AI
Curated AI Jobs
Turbopuffer

software eng, inference

Turbopuffer16 Nov 2026
fulltimeonsite
Apply for this position

Before you apply

Listed location: US / Canada

Work arrangement: onsite. A remote label does not confirm worldwide eligibility or visa sponsorship.

Read the employer’s description for qualifications, compensation and work eligibility. Confirm the position is still open on the application page.

Job description supplied by Turbopuffer; category and skill labels may be inferred. How our listings work · Report a problem

Job Description

turbopuffer is looking for a software engineer who wants to build inference for searching +1T documents.

what you'll do:

  • work closely with our inference providers to make sure that the p99 inference latency stays as low as possible

  • write code to improve how the database interacts with our inference providers

  • integrate new embedding & reranking models into turbopuffer

  • automate yourself out of a job

must have:

  • engineering

    • you've worked in a systems language (Rust, C++, Java, Go, etc.)

    • experience in inference engineering, e.g. managing a production deployment of an LLM/embedding/reranking model

    • worked on handling/processing large datasets

    • you love shipping things to prod

  • domain expertise

    • you understand the tradeoff between latency and throughput for model deployments and you know how to think about improving model performance

    • keeping up with state-of-the-art embedding & reranker models and their evaluation

    • you’re familiar with the most common inference engines like vLLM and SGLang

    • you know how to manage the infra of model deployments and how to reason about GPU autoscaling.

  • typist - you can write well and can explain complex ideas simply

  • human - you build trust and admit what you don’t know

nice to have:

  • an interest in embedding & reranker model training

  • prior experience in vector and full-text search

  • knowledge about in-depth areas of inference engines & GPU engineering

tpuf is hardcore & whimsical. we value:

  • overstep > understep

  • show > tell

  • complexity is earned

  • showing up as part of our customer’s team

  • making stuff easy to react to

Skills mentioned

GoRustReactLLMC++JavaGPU

Categories

Frequently asked questions

Is the software eng, inference position at Turbopuffer remote?

The software eng, inference role at Turbopuffer does not have a confirmed remote arrangement in our data. Check the employer description for its work location.

What type of employment is the software eng, inference role?

Turbopuffer is hiring for a full-time software eng, inference position.

Which skills are mentioned for the software eng, inference job at Turbopuffer?

Detected skill labels include Go, Rust, React, LLM, C++, Java, GPU. Check the employer description to distinguish required skills from preferred experience.

How do I apply for the software eng, inference position at Turbopuffer?

You can apply for the software eng, inference role directly through Turbopuffer's official application link provided on this page.

Interested in this role?

Apply directly on the company's website.

Apply Now
Turbopuffer

Turbopuffer

Website
Posted16 Nov 2026
Typefulltime
LevelMid-level
LocationUS / Canada
Apply NowView All Jobs at Turbopuffer

Share this job