Member of Technical Staff - Research, Inference
Before you apply
Listed location: New York
Work arrangement: onsite. A remote label does not confirm worldwide eligibility or visa sponsorship.
Stated pay: $150,000–$350,000 USD per year, as published by the employer.
Read the employer’s description for qualifications, compensation and work eligibility. Confirm the position is still open on the application page.
Job description supplied by Modal; category and skill labels may be inferred. How our listings work · Report a problem
Job Description
About Us:
AI needs a new infrastructure layer. We're building it at Modal.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn,Luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
The Role:
Most of the value of owning a model shows up at serving time. We’re building a platform that covers the whole life of an LLM (train it, deploy it, observe it), and inference is where teams feel the difference every day. We already run elastic inference, sandboxes, distributed volumes, and multi-node training, and we control the infrastructure underneath, so the serving stack is ours to shape rather than something we resell.
You will do hands-on inference research at Modal, working with the research lead to pick high-impact bets and owning them end to end. The bets that matter most are the ones that move cost per token and tail latency on the workloads our customers actually run.
What You’ll Work On:
Own end-to-end inference research bets: speculative decoding, disaggregated prefill/decode, quantization (FP8, INT4), KV-cache and memory management, autoscaling for spiky serverless traffic, and whatever else the research agenda calls for
Train custom speculators against real production traffic and feed what you learn back into target models; acceptance length is the metric that decides the win
Work directly with customers alongside our Forward Deployed Engineers to deploy and tune models, and bring what you learn back into the research
Carry and expand collaborations with outside research labs, for example:
our work with ZLab on DFlash, a speculator design built on KV injection and blockwise parallel drafting
our work with SGLang on specdec and multimodal inference performance
our work on Flash Attention 4 kernels
Work with engineering to turn frontier serving techniques into products: primitives for disaggregation, fast weight refresh for models that keep training after deployment, observability for quality and latency in production, or even a next-generation inference engine
Help shape the research agenda
None of the above is prescriptive; your work will help guide our future.
You May Be a Fit If:
You have a research-leaning or systems background in LLM inference, with work you can point to
You’re fluent in the LLM serving stack, from kernels and quantization up to schedulers and autoscaling
You have a record of shipping research or systems that other people build on, whether in a lab or in industry
You have the drive to independently take a research bet from idea to result, working in the open with the rest of the team
You’re able to work in person in our NYC or San Francisco office
Skills mentioned
Categories
Frequently asked questions
Is the Member of Technical Staff - Research, Inference position at Modal remote?
The Member of Technical Staff - Research, Inference role at Modal does not have a confirmed remote arrangement in our data. Check the employer description for its work location.
What type of employment is the Member of Technical Staff - Research, Inference role?
Modal is hiring for a full-time Member of Technical Staff - Research, Inference position.
Which skills are mentioned for the Member of Technical Staff - Research, Inference job at Modal?
Detected skill labels include LLM, Multimodal, GPU. Check the employer description to distinguish required skills from preferred experience.
How do I apply for the Member of Technical Staff - Research, Inference position at Modal?
You can apply for the Member of Technical Staff - Research, Inference role directly through Modal's official application link provided on this page.
Similar AI jobs
Staff Network Production Engineer, Deployment
Crusoe · fulltime
Solutions Architect, Manufacturing
NVIDIA · fulltime
Technical Trainer
Crusoe · fulltime
Engineering Manager, Kubernetes Control Plane - Lambda Kubernetes Service
Lambda · fulltime
Senior Mechanical Engineer, Connected Warfare
Anduril · fulltime
Mechanical Engineer, Connected Warfare
Anduril · fulltime