Product Manager, Inference Experience at Baseten
RemoteSan FranciscoEPDFull-timePosted Nov 11, 2026$200K–$400K per year
About the role
As published on Baseten's job board.
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
PRODUCT AT BASETEN
Baseten is building a new cloud for AI. Our ambition is to make inference, training, and agent execution part of one coherent platform, and to shape how the next generation of AI products gets built. Product decisions here reach from the economics of GPU infrastructure to the abstractions developers build on every day.
We’re hiring builders and tastemakers with the ambition to help create that future. You should bring a strong point of view about what should exist, the taste to make complex technology feel simple, and the technical judgment to build it alongside engineers, researchers, and designers. You’ll work directly with customers and forward deployed teams, turn emerging capabilities into new possibilities for developers, and carry an idea from early conviction through to production and adoption.
THE ROLE
Make world-class AI inference feel effortless for developers.
Building with AI models should be easy. Getting them into production, understanding their performance, and scaling them reliably is anything but. At Baseten, we're changing that.
We're looking for a Product Manager to own the experience of building on Baseten, from discovering and evaluating models to deploying, optimizing, and operating them in production.
You'll help shape some of our most important products, including Model APIs, Dedicated Inference, Model Evaluations, and our Model Library. You'll work closely with engineering, research, and GTM to turn breakthroughs in inference performance into products that developers love and businesses depend on.
This is a high-impact role at the intersection of AI infrastructure, developer experience, and product strategy.
RESPONSIBILITIES
- Own product strategy and roadmap across Baseten's inference offerings, with a focus on developer adoption and business impact
- Make it easier for developers to discover, evaluate, deploy, and manage AI models through our APIs, SDKs, CLI, and console
- Work with inference engineers and researchers to turn technical advances into compelling customer-facing capabilities
- Help determine which models, workloads, and customer needs we prioritize
- Partner with GTM and leadership on pricing, packaging, launches, and commercialization
- Spend time with developers and customers to understand what's working, what's frustrating, and what we should build next
REQUIREMENTS
- 10+ years building and shipping AI/ML products or platforms
- A technical background in software engineering, ML engineering, research, or equivalent hands-on experience
- Direct experience building or deploying models using technologies like PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar frameworks
- Strong understanding of model serving, GPU economics, and the tradeoffs between quality, latency, throughput, and cost
- Exceptional developer product instincts. You know how to make complex technology approachable without sacrificing power
- A track record of leading cross-functional product initiatives and turning technical capabilities into measurable adoption or revenue growth
NICE TO HAVE
- Experience deploying models, building infrastructure products, building ML infrastructure, or designing tools used from both a terminal and a console
- Past experience as a software developer
WHAT SUCCESS LOOKS LIKE
Developers choose Baseten for a clear, compelling inference experience, from discovering a model to operating it at scale. Model APIs and Dedicated Inference offer clear paths that fit different workloads. Developers can move from a model to a repeatable production workflow with less assistance. Evaluation, artifacts, and releases fit together, and the experience makes customers more confident shipping their next model change. Engineering advances reach customers through successful launches and sustained production use.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Similar roles at other companies
Open machine learning and AI engineering jobs elsewhere, newest first.
| Role | Company | Salary | Posted | Actions |
|---|---|---|---|---|
| Product Manager, Perception General Services | Waymo | — | Tailor | |
| Applied AI Architect, Beneficial Deployment Applied AI | Anthropic | — | Tailor | |
| Principal Engineer, LLM Machine Learning Department | Upstart | $238K–$330K | Tailor | |
| Staff Machine Learning Engineer, Ads Lightweight Ranking EPD Ads and Ads Product | $189K–$390K | Tailor | ||
| Senior Staff Machine Learning Engineer, Ads Ranking Ads Product & Engineering | $266K–$372K | Tailor | ||
| Senior Machine Learning Engineer Engineering | Nabla | — | Tailor |
- Product Manager, PerceptionPERM - N/ANov 21General Services
- Applied AI Architect, Beneficial DeploymentSydney, AustraliaNov 20Applied AI
- Principal Engineer, LLMRemoteUnited States$238K–$330KNov 19Machine Learning Department
- Staff Machine Learning Engineer, Ads Lightweight RankingRemoteSan Francisco, CA$189K–$390KNov 19EPD Ads and Ads Product
- Senior Staff Machine Learning Engineer, Ads RankingRemote$266K–$372KNov 19Ads Product & Engineering
- Senior Machine Learning EngineerParis officeNov 19Engineering
All machine learning and AI engineering jobs at AI and tech companies
Before you apply
- Scan your resume against this posting to see which of its terms you are missing.
- Tailor your resume so the summary and bullets use the posting's own wording where it is true for you.
- Read the machine learning engineer resume guide and the interview questions for the role.
- Apply on Baseten's site. Applications never pass through OneTwo Resume.
About Baseten
Inference platform for deploying and scaling open-source and custom AI models.
All open roles at Baseten · All machine learning and AI engineering jobs at AI and tech companies
More roles at Baseten
| Role | Salary | Posted | Actions |
|---|---|---|---|
| Base Labs Research Scientist - RL Environments EPD | $210–$285 | Tailor | |
| Web Engineer GTM | $200K–$240K | Tailor | |
| Strategic Events Manager GTM | $200K–$240K | Tailor | |
| Design Engineer (Brand Team) EPD | $190K–$240K | Tailor | |
| Data Center Hardware Operations Site Lead EPD | $150K–$295K | Tailor | |
| Revenue Strategy & Operations Manager (Solutions Architects) GTM | $185K–$235K | Tailor |
- Base Labs Research Scientist - RL EnvironmentsRemoteSan Francisco$210–$285Nov 20EPD
- Web EngineerRemoteSan Francisco$200K–$240KNov 20GTM
- Strategic Events ManagerRemoteSan Francisco$200K–$240KNov 20GTM
- Design Engineer (Brand Team)RemoteSan Francisco$190K–$240KNov 20EPD
- Data Center Hardware Operations Site LeadSanta Clara$150K–$295KNov 20EPD
- Revenue Strategy & Operations Manager (Solutions Architects)RemoteSan Francisco$185K–$235KNov 19GTM