Together AI
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure
San Francisco
Greenhouse· posted 7 days ago
- Staff+
- Kubernetes
- CUDA
- Node.js
- Salesforce
Sign in and add your resume to see how well this job fits you, and why.
About the job (preview)
About The Role
We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and controllers that let the inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled underneath. Your job is to keep that promise true in the real world: triaging InfiniBand issues when prefill and decode nodes stall exchanging KV cache over RDMA, diagnosing hero-model and…
Read the full posting on Together AI's site ↗Source: greenhouse public API