Together AI
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
San Francisco
Greenhouse· posted 3 months ago
- Staff+
- Kubernetes
- CUDA
- Go
- Python
Sign in and add your resume to see how well this job fits you, and why.
About the job (preview)
About the Role
We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool is doing the work. You'll also build the systems that keep the fleet…
Read the full posting on Together AI's site ↗Source: greenhouse public API