Performance Engineer, On-Device Inference
Sarvam AI
Bengaluru, IndiaPosted 3 months ago
S
Skill Required
Infrastructure buildingPyTorchDesign PatternsAIMachine LearningFulltime
Key highlights
- 3+ years experience in ML systems
- Quantization in production on at least one real model
- Comfort with at least two of ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT
- Ownership of 1–2 model‑chipset pairs across Intel, ARM, Apple, Nvidia/AMD GPUs
- High ownership and impact from day one
- Company backed by Lightspeed, Peak XV, and Khosla Ventures
Role overview
Take Sarvam models from research-handoff state to production‑ready artifacts on at least two of our target chipsets (Intel xPU, ARM xPU, Apple xPU, Nvidia / AMD GPUs). You’ll own 1–2 model‑chipset pairs end‑to‑end and partner with the consuming app team during integration.
Responsibilities
- Quantize, validate accuracy, benchmark, and document each model‑chipset pair you own.
- Author the deployment workbook for each pair you own.
- Embed part‑time with consuming teams during integration to debug performance and accuracy issues.
- Maintain and extend the team's benchmark harness.
Requirements
- 3+ years on ML systems.
- Solid PyTorch + ONNX export experience including the gotchas (dynamic shapes, control flow, custom ops).
- Quantization in production on at least one real model.
- Comfort with at least two of: ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT.
- Profiling fluency on at least one platform.
Nice to have
- Custom op authoring in any runtime.
Additional details
- Sarvam is building the bedrock of Sovereign AI for India.
- The company is developing India’s full‑stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India.
- Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures.
- Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
- Sarvam is a fast‑moving, high talent‑density team building full‑stack AI for India, working on problems that push the frontiers of AI with real population‑scale impact.
- Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar.
- High ownership and high impact, from day one.
- Everything we do is AI‑first, from the way we build and ship to the way we think about problems.
- You can work on problems that could change how an entire country learns, works, and communicates.
- If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.