Product Manager On-Device & Edge AI
Sarvam AI
Skill Required
Key highlights
- 4–8 years of product management experience required
- Enterprise SaaS or B2B AI product experience required
- High-impact role with ownership from day one
- Work with top-tier silicon partners (Qualcomm, Intel, HP, Apple, NVIDIA)
Role overview
Sarvam is building India's full-stack sovereign AI platform, focusing on making AI work for India across research, models, infrastructure, and applications. The company partners with leading enterprises and public institutions and is backed by top-tier investors like Lightspeed, Peak XV, and Khosla Ventures. This role is for a Product Manager to own the product roadmap for Sarvam’s on-device AI product line, designed for enterprise deployments where data sovereignty, low latency, and offline reliability are critical. The role involves deep collaboration with engineering, sales, and customer success to define enterprise-grade AI for on-device, edge, and secure perimeter deployments, with a focus on embedding AI into workflows at scale across India.
Responsibilities
- Own the product roadmap for Sarvam, from on-device inference to enterprise deployment and fleet management
- Define and prioritise features for IT admin personas — MDM integration, device provisioning, policy enforcement, and enterprise authentication (including Microsoft ecosystem)
- Drive B2B GTM alignment by working with sales and customer success to translate customer pain points into product requirements
- Run iterative experiments in enterprise deployments to identify and improve workflow stickiness and adoption
- Design and ship features for multi-tenant SaaS architecture, including tenant isolation, access controls, and admin tooling
- Define requirements for HITL (human-in-the-loop) and agentic workflows, ensuring enterprise-grade reliability and auditability
- Work across security and compliance requirements — data residency, enterprise auth (SSO, SAML, SCIM), and regulatory standards relevant to enterprise AI
- Collaborate with engineering on API design and integration patterns for enterprise tooling and partner ecosystems
- Define and track product metrics that measure enterprise engagement, retention, and workflow depth
- Co-own as a Full Stack product builder the most ambitious on-device AI problem in India building sovereign models that run at the silicon level across devices
- Be embedded with silicon partners like Qualcomm, Intel, HP, Apple, NVIDIA etc turning research breakthroughs into production-grade optimisations that serve 1.5b Indians at minimal latency
- Architect the Product motion from tuning to agentic orchestration and client deployment
Requirements
- 4–8 years of product management experience, with significant time in enterprise SaaS or B2B AI products
- Demonstrable experience with on-device or edge AI products, or IT fleet management and enterprise device management
- Strong understanding of enterprise authentication and identity — Microsoft ecosystem (Entra ID, Intune, Azure AD), SSO, SAML, or SCIM
- Experience running structured product experiments and using data to drive roadmap decisions in enterprise contexts
- Ability to work directly with IT admin and enterprise buyer personas — understanding their workflows, constraints, and decision criteria
- Comfort with technical depth: APIs, security and compliance requirements, and multi-tenant SaaS architecture
Nice to have
- Experience with HITL workflows or agentic AI product design
- Prior exposure to data residency, sovereign cloud, or on-premise enterprise AI deployments
- Familiarity with MDM/UEM platforms (Jamf, Intune, or equivalent)
- Experience working on AI products in regulated industries (BFSI, healthcare, or government)
- Background that combines technical depth with business or GTM exposure
- Background in Computer Science or Electrical Engineering
Benefits
- Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
- High ownership and high impact, from day one
- Everything we do is AI-first, from the way we build and ship to the way we think about problems
- You can work on problems that could change how an entire country learns, works, and communicates
Additional details
- Sarvam is building the bedrock of Sovereign AI for India
- Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures
- Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC
- This is not a feature team, it is a platform-defining role