MLOps Engineer
Saaf Finance
IndiaremotePosted 2 days ago
Skill Required
MLOps-EngineerMLOps-Engineer-JobsMLOps-DevOps-EngineerMLOps-EngineeringMLOps-Platform-EngineeringData-Engineering-MLOpsMachine LearningObservabilityEngineeringbuildingMaterial UIfintechTestNGPythondesignRailsCI/CDCloudUnityAWSandGenerative AICICDAIFulltime
Key highlights
- Remote-first with flexible hours
- Unlimited PTO
- $2,000/year professional development budget
- Home office setup stipend
- Competitive compensation
Role overview
Saaf AI is hiring an MLOps Engineer to own the infrastructure for their production-grade AI systems in the mortgage lending space. As part of American Heritage Lending, the role involves scaling AI services, establishing predictable deployment paths, and building internal self-serve tooling so the broader engineering team can safely and efficiently ship AI workflows.
Responsibilities
- Re-architect how AI services are deployed and run — from single-host setups to horizontally scalable, orchestrated infrastructure that absorbs traffic spikes without degrading
- Design for the specific realities of LLM-backed workloads: long-running requests, streaming responses, bursty concurrency, expensive downstream calls, and upstream rate limits
- Own capacity, autoscaling, and unit economics — you should be able to say what we spend per unit of work, and why
- Build the promotion path from development through pre-production to production, with environments that are consistent and reproducible rather than each one a special case
- Make everything version-controlled and reviewable — infrastructure, configuration, and application logic on the same rails
- Ship CI/CD that gives engineers fast deploys with real rollback, staged rollout, and change history you can audit
- Build internal tooling that lets engineers — and technically-minded teammates outside engineering — define, modify, and test AI workflow logic without touching deployment plumbing
- Design the guardrails that make that safe: validation, versioning, review, staged promotion, and a clear path back when something is wrong
- Treat internal users as customers. Success is measured in how many changes ship correctly without you being involved
- Instrument the AI stack end to end: latency, throughput, failure modes, cost, and output-quality signals
- Build alerting that catches real degradation rather than noise, and incident practice that changes the system instead of assigning blame
- Own secrets, access control, and environment isolation in a regulated industry where those things carry real consequences
Requirements
- Production infrastructure ownership: You’ve deployed and operated containerized services in production under real traffic. You’ve dealt with rollouts, autoscaling, failure isolation, resource limits, and rollback — not just a first deploy.
- Infrastructure as code: You build environments declaratively and reproducibly. Manually-configured infrastructure makes you uncomfortable, and you know how to migrate away from it without a big-bang rewrite.
- CI/CD depth: You’ve built pipelines that others depend on daily — automated testing, promotion between environments, safe rollout, and fast recovery.
- Strong Python: Our AI stack is Python. You should be able to read and change application code, profile it, and fix it — not just package and deploy it.
- Operational judgment: You can debug a production problem across application, network, and infrastructure boundaries, and you know the difference between a fix and a workaround.
- Ownership without guardrails: You drive work end to end — design, implementation, deployment, monitoring, and the follow-up when it doesn’t behave.
- Fast iteration: You ship incrementally and improve. You’re impatient with process that doesn’t reduce risk.
- Experience operating LLM or ML workloads in production — where cost, latency, and non-deterministic output are all live concerns
- Cloud deployment experience (AWS preferred) — you can containerize, deploy, scale, and operate the systems you own
- Experience in fintech, lending, insurance, or another regulated industry — secrets management, access control, audit trails, PII handling
- Built internal developer platforms or self-serve tooling that non-infrastructure engineers actually used
- Full-stack comfort — you can build a lightweight UI or internal tool when the platform needs one, rather than waiting for someone else to
Nice to have
- Experience designing multi-environment promotion pipelines where configuration and logic move together with code
- Familiarity with agent orchestration frameworks and what it takes to run them reliably
- Observability for non-deterministic systems — tracing, evaluation signals, quality monitoring alongside standard telemetry
- Inference optimization: model serving, batching, caching, and cost reduction strategies
- Exposure to workflow automation tooling and low-code builders
Benefits
- Competitive compensation
- Unlimited PTO
- Remote-first with flexible hours
- $2,000/year professional development budget
- Home office setup stipend
Additional details
- Saaf AI is part of American Heritage Lending, a top-10 private lender processing billions in loan volume, with 15+ years of growth, and backed by some of the largest asset managers and funds.
- This role is right for you if you’ve taken AI or ML systems from a single deployment to infrastructure that scales — and you’ve been on call for the result, treat infrastructure as a product with users, think deploys should be boring, reversible, and frequent, and would rather remove yourself from the critical path than be the person everyone has to ask.
- AI-first means AI-first. Every engineer here uses AI to build AI (Claude Code, agentic workflows, AI-assisted code review).
- Originally posted on Himalayas