Software Engineer, Distributed Systems & AI Agents (Senior Level)
Instabase
Bengaluru, IndiaPosted 1 month ago
Skill Required
Product EngineeringAI EngineerSoftware EngineerSoftware DeveloperSystem DesignSOCObservabilityKubernetesPythonKotlinRabbitMQC++KafkaJavaRustGenerative AIRAGMachine Learning
Key highlights
- 5+ years of software engineering experience required.
- Strong fundamentals in distributed systems, concurrency, APIs, data modeling, and failure handling.
- Proficiency required in Python, Go, Java, Kotlin, Rust, or C++.
- Experience required with queues, databases, caching, containers, cloud infrastructure, and production observability.
- Opportunity to build systems that can scale to workloads up to 1,000,000× larger than prototypes.
- Equal Opportunity Employer promoting inclusive hiring.
Role overview
We are looking for a systems‑minded engineer to build the distributed backend and execution infrastructure that powers AI agents. The role involves building scalable, reliable, and secure systems at the intersection of distributed systems, agentic execution, and applied AI, working on challenges such as large‑scale unstructured‑data extraction, reliable backend infrastructure for long‑running AI workflows, and R&D into LLM advances.
Responsibilities
- Take new ideas from 0‑to‑1 quickly, then evolve their architecture to scale by orders of magnitude—from early prototypes to production systems handling workloads that are 10×, 1,000×, or even 1,000,000× larger.
- Build scalable distributed systems for large‑scale unstructured‑data extraction and agentic workloads.
- Develop reliable execution infrastructure for scheduling, retries, timeouts, cancellation, rate limits, and failure recovery.
- Build agent runtimes that coordinate model calls, tool execution, durable state, multi‑step loops, and human approvals.
- Evaluate emerging models and AI techniques through benchmarks and experiments, and apply them to new platform and customer problems.
- Own systems from design through production, including testing, observability, and pragmatic trade‑offs across reliability, performance, security, and cost.
Requirements
- 5+ years of software engineering experience building and operating production backend systems, with the ability and experience to serve as a technical lead—setting direction, leading teams through complex projects, and mentoring and coaching engineers while remaining hands‑on.
- Strong fundamentals in distributed systems, concurrency, APIs, data modeling, and failure handling.
- Experience with agentic execution systems, workflow orchestration, event processing, scheduling, or high‑volume services.
- Proficiency in a backend language such as Python, Go, Java, Kotlin, Rust, or C++.
- Experience with queues, databases, caching, containers, cloud infrastructure, and production observability.
- Experience building or integrating ML, generative‑AI, or LLM‑based systems, including tool calling and agent workflows.
- A strong ownership mindset across design, deployment, monitoring, incident response, and continuous improvement.
Nice to have
- Helpful experience with workflow engines or task executors.
- Experience with Kafka, Temporal, Celery, Ray, or similar systems.
- Experience with Kubernetes.
- Experience with agent runtimes, Retrieval‑Augmented Generation (RAG), evaluations, model gateways, MCP, or AI observability.
Additional details
- Instabase is passionate about democratizing access to cutting‑edge AI innovation to enable any organization to solve previously unsolvable unstructured data problems.
- Customers include some of the largest and most complex organizations in the world; investors include Greylock, Andreessen Horowitz, and Index Ventures; market opportunity described as near infinite.
- Instabase offers a consumption‑based pricing model where customers pay only for what they use, aligning directly with the value the products deliver.
- The model empowers clients to explore the AI Hub platform features extensively, uncovering crucial business insights.
- Offices in San Francisco and Bengaluru; global company; people‑first culture; fearlessly experimental, endlessly curious, customer‑obsessed team.
- Instabase is an Equal Opportunity Employer; qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, protected veteran status, or disability status.
- Research note about gender‑based application behavior and encouragement for all qualified individuals to apply regardless of identity.