Senior Software Engineer (AI / LLMs)
apiphani
Australia, Canada, Germany, India, Ireland +5 moreremotePosted 2 months ago
Skill Required
Software-EngineeringBackend-DevelopmentAI-EngineeringAgentic-AI-EngineeringCloud-Infrastructure-EngineeringDistributed-Systems-EngineeringDevOpsSenior-AI-Software-EngineerSenior-Software-AI-EngineerSenior-AI-LLM-EngineerSenior-AI-ML-EngineerSenior-AI-EngineerSenior-Lead-AI-EngineerSenior-AI-ML-DeveloperSenior-AI-EngineeringAI EngineerSoftware EngineerSoftware DeveloperGenerative AIAISystem DesignGitHub ActionsMicroservicesObservabilityEngineeringTypeScriptPostgreSQLLangChainTerraformdesigningsimilar)DatadogsecuritybuildingRAGetc.)TestNGPythonDockerdesignGitOpenAPIFulltime
Key highlights
- Base Salary: $120,000—$160,000 USD
- 6+ years of backend engineering experience required
- Remote full‑time position
- 401K with 3% company contribution
- Fully paid medical/dental/vision coverage for employees
- Strong proficiency in Python and TypeScript
Role overview
Apiphani, a technology-enabled managed services company, is building the future of intelligent infrastructure automation through an agentic AI platform called Luumen. They are seeking a Senior Software Engineer (Backend) to design and build the backend foundations for large-scale AI orchestration, integrating LLMs, vector databases, and AWS services. This high-impact, zero-to-one role involves creating scalable systems, APIs, and monitoring pipelines while collaborating with product and DevOps teams in a remote, fast-moving environment.
Responsibilities
- Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions
- Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases, and observability pipelines
- Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure
- Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities
- Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant)
- Build robust monitoring, testing, and CI/CD systems to ensure reliability and reproducibility of AI workflows
- Collaborate closely with the product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health
- Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices
- Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality
Requirements
- 6+ years of backend engineering experience in production environments
- Strong proficiency in Python and TypeScript for building distributed, event-driven systems
- Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.)
- Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models
- Familiarity with vector databases and concepts like embeddings, similarity search, and retrieval-augmented generation
- Experience with infrastructure-as-code tools such as Terraform or AWS CDK
- Understanding of SQL and schema migration workflows (PostgreSQL or similar)
- Hands‑on experience with Docker, GitHub Actions, and cloud‑native CI/CD workflows
- Ability to diagram systems, communicate architecture decisions clearly, and work asynchronously in a distributed team
- Strong sense of ownership and ability to deliver in fast‑moving, ambiguous environments
Nice to have
- Experience working with LangChain, OpenAI, or Anthropic APIs
- Familiarity with agentic frameworks or AI orchestration systems
- Background in observability or APM tooling (e.g., Datadog, Dynatrace)
- Prior experience building automation or infrastructure management tools
- Contributions to open‑source LLM or MLOps projects
- Interest in shaping how AI is applied to real‑world IT operations
Benefits
- Medical/dental/vision - 100% paid for employees, 50% paid for dependents
- Life and disability - 100% paid for employees
- 401K - 3% contribution, no employee contribution necessary
- Education and tuition reimbursement
- Accident, critical illness, hospital indemnity benefits offered through our providers
- Employee Assistance Program
- Legal assistance
- Paid Time Off - up to 6 weeks per year
- Sick Leave - up to 2 weeks per year
- Parental Leave - up to 12 weeks
- Remote work (Location: Remote)
- Full‑time employment
Additional details
- Apiphani is a technology‑enabled managed services company dedicated to redefining what it means to support mission‑critical enterprise workloads.
- The company is small but rapidly growing, offering room for growth and learning opportunities.
- Apiphani is dedicated to creating a diverse and inclusive work environment for all as a fundamental component of its business.
- Diversity and inclusion are highlighted as the bedrock of creativity and innovation at Apiphani.
- Location: Remote | Full‑time | Competitive Compensation
- Originally posted on Himalayas
- Benefits listed apply to employees working in the United States; international employees receive statutory benefits via Deel, with some U.S.-specific programs possibly unavailable.