QA AI Automation Engineer
Welltory
WorldwideremotePosted 1 month ago
Skill Required
QA-Automation-EngineerAI-Testing-EngineerMobile-Test-Automation-EngineerSoftware-QA-EngineerAutomation-TestingAI-QA-EngineerQuality-Assurance-Automation-EngineerAI-Automation-EngineerAI EngineerQA EngineerAIManual TestingTest AutomationWeb AccessibilityEngineeringData StructuresbuildingAndroidwrittenTestNGAppiumdesignFigmaDesign PatternsAPIsGenerative AIiOSGoFulltime
Key highlights
- R&D role focused on AI and automation in QA
- Fully remote and asynchronous work
- Stock option program available
- 17M+ users and 140K+ five-star ratings
- Company-paid days off and no time trackers
- Hardware subsidy after six months
Role overview
Welltory is a health-tech company with over 17 million users, helping people improve their health through data analysis. This R&D-focused role involves building AI and automation tools to replace manual QA processes, as the current manual testing has become a bottleneck. The position blends classic mobile test automation with experimental AI-driven solutions (e.g., AI navigating the app, pixel-by-pixel screen comparisons, or automatic bug filing). The core challenge includes validating health data calculations and algorithms, not just UI behavior. The role is ideal for those comfortable with uncertainty, rapid experimentation, and shaping QA processes from the ground up rather than working within a mature, predefined framework.
Responsibilities
- Automating testing workflows — taking specific manual processes (regression testing, design acceptance, smoke testing, traffic analysis, validating calculation consistency between builds) and replacing them with automated tests or AI-powered tools that become reliable parts of our workflow
- Running R&D experiments — evaluating new AI tools and automation approaches on real problems: do they work, do they match manual quality, are they worth adopting? Quickly discarding ideas that don’t deliver
- Building and evolving automation infrastructure — turning successful experiments into stable tools and workflows used across the entire QA guild
- Working closely with the team — partnering with QA engineers (to decide what to automate first), developers (to make sure the product exposes everything automation needs, such as accessibility elements), and the QA guild lead (to align on priorities)
- Sharing knowledge and raising the bar — documenting discoveries, introducing new tools and approaches, and helping the whole QA team become more effective
Requirements
- Automation background: you’ve written automated tests before and understand how test automation works — where it creates real value and where it becomes maintenance for maintenance’s sake. The specific stack is secondary
- An R&D mindset: you’re comfortable with uncertainty. You can take a tool with no proven track record, quickly validate the “works / doesn’t work” hypothesis, document the outcome, and move on instead of waiting for someone to break the task into detailed steps
- Willingness to work with data (using AI): our product is built around analyzing health data and generating meaningful results for users, so many of our QA tasks involve validating calculation algorithms rather than just UI behavior. You don’t need to be a data scientist or analyst, but you should be comfortable exploring data with the help of AI: comparing calculation results across builds, identifying where numbers started to diverge, and verifying that updated algorithms produce expected outputs
- A genuine interest in AI tools: you haven’t just “heard about AI” — you actively use it in your work, keep up with new tools, and understand that test automation in 2026 goes far beyond Appium or XCUITest. It includes AI agents, MCP, LLMs, scripts, and automated workflows that glue entire processes together
- Engineering thinking beyond autotests: you naturally spot repetitive work and think about eliminating it — whether through automated tests, scripts, AI pipelines, or process improvements. We’re optimizing much more than test execution: acceptance testing, regression, traffic analysis, bug workflows, and more
- Understanding what you’re automating: you have a solid understanding of how a mobile application communicates with the backend (client ↔ server, APIs, state management, analytics). You can’t automate a check for something you don’t understand
- Async self-sufficiency: we’re a fully remote, asynchronous team. You move your own work forward, ask questions in public channels, and communicate clearly in writing
Nice to have
- Experience with mobile automation (iOS / Android). Nice to have, but a strong R&D/AI mindset combined with general automation experience can absolutely compensate
- Hands-on experience using AI agents, MCP, and LLM-based tools in real production work
- Experience working on Health or Wellness products
Benefits
- Fully remote — live wherever you want and work alongside colleagues from around the world
- Asynchronous communication — our primary tools are Slack, Confluence, and Asana. We only jump on Zoom when synchronous discussion is actually needed. We value thoughtful written communication
- Healthy flexibility — company-paid days off whenever you need to recharge or relocate. No time trackers
- Trust by default — no micromanagement. Especially important in an R&D role, where you’re expected to experiment, learn, and occasionally fail
- Hardware with a 50% subsidy after six months
- An in-house psychologist to support the team
- A stock option program for meaningful contributions
- Regular salary reviews based on performance reviews, with opportunities for both horizontal and vertical growth
Additional details
- A health app with 17M+ users across 130 countries and more than 140K five-star ratings in the app stores
- We analyze users’ health data and provide personalized recommendations
- We work using the Shape Up methodology with well-defined release cycles
- All development (iOS, Android, Web, Backend) happens within one product organization
- We’re transparent: every quarter the whole company hears about our business performance, strategy, and key metrics
- We openly share failures — R&D can’t exist without experiments that don’t work out, and that’s completely normal
- Your work will directly influence how quickly we can ship new features without sacrificing quality. The impact is tangible and measurable
- If you feel like you’re slightly below the bar in one area but everything else describes you perfectly — apply anyway. We care much more about your test assignment and interviews than about checking every single box
- Fill out the application form (takes about 15–20 minutes). Share your resume and tell us about your experience. Complete a test assignment. If we move forward, expect 2–3 interview stages: an HR screening, a technical interview, and a final interview with the team
- Originally posted on Himalayas