Go - Senior Backend Engineer, AI Coding Agent Quality
G2i
WorldwideremotePosted 10 days ago
Skill Required
Senior-AI-Backend-EngineerGoLang-Backend-EngineerSenior-Golang-Software-EngineerSenior-AI-Backend-DeveloperGoLang-Backend-DeveloperSenior-Backend-Developer-(Artificial-Intelligence)Backend-AI-EngineerSenior-Golang-DeveloperAI-Backend-EngineerSenior-Go-DeveloperBackend DeveloperAI EngineerGoAIEngineeringJavaScriptTypeScriptPythondesignOpenAPIRustandContract
Key highlights
- $100–$200/hour
- 10–20 hrs/week
- SR+/Principal-level engineer (or equivalent)
- Start ASAP
- Contract through early May (possible extension)
Role overview
We’re looking for a highly experienced software engineer (SR+/Principal level) to evaluate the quality of interactions with modern AI coding agents like OpenAI Codex and Claude Code. This is a contract role focused on assessing whether AI-generated interactions demonstrate strong engineering judgment, useful reasoning, and appropriate behavior—not writing production code. The evaluator will assess real-world AI coding interactions for usefulness, correctness at a high level, alignment with strong engineering thinking, and quality of explanations and reasoning.
Responsibilities
- Evaluate AI-generated coding interactions end-to-end
- Judge whether outputs are: Useful, Correct (at a high level), Aligned with how a strong engineer would think
- Assess the quality of explanations and reasoning, not just code
- Distinguish between different levels of response quality (e.g. what makes something a 2 vs 4)
- Provide clear, opinionated feedback on: What worked, What didn't, What felt 'off' or misleading
- Help define what great looks like when interacting with tools like Cursor
- Assess how AI coding agents behave in real-world scenarios — focusing on: Whether the response makes sense, Whether the preamble and reasoning are useful, Whether the output reflects strong engineering judgment, Whether the interaction feels right to an experienced developer
- Make subjective but rigorous judgments about whether AI interactions reflect strong engineering judgment
Requirements
- Staff / Principal-level engineer (or equivalent experience)
- Strong background in one of the below: TypeScript / JavaScript, Python
- Hands-on experience using: OpenAI Codex, Claude Code
- Deep familiarity with modern AI-assisted dev workflows
- Able to evaluate code without needing to fully execute or deeply review every line
- Comfortable giving direct, opinionated feedback
- High bar for what 'good engineering' looks like
- Take-home evaluation exercise
- One behavioral interview
Nice to have
- Experience with tools like Cursor or similar AI-first IDEs
- Prior exposure to prompt design or evaluation workflows
- Experience mentoring senior engineers or defining engineering standards
Additional details
- Contract position
- $100–$200/hour
- 10–20 hrs/week
- Duration: Through early May (with possible extension)
- Start: ASAP
- This is not a traditional engineering role
- You won't be writing production code
- Check out this Loom video for more details!
- Originally posted on Himalayas