Senior Software Engineer - Python
G2i
WorldwideremotePosted 9 days ago
Skill Required
Senior-Python-Software-EngineerSenior-Python-EngineerPython-DeveloperPython-Software-EngineerSenior-Python-Backend-DeveloperSenior-Backend-Python-DeveloperSoftware EngineerSoftware DeveloperPython DeveloperPythonEngineeringJavaScriptTypeScriptdesignOpenAPIandAIContract
Key highlights
- $100–$200/hour
- Contract, 10–20 hrs/week
- Start ASAP (through early May)
- Staff/Principal-level engineer or equivalent experience required
- Hands-on experience with OpenAI Codex, Claude Code, and Cursor required
- Not a traditional engineering role — no production code writing
Role overview
Senior AI Interaction Evaluator (Codex / Claude Code) — a contract role evaluating the quality of AI coding agents' interactions rather than writing production code. The position assesses whether models like OpenAI Codex and Claude Code demonstrate strong engineering judgment, clear reasoning, and useful explanations in real-world developer scenarios. The role focuses on 'engineering taste' — subjective but rigorous evaluation of how models communicate, guide users, and reflect expertise, rather than just syntactic correctness. The engagement runs approximately 10–20 hours per week at $100–$200/hour through early May, starting ASAP.
Responsibilities
- Evaluate AI-generated coding interactions end-to-end
- Judge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would think
- Assess the quality of explanations and reasoning, not just code
- Distinguish between different levels of response quality (e.g., what makes something a 2 vs 4)
- Provide clear, opinionated feedback on what worked, what didn't, and what felt 'off' or misleading
- Help define what great looks like when interacting with tools like Cursor
- Assess whether responses make sense, preambles and reasoning are useful, outputs reflect strong engineering judgment, and interactions feel right to an experienced developer
Requirements
- Staff / Principal-level engineer (or equivalent experience)
- Strong background in TypeScript / JavaScript or Python
- Hands-on experience using OpenAI Codex
- Hands-on experience using Claude Code
- Hands-on experience using Cursor
- Deep familiarity with modern AI-assisted dev workflows
- Able to evaluate code without needing to fully execute or deeply review every line
- Comfortable giving direct, opinionated feedback
- High bar for what 'good engineering' looks like
- Take-home evaluation exercise
- One behavioral interview
Nice to have
- Experience with tools like Cursor or similar AI-first IDEs
- Prior exposure to prompt design or evaluation workflows
- Experience mentoring senior engineers or defining engineering standards
Additional details
- Contract position
- Rate: $100–$200/hour
- Hours: ~10–20 hours/week
- Duration: Through early May (with possible extension)
- Start: ASAP
- Check out this Loom video for more details!
- Originally posted on Himalayas
- This is not a traditional engineering role
- You won't be writing production code
- You should be comfortable making subjective but rigorous judgments