Python - Senior Backend Engineer, AI Coding Agent Quality
Python - Senior Backend Engineer, AI Coding Agent Quality is an open role at G2i Talent, available remotely, with pay listed as $100–$200/hr.
Applications open on G2i Talent’s own site. How we make money.
About this role
Senior AI Interaction Evaluator (Codex / Claude Code) Contract | $100–$200/hour | 10–20 hrs/week | Start ASAP (through early May) Check out this Loom video for more details! We’re looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role. You won’t be writing production code. You’ll be evaluating something harder: whether the model thinks like a great engineer. What This Role Actually Is You will assess how AI coding agents behave in real-world scenarios — focusing on: Whether the response makes sense Whether the preamble and reasoning are useful Whether the output reflects strong engineering judgment Whether the interaction feels right to an experienced developer This role is about engineering taste — not syntax correctness. What You’ll Be Doing Evaluate AI-generated coding interactions end-to-end Judge whether outputs are: Useful Correct (at a high level) Aligned with how a strong engineer would think Assess the quality of explanations and reasoning , not just code Distinguish between different levels of response quality (e.g. what makes something a 2 vs 4 ) Provide clear, opinionated feedback on: What worked What didn’t What felt “off” or misleading Help define what great looks like when interacting with tools like Cursor What We Mean by “Taste” We’re specifically looking for engineers who can answer questions like: Does this feel like something a strong engineer would actually say? Is this explanation helpful, or just technically correct? Is the model guiding the user well, or just dumping output? Would this interaction build or erode trust? You should be comfortable making subjective but rigorous judgments . Who You Are Staff / Principal-level engineer (or equivalent experience) Strong background in one of the below: TypeScript / JavaScript Python Hands-on experience using: OpenAI Codex Claude Code Cursor Deep fami
Pay
$100–$200/hr
About G2i Talent
G2i Talent's connection to G2i: Direct talent network. Coding task creation, rubrics, evaluation and agent environments
Ownership confidence: Confirmed. See the full network profile →
Similar open roles
Frequently asked questions
How do I apply for the Python - Senior Backend Engineer, AI Coding Agent Quality role at G2i Talent?
Applications go through G2i Talent's own portal - HumanSourcer links to the listing and never collects applications or handles hiring. G2i Talent's access model is "Open / self-serve" (Join talent network). This listing was first seen here on August 26, 2026 and was still live at the last check.
Is the Python - Senior Backend Engineer, AI Coding Agent Quality role at G2i Talent remote?
Yes - G2i Talent lists this role as remote.
What does the Python - Senior Backend Engineer, AI Coding Agent Quality role at G2i Talent pay?
G2i Talent lists this role's pay as $100–$200/hr, quoted from the listing rather than estimated.
What kind of work is Python - Senior Backend Engineer, AI Coding Agent Quality?
Coding / software engineering. Coding task creation, rubrics, evaluation and agent environments
Is G2i Talent a legitimate AI-training platform?
Direct talent network - and that relationship is rated "Confirmed" here because it can be checked against www.g2i.ai rather than taken on G2i Talent's word. Confidence describes how well the ownership is evidenced. It is not a rating of how the platform treats the people who work for it, which no public source covers reliably.
Get new AI-training roles by email
One weekly digest of newly listed roles across every tracked network - pay where it's disclosed, no spam, unsubscribe anytime.
Free. See how we make money.