Senior AI Interaction Evaluator (Codex/Claude Code)

About the role

We are seeking a senior‑level software engineer to assess the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This is a contract position focused on judging how well the model thinks and communicates like an experienced developer, rather than writing production code.

Key responsibilities

• Evaluate end‑to‑end AI‑generated coding interactions in realistic scenarios.
• Judge whether outputs are useful, high‑level correct, and aligned with strong engineering judgment.
• Assess explanations, reasoning, and overall interaction quality.
• Provide clear, opinionated feedback on what works, what doesn’t, and what feels off.
• Help define standards for great AI‑assisted development experiences.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience).
• Deep familiarity with AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line.
• Comfortable delivering direct, rigorous feedback.
• High bar for what constitutes good engineering.

Required skills

• TypeScript
• JavaScript
• Python
• Experience with OpenAI Codex
• Experience with Claude Code
• Familiarity with Cursor or similar AI‑first IDEs

What we offer

• Hourly rate up to $200/hr (US/Canada), $150/hr (EU/Latam), $100/hr (other regions).
• Flexible 10–20 hours per week, remote work.
• Potential extension beyond early May.