Senior Software Engineer (Python) - Agent Evaluation - Freelance/Remote 100+ openings

Role responsibilities

You will create challenging tasks and evaluation criteria for AI coding agents within realistic simulated environments. This includes building developer environments, designing tasks, writing tests, and iterating based on feedback.

Requirements

Candidates must have 5+ years of professional experience with Python and strong experience with FastAPI, pytest, and async/await. English proficiency at B2 level or higher and availability to work 30+ hours per week are also required.

Key skills

Python, FastAPI, pytest, async/await, Docker, PostgreSQL, CI/CD, React, TypeScript

Keywords

Python, FastAPI, pytest, async/await, Docker, PostgreSQL, CI/CD, React, TypeScript, AI, Automated Tests, Virtual Company, Development History, Evaluation Criteria, Technical Assessment, Background Check, Remote Work