Freelance Agent Evaluation Engineer
Tailor your resume to this posting—match keywords and layout for recruiters. Try Resume.io before you apply.
AI Summary AI Analysis
This role involves creating complex coding tasks and evaluation criteria to improve AI agents within simulated environments. It requires a senior-level developer with strong Python and full-stack expertise to contribute to cutting-edge AI development.
Job Description
We're building a dataset to evaluate AI coding agents by creating challenging tasks and evaluation criteria within realistic simulated environments. You'll work on a part-time, non-permanent project, creating tasks for AI agents to evaluate and improve their coding abilities.RequirementsDegree in Computer Science, Software Engineering, or related fields5+ years in software development, primarily PythonBackground in full-stack development, with experience building React-based interfaces and robust back-end systemsExperience writing tests, familiarity with Docker containers, CI/CD tools, and infrastructure toolsBenefitsOpportunity to work on a challenging project, Flexible schedule, Compensation up to $45 per hourOriginally posted on Himalayas
Full Description
We're building a dataset to evaluate AI coding agents by creating challenging tasks and evaluation criteria within realistic simulated environments. You'll work on a part-time, non-permanent project, creating tasks for AI agents to evaluate and improve their coding abilities.RequirementsDegree in Computer Science, Software Engineering, or related fields5+ years in software development, primarily PythonBackground in full-stack development, with experience building React-based interfaces and robust back-end systemsExperience writing tests, familiarity with Docker containers, CI/CD tools, and infrastructure toolsBenefitsOpportunity to work on a challenging project, Flexible schedule, Compensation up to $45 per hourOriginally posted on Himalayas