AI Coding Evaluator

About the role

Anyone AI creates high-quality training and evaluation data for frontier AI models. It is looking for multilingual experts with coding knowledge and a solid understanding of JSON to evaluate AI-generated technical content and customer service responses. The role is remote, part-time and independent contractor, lasting up to 3 months.

Key responsibilities

• Review AI-generated customer service responses and technical content.
• Evaluate responses for clarity, helpfulness, natural language and overall quality.
• Assess technical correctness using coding knowledge.
• Read, validate and troubleshoot JSON, identifying structural and formatting issues.
• Check outputs for formatting accuracy and adherence to project guidelines.
• Provide clear, well-reasoned feedback on each evaluation.

Required profile

• Fluency in one or more of the supported languages: Dutch, Welsh, French (Canada), German, Italian, Portuguese (Brazil), Greek.
• Strong judgment when evaluating customer service responses.
• Excellent attention to detail and strong written communication skills.
• Ability to follow detailed evaluation guidelines consistently.

Required skills

• Solid understanding of JSON, including syntax, structure, validation and troubleshooting.
• Coding knowledge sufficient to assess technical content and identify errors.
• Nice to have: previous experience in AI evaluation, quality assurance or technical support; experience with APIs and structured data; a background in customer service, software development or technical writing.