Remote Evaluation

Mercor connects elite creative and technical talent with leading AI research labs, operating with a remote model and offering hourly compensation.This contract role focuses on thorough document review and structured feedback to elevate quality and impact across projects.Ideal candidates have a Bachelor's degree and 2+ years of relevant experience, with...

A cutting-edge AI consultancy is seeking an Entry-Level Tester to design evaluation scenarios for LLM-based agents. Responsibilities include creating structured test cases to simulate human workflows, ensuring clarity and effectiveness of scenarios, and analyzing agent behaviors. This flexible part-time freelance role allows you to work around your academic...

An innovative AI project firm in Milan seeks QAs for autonomous AI agents. This flexible, project-based role requires strong analytical thinking, attention to detail, and good communication skills in English. Ideal candidates include analysts or students eager to contribute to AI validation efforts while balancing other commitments. The role involves...

YO AI Labs is seeking experienced Product Managers and Product Owners for a contract-based, remote evaluation project focused on assessing and improving AI systems. You will review AI-generated specifications, release notes, and user-facing content to judge clarity, accuracy, tone, usefulness, and adherence to instructions. Applicants should have product...

Mercor is seeking a Frontend Engineer on a remote contract to render and compare two candidate replicas, judging fidelity and responsiveness. You will justify design choices with evidence and ensure robust HTML/CSS/JS understanding. Strong written English is required to document findings and recommendations.The role emphasizes pixel-perfect implementation,...

Mercor is seeking Engineers/Platform professionals for a remote contract focused on document evaluation and quality assurance. You will review domain-specific materials, provide structured feedback, and collaborate to improve evaluation processes, deadlines managed independently. The role emphasizes strong analytical abilities, attention to detail, and the...

Invisible Technologies Inc. is seeking independent Audio Evaluation Specialists to design and execute role-play based evaluation tasks for AI benchmark projects involving real-world customer support scenarios across travel, finance, and telecom.You will craft nuanced evaluation prompts, audit model outputs, and help generate high-quality training data....

Food and Agriculture Organization of the United Nations in a home-based setting seeks expressions of interest for an evaluation specialist to support the GEF-7 Common Oceans Programme and its child projects.La preghiamo di leggere attentamente i seguenti dettagli prima di inviare la sua candidatura.The role requires senior-level evaluation experience and...

Luogo di lavoro: MilanoAI Evaluation Specialist Role Type: ContractorLocation: Remote - US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards,...