Remote Evaluation Specialist

An innovative AI project firm in Milan seeks QAs for autonomous AI agents. This flexible, project-based role requires strong analytical thinking, attention to detail, and good communication skills in English. Ideal candidates include analysts or students eager to contribute to AI validation efforts while balancing other commitments. The role involves...

Invisible Technologies Inc. is seeking independent Audio Evaluation Specialists to design and execute role-play based evaluation tasks for AI benchmark projects involving real-world customer support scenarios across travel, finance, and telecom.You will craft nuanced evaluation prompts, audit model outputs, and help generate high-quality training data....

YO AI Labs is seeking experienced AI Evaluation Specialists to assess and improve AI assistant outputs for an enterprise training project. Remote work is offered with global coverage; no prior formal AI experience is required but strong analytical and writing skills are essential. You will evaluate responses against rubrics, identify issues, and provide...

AI Evaluation Specialist Role Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review...

About the work We're building a high-quality dataset of human preference judgments on AI-generated frontend code. Each task hands you a reference web page — crawled from the real internet, delivered as a full zipped site tree plus screenshots of its default view and, on some pages, additional states reached by hovering, clicking, or scrolling. Alongside...

About the workNon si lasci sfuggire questa opportunità: si candidi rapidamente se la sua esperienza e le sue competenze corrispondono a quanto descritto di seguito.We're building a high-quality dataset of human preference judgments on AI-generated frontend code. Each task hands you a reference web page — crawled from the real internet, delivered as a full...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role...

Agency is seeking German language specialists to shape the future of AI by testing grammar, syntax, morphology, semantics and pragmatics with large language models. You will engage the model on verb conjugation, case system, word order, declensions and stylistic variation, documenting failures to help harden model reasoning.A master’s or PhD in German...