AI Evaluation Specialist
Salva questo lavoro e mantieni la tua ricerca organizzata
Crea un account gratuito per salvare lavori, creare avvisi e tornare a questa inserzione dalla tua dashboard.
Continuando accetti i nostri Termini & Informativa sulla privacy.
Location:
Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues, and provide clear feedback to help improve AI systems. No prior formal AI experience is required. Scope of Work
* Evaluate AI-generated outputs against detailed rubrics for accuracy, relevance, quality, and adherence to guidelines.
* Apply consistent and objective judgment across large volumes of examples.
* Identify reasoning gaps, tool-use issues, logical errors, and inconsistencies.
* Provide concise, actionable feedback highlighting strengths and areas for improvement.
* Participate in discussions around rubric interpretation and evolving quality standards.
* Contribute to process improvements and evaluation best practices.
* Maintain accurate documentation of evaluations and recommendations. Preferred Qualifications
* Experience in grading, quality assurance, editorial review, assessment, annotation, or similar analytical work.
* Advanced, daily use of AI assistants such as ChatGPT, Claude, or similar tools.
* Strong ability to analyze complex information and communicate findings clearly in writing.
* Experience with process improvement, rubric development, or quality assessment.
* Strong critical-thinking skills with a focus on consistency, accuracy, and fairness.
* Comfortable working independently on high-volume evaluation tasks.
* Strong attention to detail and ability to identify subtle quality issues.
* Collaborative approach to resolving ambiguous cases and improving evaluation criteria. #J-18808-Ljbffr
-
AI Evaluation Specialist
12 ore fa
cremona, lombardia, Italia YO AI Labs Tempo pienoAI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and...
-
Frontend Code Evaluation Specialist
3 giorni fa
cremona, lombardia, Italia Mercor Tempo pienoAbout the work We're building a high-quality dataset of human preference judgments on AI-generated frontend code. Each task hands you a reference web page — crawled from the real internet, delivered as a full zipped site tree plus screenshots of its default view and, on some pages, additional states reached by hovering, clicking, or scrolling. Alongside it...
-
Cremona, Lombardia, Italia Agency Tempo pienoAgency is seeking German language specialists to shape the future of AI by testing grammar, syntax, morphology, semantics and pragmatics with large language models. You will engage the model on verb conjugation, case system, word order, declensions and stylistic variation, documenting failures to help harden model reasoning. A master’s or PhD in German...
-
Intervention Specialist
7 ore fa
Cremona, Lombardia, Italia Educational Empowerment Group Tempo pienoDescription Purpose: * The intervention specialist is responsible for all aspects of Special Education services and compliance and may provide additional intervention to students not identified for Special Education services as needed. * The Intervention Specialist must be knowledgeable and proactively stay up to date on all laws pertaining to special...
-
Biocompatibility Specialist
7 ore fa
Cremona, Lombardia, Italia Enovis Tempo pienoJoin to apply for the Biocompatibility Specialist role at Enovis. Overview Enovis Corporation (NYSE: ENOV) is a growth-oriented medical technology company focused on innovation and clinically differentiated solutions that improve patient outcomes and transform workflows. The company is powered by a culture of continuous improvement and global talent and...
-
Remote Talent Acquisition
7 ore fa
Cremona, Lombardia, Italia Jobgether SRL Tempo pienoJobgether SRL is seeking a Talent Acquisition Specialist with strong medical billing expertise, based in Italy and working remotely. The role blends hands-on revenue cycle management with candidate sourcing, screening, and evaluation to support U.S. physical, occupational, and speech therapy practices. You will build reliable candidate pipelines, assess...
-
Proposal Specialist
12 ore fa
cremona, lombardia, Italia Space Industries S.p.A. Tempo pienoCompany OverviewSPACE INDUSTRIES is a dynamic and rapidly growing company operating in the aerospace sector, with a strong commitment to innovation, reliability, and mission excellence.The company supports complex space programs and provides end-to-end mission operations, ensuring high standards of performance and operational success.Position OverviewSpace...
-
Sales Specialist
7 ore fa
Cremona, Lombardia, Italia ARKRAY, Inc. Tempo pienoARKRAY is a medical device manufacturer that is contributing to the health and well-being of people all over the world through the discovery of new technologies. With over 65 years in business, our products are now being used in 80 different countries worldwide and still growing; especially in the European region. We are currently looking for the top talents...
-
Evaluation Specialist
2 settimane fa
Cremona, Lombardia, Italia IZI S.p.A Tempo pienoOverview We are looking for a Medium Consultant to support our Evaluation Department, that carries out consultancies for international and national clients. The resource will be engaged on a professional basis, in view of a further involvement as permanent staff. Responsibilities * Support the drafting of technical components of bids and requests for...
-
cremona, lombardia, Italia FAO Tempo pienoJob Description - Investment Operations Specialist (2600179) Job Description CALL FOR EXPRESSIONS OF INTEREST - VACANCY ANNOUNCEMENT 2600179 Investment Operations Specialist Job Posting 20/Apr/2026 Closure Date 28/Sep/2026, 9:59:00 PM Organizational Unit : CFI Job Type Non-staff opportunities Type of Requisition : Consultant / PSA (Personal Services...
