Pane e Rose ricerca Facilitator3 Linguistici e Mediator3 Linguistico-Culturali per scuole, servizi territoriali e contesti socio-sanitari a Prato.

14 ore fa

Genoa, Liguria, Italia Pane&Rose Cooperativa Sociale Tempo pieno

Remote Data Annotation Specialist (Milan) — Remote (US-listed) Rex.zone connects Milan-based talent with full-time remote AI data work supporting LLM training pipelines, RLHF, and model evaluation.


Potrebbe essere proprio lei il candidato/la candidata ideale per questo lavoro. Legga tutte le informazioni associate e invii la sua candidatura.

You will label, review, and QA training data using clear rubrics and annotation guidelines to improve model quality and safety.

What You Will Do
  • Produce labeled examples for NLP and computer vision annotation tasks
  • Perform prompt evaluation, rubric scoring, and RLHF preference ranking/response ranking
  • Execute QA evaluation using gold sets, peer review, audits, and disagreement resolution
  • Apply named entity recognition (span labeling) and taxonomy-based labeling
  • Support content safety labeling (policy-driven categories) and escalation ambiguous cases
  • Document annotation decisions and ensure annotation guidelines compliance
Core Workflows
  • RLHF ranking and instruction-following grading
  • Inter-annotator agreement checks and training data quality audits
  • Adversarial/edge-case prompt evaluation
  • Computer vision annotation (bounding boxes, polygons, keypoints)
Requirements
  • 3+ years in data annotation, data labeling, QA evaluation, or ML data operations
  • Strong written English and ability to follow detailed rubrics
  • Familiarity with LLM evaluation concepts (preference ranking, instruction xbvzest tuning)
  • Comfort with annotation tools and structured labeling schemas
  • Ability to maintain high accuracy under throughput targets
  • Security-minded approach to handling potentially sensitive content
Employment Notes

This is a FULL_TIME Remote role aligned to Milan-based availability; projects may span multiple time zones depending on client needs.

Pay

Competitive hourly rate: $30–$50 per hour (USD)