Data Engineer

21 ore fa

roma, Italia MSX International Tempo pieno
Overview

As Data Engineer, you will design and operate scalable data pipelines powering AI-driven automotive intelligence across MSX’s global network. You’ll build robust data storage and warehousing to support knowledge applications and analytics, collaborating with cross-functional teams to ensure secure, governed access. This role focuses on scalable, reliable data infrastructure that enables fast, AI-enabled insights for dealer networks. You will impact data quality, performance, and integration across 80+ countries.

Responsabilità
  • Design, implement, and monitor data pipelines/ETL/ELT; manage connectors to source systems
  • Build and optimize database systems for automotive knowledge storage from diverse sources (SharePoint, TrackIt, external APIs) and implement data warehousing for analytics/AI
  • Implement data quality checks, lineage, data contracts; optimize performance for global access; automate orchestration and CI/CD; support backfill and remediation
  • Integrate with MSX systems and cloud platforms (Azure, AWS, GCP); implement security measures; develop API interfaces for knowledge access by AI agents
  • Establish data governance ensuring compliance with global regulations; secure and govern data access and secrets
  • Collaborate with Knowledge Architect, Data Scientist, Knowledge Champions, and PM/Privacy teams on data structures, tooling, milestones, and risk
Requisiti fondamentali
  • Bachelor’s degree in Computer Science, Information Technology, or related field
  • 4–7+ years in data engineering; production-grade pipelines; governance/privacy constraints
  • Expertise in SQL, database design, optimization; orchestration tools (Airflow/Prefect)
  • Experience with cloud platforms/services (Azure, AWS, GCP; Snowflake/BigQuery/Databricks) and distributed systems
  • Experience with Python/Scala; proficiency in ETL/ELT tools; streaming and batch processing; IaC basics; observability/versioning
  • Strong understanding of data security and compliance requirements
  • collaboration
  • communication
  • problem-solving
  • SQL
  • database design and optimization
  • data pipelines/ETL/ELT