AWS Data Engineer

1 giorno fa

Turin, Piedmont, Italia NTT DATA Tempo pieno

Overview

In this AWS Data Engineer role, you will build and optimize data platforms on AWS, collaborating with analysts and solutions architects to translate use cases into scalable data pipelines. You'll acquire, transform, cleanse, convert, compress, and load data into data lakes to support analytics and machine learning. You'll modernize infrastructure, implement CI/CD, and establish reliable monitoring and security practices to enable high availability and scalable data workflows.

Responsabilità

  • Acquire, transform, cleanse, convert, compress, and load data into data lakes for analytics and ML
  • Understand use cases with business analysts and solution architects and translate them into data solutions
  • Define and document best practices for deployment and infrastructure maintenance
  • Migrate infrastructure with zero downtime to a highly available, scalable environment
  • Set up monitoring stacks (CloudWatch, Prometheus, ELK) and define capacity planning
  • Implement CI/CD pipelines using AWS CI/CD stack and write infrastructure as code (CloudFormation or similar)

Requisiti fondamentali

  • Cloud-native experience in at least one major public cloud (AWS, GCP, Azure) with 5+ years on AWS preferred
  • Experience with Big Data architectures, cloud and on-premises
  • Docker and Kubernetes experience; ECS/EKS a plus
  • Serverless experience with AWS Lambda
  • Strong security practices (IAM roles, KMS) and AWS networking
  • Experience migrating workloads from on-prem to cloud
  • Monitoring distributed infrastructure with AWS tools or Open Source (CloudWatch, Prometheus, ELK)
  • Proficiency in Java, Scala, Python, and shell scripting
  • Agile methodology and Kanban experience
  • AWS Certification: Solutions Architect and/or Developer (preferred)
  • Collaborative communication
  • Problem solving
  • Adaptability and learning mindset
  • AWS (core services, IAM, KMS, networking)
  • CloudFormation or IaC tooling
  • CloudWatch, Prometheus, ELK stack