Data Engineer

Join to apply for the Data Engineer (AWS) role at NTT DATA Europe & LatamAbout the CompanyAt the heart of our outsourcing organization, the Data & Intelligence Competence Center serves as a dedicated hub for advanced data‑driven solutions. We specialize in data engineering, analytics, and AI‑powered insights, helping businesses turn raw information into actionable intelligence. By combining deep technical expertise with industry best practices, we enable smarter decision‑making, optimize processes, and foster innovation across diverse sectors.Building on this foundation, we collaborate with a world‑leading reinsurance and risk‑management company. Our client delivers comprehensive solutions in insurance, underwriting, and data‑driven risk assessment. With a strong commitment to innovation and long‑term stability, they empower organizations to navigate complex risks and create sustainable value in an ever‑changing global landscape. To support this mission, we are seeking a highly skilled AWS Data Engineer to strengthen our data and analytics ecosystem. In this role, you will design, develop, and manage cloud‑based data solutions, leveraging big data frameworks to build efficient pipelines, optimise storage, and implement robust processing workflows—ensuring high‑quality data availability for analytics and business intelligence.What You’ll Be DoingBuild and maintain large‑scale ETL pipelines using AWS Glue, Lambda, and Step FunctionsDesign and manage data lakes on Amazon S3, implementing robust schema management and lifecycle policiesWork with Apache Iceberg and Parquet formats to support efficient and scalable data storageDevelop distributed data processing workflows using PySparkImplement secure, governed data environments using AWS Lake FormationBuild and maintain integrations using AWS API Gateway and data exchange APIsAutomate infrastructure provisioning using Terraform or CDK for Terraform (CDKTF)Develop CI/CD pipelines and containerised solutions within modern DevOps practicesImplement logging, observability, and monitoring solutions to maintain reliable data workflowsPerform root‑cause analysis and optimise data processing for improved performance and qualityCollaborate with business intelligence teams and analysts to support reporting and analytics needsWork in cross‑functional, Agile teams and actively participate in sprint ceremonies, backlog refinement, and planningProvide data‑driven insights and recommendations that support business decision‑makingWhat You’ll Bring AlongBachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience)Minimum 3–5 years of experience in a Data Engineering roleStrong knowledge of AWS services: Glue, Lambda, S3, Athena, Lake Formation, Step Functions, DynamoDBProficiency in Python and PySpark for data processing, optimisation, and automationHands‑on experience with Terraform or CDKTF for Infrastructure as CodeSolid understanding of ETL development, data lakes, schema evolution, and distributed processingExperience working with Apache Iceberg and Parquet formats (highly valued)Experience with CI/CD pipelines, automation, and containerisationFamiliarity with API Gateway and modern integration patternsStrong analytical and problem‑solving skillsExperience working in Agile Scrum environmentsGood understanding of data governance, security, and access control principlesExperience with visualisation/BI tools such as Power BI or AWS QuickSight is a plusExcellent command of both spoken and written EnglishNice to HaveExperience designing data products, implementing tag‑based access control, or applying federated governance using AWS Lake FormationFamiliarity with Amazon SageMaker for AI/ML workflowsHands‑on experience with AWS QuickSight for building analytics dashboardsExposure to data mesh architecturesExperience with container orchestration (e.g., Kubernetes, ECS, EKS)Knowledge of modern data architecture patterns (e.g., CDC, event‑driven pipelines, near‑real‑time ingestion)Seniority LevelAssociateEmployment TypeFull‑timeJob FunctionInformation Technology#J-18808-Ljbffr