Senior Data Engineer

Join to apply for the Senior Data Engineer role at INNOCV Solutions.About the CompanyWe are a company expert in helping others grow through our technological expertise, solving complex technological challenges, and focusing on operational excellence.We are part of Alkemy, an international company that specializes in evolving the business model of large and medium-sized enterprises and is a public company listed on the MTA STAR market of Borsa Italiana.We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem-solving skills in any business situation.We are passionate about technology challenges that have a significant impact on business.To address these, we have high-performance teams and the ability to quickly and effectively combine technologies.We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi-sector experience.ResponsibilitiesThe work focuses on designing and building scalable architectures for Data Lakes and Data Warehouses to centralize and ensure the quality and accessibility of data.It involves implementing and managing ETL processes to extract, transform, and load data from multiple sources, including platforms like Sitetracker, SAP, and Smartmeters.Advanced techniques are applied to transform and enrich data, ensuring alignment with business requirements.The infrastructure is primarily cloud-based, utilizing AWS, Azure, and DataBricks for distributed data processing.Data security measures such as encryption, access controls, and threat monitoring are implemented to protect sensitive information.Additionally, the work encompasses managing both relational and non-relational databases (e.g., SQL Server, Couchbase, MongoDB) and implementing real-time data processing technologies like Kafka Streams, Apache Flink, and ksqlDB.Event streaming platforms, such as Kafka and Confluent, are designed to enable real-time data integration.APIs are developed to facilitate efficient data flow between systems, while microservices architecture using frameworks like Spring Boot ensures scalability.Monitoring systems like Dynatrace and Grafana are set up to track the health and performance of platforms, with error-handling mechanisms, such as DLQ, ensuring data reliability.Data governance policies are defined to maintain data quality, integrity, and compliance with regulations.QualificationsExperience with ETL tools and techniques.Advanced knowledge in cloud computing, especially AWS, Azure, and DataBricks.Design and modeling of relational and non-relational databases.Proficiency in programming languages such as Python, Java, and Scala.Experience with Kafka Streams, Apache Flink, and ksqlDB.Knowledge of data governance principles and practices.Familiarity with DevOps tools and CI/CD.Development and integration of APIs.What We ValueWe value people who stay updated on the latest trends, are eager to try new technologies, and enjoy finding alternative ways to do things.We value team players who advocate for fair play above all.BenefitsIn this company, you can be yourself and work with colleagues equally passionate about technology and innovation.We invest in your professional development with training, tech breakfasts, and forums, and provide a personal budget for continuous learning.We care about well-being and happiness at work, listening to needs to offer the best working conditions and flexibility for work-life balance.Job DetailsSeniority level: Mid-Senior level.Employment type: Full-time.Job function: Information Technology.Industries: Software Development.Suitable profiles will be contacted within 20 days.Applications without a complete CV attached will not be considered.Candidate data will be processed in accordance with the Privacy Notice, which is always available on our website.Referrals increase your chances of interviewing at INNOCV Solutions by 2x.#J-*****-Ljbffr