Senior Data Engineer

2 giorni fa

Croco IT main office Croco IT 2 Tempo pieno

We are seeking an experienced Senior Data Engineer to design, build and maintain our data infrastructure and pipelines, with a focus on e-commerce analytics and data warehouse solutions using open source technologies. The ideal candidate will combine technical expertise with business acumen to transform complex data into actionable insights.


## Key Responsibilities

- Design, develop, and maintain scalable data pipelines using Python and open-source technologies

- Create and optimize web scraping solutions to gather market and competitor data

- Architect and implement open source data warehouse solutions, ensuring optimal performance and data quality

- Develop and maintain data models that support business intelligence and analytics needs

- Design and optimize database schemas in PostgreSQL and MariaDB environments

- Collaborate with cross-functional teams to understand data requirements and provide solutions

- Mentor junior engineers and contribute to best practices and documentation

- Monitor data pipeline performance and implement improvements as needed

- Ensure data security and compliance with relevant regulations


## Required Qualifications

- 3+ years of experience in data engineering, with significant Python development experience

- Strong expertise in data modeling and data warehouse design principles

- Proven experience with web scraping technologies and best practices

- Hands-on experience with open-source data tools and technologies

- Deep understanding of e-commerce domain and related data structures

- Strong experience with PostgreSQL, MySQL, and MariaDB


## Technical Skills

- Languages: Python (advanced), SQL

- Databases and Data Warehouse: PostgreSQL, MariaDB

- ETL Tools: Pentaho Integration is preferred.

- Web Scraping: Scrapy, Selenium, Beautiful Soup


## Preferred Qualifications

- Advanced PostgreSQL and MariaDB administration skills

- Experience with Pentaho Integration and ETL workflows

- Knowledge of data governance and security best practices

- Experience with Python data processing libraries (Pandas, NumPy)