Senior Data Engineer
Salva questo lavoro e mantieni la tua ricerca organizzata
Crea un account gratuito per salvare lavori, creare avvisi e tornare a questa inserzione dalla tua dashboard.
Continuando accetti i nostri Termini & Informativa sulla privacy.
We are seeking an experienced Senior Data Engineer to design, build and maintain our data infrastructure and pipelines, with a focus on e-commerce analytics and data warehouse solutions using open source technologies. The ideal candidate will combine technical expertise with business acumen to transform complex data into actionable insights.
## Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and open-source technologies
- Create and optimize web scraping solutions to gather market and competitor data
- Architect and implement open source data warehouse solutions, ensuring optimal performance and data quality
- Develop and maintain data models that support business intelligence and analytics needs
- Design and optimize database schemas in PostgreSQL and MariaDB environments
- Collaborate with cross-functional teams to understand data requirements and provide solutions
- Mentor junior engineers and contribute to best practices and documentation
- Monitor data pipeline performance and implement improvements as needed
- Ensure data security and compliance with relevant regulations
## Required Qualifications
- 3+ years of experience in data engineering, with significant Python development experience
- Strong expertise in data modeling and data warehouse design principles
- Proven experience with web scraping technologies and best practices
- Hands-on experience with open-source data tools and technologies
- Deep understanding of e-commerce domain and related data structures
- Strong experience with PostgreSQL, MySQL, and MariaDB
## Technical Skills
- Languages: Python (advanced), SQL
- Databases and Data Warehouse: PostgreSQL, MariaDB
- ETL Tools: Pentaho Integration is preferred.
- Web Scraping: Scrapy, Selenium, Beautiful Soup
## Preferred Qualifications
- Advanced PostgreSQL and MariaDB administration skills
- Experience with Pentaho Integration and ETL workflows
- Knowledge of data governance and security best practices
- Experience with Python data processing libraries (Pandas, NumPy)