Senior Data Engineer HK
1 mese fa
Location: Remote
We are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture optimizing data flow and supporting crossfunctional teams. The ideal candidate has extensive experience in handling big data and enjoys creating data systems from the ground up.
Key Responsibilities:
- Design and develop key components of our data pipeline for extracting transforming and loading data from various sources using modern Big Data technologies.
- Implement internal process improvements by automating manual tasks optimizing data delivery and enhancing scalability.
- Collaborate with executives product teams and design teams to address datarelated technical issues and ensure their infrastructure needs are met.
- Work closely with machine learning data and analytics teams to innovate and improve functionality in our data systems.
Qualifications:
- Bachelor s degree in Engineering Computer Science or related field.
- 11 years of experience as a Data Engineer.
- 5 years of handson experience with Apache Spark and a deep understanding of Big Data fundamentals.
- Strong coding skills in Scala Python Java or other languages with the ability to switch between them as needed.
- Proficiency in SQL and experience with relational databases like Postgres or MySQL.
- Experience with cloud technologies specifically DataBricks.
- Familiarity with various data formats including Delta Tables Parquet CSV and JSON.
- Comfortable working in a Linux shell environment and writing scripts when needed.
- Experience working in Agile development environments.
- Knowledge of Machine Learning is a plus.
- Ability to work independently and deliver stable reliable and efficient software.
- Strong written and verbal communication skills in English.
- Proven ability to collaborate with crossfunctional teams in a dynamic work environment.
If you are excited about the opportunity to help redesign data architecture and build scalable data solutions apply today
delta tables,linux,communication,apache spark,sql,json,databricks,agile development,cloud technologies,mysql,scala,agile environment,architecture,java,parquet,relational databases,csv,data systems,design,big data,python,machine learning
-
Senior Databricks Data Engineer
1 mese fa
Re, Italia IT Force Inc A tempo pienoJob Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Client: Data Piper Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse...
-
Databricks Data Engineer
1 mese fa
Re, Italia IT Force Inc A tempo pienoJob Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse and Delta Lake. ...
-
Data Engineer
1 mese fa
Re, Italia TecQubes Technologies A tempo pienoJob Role Data Engineer MDM Experience 6 years Budget 25 LPA Notice period 30 days – 45 days Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. ...
-
Data Engineer
1 mese fa
Re, Italia DHAL INFORMATION SYSTEM A tempo pienoData Engineer Location Alpharetta GA Salary $69/hr W2 The Data System Engineer will be responsible for tasks such as data engineering data modeling ETL processes data warehousing and data analytics & science. Our platform run both on premise and on the cloud (AWS/Azure). Knowledge/Skills: Able to establish modify or maintain data structures and...
-
Data Engineer
1 mese fa
Re, Italia TecQubes Technologies A tempo pienoJob Role Data Engineer MDM Experience 6 years Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. Participate in the development of cloud data warehouses data as a service business...
-
Sr Data engineer
1 mese fa
Re, Italia UrBench A tempo pienoSr. Data engineer (1) Snowflake/dbt/GCP/Python skillset 6 months Location: Atlanta GA (Onsite no remote work allowed Need Local) Required skills: Snowflake/dbt/GCP/Python skillset Design develop and implement data integration solutions to move data between disparate systems (Database is Snowflake). Analyze data sources and target systems to...
-
Data Architect Engineer
1 mese fa
Re, Italia Cira Tek A tempo pienoJob Description: This is a Remote position. Position Description : A Senior Enterprise Architect applies their management skills and specialized functional and technical expertise to support complex projects in applying organizing principles and methods of enterprise architecture. Methods of enterprise architecture include IT business systems...
-
Snowflake Data Engineer
1 mese fa
Re, Italia Risk Resources LLP A tempo pienoOverview:The Snowflake Data Engineer plays a critical role in designing developing and maintaining data pipeline solutions within the organization. This role is important for ensuring efficient and reliable data ingestion transformation and storage for data analytics and business intelligence purposes.Key Responsibilities:Designing and implementing scalable...
-
Data Engineer EDM III
1 mese fa
Re, Italia ACCELON PREMIERE CONSULTANTS PRIVATE LIMITED A tempo pienoDescription Job Title : Data Engineer Location : Bangalore (Hybrid) Position Overview We are looking for an exceptional data engineer to transform optimize test and maintain architectures for enterprise analytics databases data apis as well as optimizing data flow and collection for cross functional teams. The mission of the team is to empower...
-
Data Engineer Distributed Systems
1 mese fa
Re, Italia Value pro A tempo pienoData Engineer Distributed Systems Client: Tavant Technologies End Client : Apple Job Title Data Engineer Distributed Systems Job Type Contract Location Remote or Austin Texas Key skills are snowflake Data Modelling and Distributed database DRUID Skill is most Imp Note Client is looking for an expert in Druid development POSITION TITLE Data...
-
Cloud Data Engineer
1 mese fa
Re, Italia Acunor Inc A tempo pienoPosition: Cloud Data Engineer Location: Remote position One year contract Job Description Role and Responsibilities: Work closely with application development and data engineers on daytoday tasks. Participate in project planning and implementation. Coordinate with Data Scientists Product Managers and business leaders to understand data needs and...
-
ETL Data Engineer
1 mese fa
Re, Italia Cleo Consulting A tempo pienoAssignment: RQ07863 Software Developer ETL Senior Job Title: ETL Data Engineer Requisition (SS): RQ07863 Start Date: End Date: Client: Justice Technology Services Office Location: Onsite / 21 College Street Toronto Organization: Justice Technology Services Extension # of Days: 230.00 Ministry: Ministry of Solicitor General # Business Days: 270.00 NOTE:...
-
Data Visualization Software Engineer
1 mese fa
Re, Italia Arata Global A tempo pienoRole : Data Visualization Software Engineer (Frontend Software Engineer) Location: Remote (Canada) Job Type Contract Project Duration: 1 year with possible extension based on performance. Must have Biotechnology Pharmaceutical LifeScience Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate...
-
Spark Data Reconciliation Engineer
1 mese fa
Re, Italia Purple Fly Solutions A tempo pienoJob Summary: 1. Role: Spark Data Reconciliation Engineer fulltime position in Jersey City NJ. 2. Responsible for designing implementing and maintaining Javabased applications for complex data reconciliations. 3. Implement data transformation and matching algorithms using Java and relevant frameworks. 4. Develop robust error handling and exception management...
-
Senior Data Engineer
1 mese fa
Re, Italia HatchPros Inc A tempo pienoIt is hybrid in Dallas TX (Richardson office) 3 days a week Ho h1b This role has two client interviews and the final interview is onsite. need local to Dallas Please note that we have had significant issues with resume authenticity so we arent sending full JDs we would rather see a candidates resume the way it is. so please send genuine candidates who...
-
GCP Data Engineer
1 mese fa
Re, Italia People Prime Worldwide A tempo pienoAbout client: Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...
-
Data Security Engineer
1 mese fa
Re, Italia Pi Square Technologies A tempo pienoJob Description PSTI 1989 Client Name Infosys Client Location Bangalore Position Name Data Security Engineer Job Description Job Roles & Responsibilities Build deploy and manage Data security products to secure and implement governance policies on the data...
-
Data Engineer
1 mese fa
Re, Italia Risk Resources LLP A tempo pienoData Engineer Snowflake / Azure (ADLS ADF Synapse) /AWSOverview:The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.Key...
-
Azure Data Engineer
1 mese fa
Re, Italia People Prime Worldwide A tempo pienoAbout Client: Our client is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients. With its extensive domain and technology...
-
Data Engineer
1 mese fa
Re, Italia Pi Square Technologies A tempo pienoJob Description PSTI 1990 Client Name Infosys Client Location Bangalore Position Name Data Engineer Job Description Responsibilities: Provide expert solutions in field of Cloud Native bigdata application design and development in Data Platform To work closely...