Data Engineer
1 mese fa
Knowledge/Skills:
Able to establish modify or maintain data structures and associated components according to design
Understands and documents business data requirements
Able to come up with Conceptual and Logical Data Models at Enterprise Business Unit/Domain Level
Understands XML/JSON and schema development/reuse database concepts database designs Open Source and NoSQL concepts
Partners with Sr. Data Engineers and Sr. Data architects to create platform level data models and database designs
Takes part in reviews of own work and reviews of colleagues work
Has working knowledge of the core tools used in the planning analyzing designing building testing configuring and maintaining of assigned application(s)
Able to participate in assigned teams software delivery methodology (Agile Scrum TestDriven Development Waterfall etc.) in support of data engineering pipeline development
Understands infrastructure technologies and components like servers databases and networking concepts
Write code to develop maintain and optimized batch and event driven for storing managing and analyzing large volumes of structured and unstructured data both
Metadata integration in data pipelines
Automate build and deployment processes using Jenkins across all environments to enable faster highquality releases
Qualification:
Up to 4 years of software development experience in a professional environment and/or comparable experience such as:
Understanding of Agile or other rapid application development methods
Exposure to design and development across one or more database management systems DB2 SybaseIQ Snowflake as appropriate
Exposure to methods relating to application and database design development and automated testing
Understanding of big data technology and NOSQL design and development with variety of data stores (document column family graph etc.)
General knowledge of distributed (multitiered) systems algorithms and relational & nonrelational databases
Experience with Linux and Python scripting as well as large scale data processing technology such as spark
Exposure to Big data technology and NOSQL design and coding with variety of data stores (document column family graph etc.)
Experience with cloud technologies such as AWS and Azure including deployment management and optimization of data analytics & science pipelines
Nice to have: Collibra Terraform Java Golang Ruby Machine Learning Operation deployment
Bachelors degree in computer science computer science engineering or related field required
-
Data Engineer
1 mese fa
Re, Italia TecQubes Technologies A tempo pienoJob Role Data Engineer MDM Experience 6 years Budget 25 LPA Notice period 30 days – 45 days Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. ...
-
Senior Data Engineer HK
1 mese fa
Re, Italia Hunarstreet Technologies A tempo pienoSenior Data EngineerLocation: RemoteWe are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture optimizing data flow and supporting crossfunctional teams. The ideal candidate has extensive experience in handling big data and enjoys...
-
Databricks Data Engineer
1 mese fa
Re, Italia IT Force Inc A tempo pienoJob Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse and Delta Lake. ...
-
Data Engineer
2 mesi fa
Re, Italia TecQubes Technologies A tempo pienoJob Role Data Engineer MDM Experience 6 years Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. Participate in the development of cloud data warehouses data as a service business...
-
Sr Data engineer
1 mese fa
Re, Italia UrBench A tempo pienoSr. Data engineer (1) Snowflake/dbt/GCP/Python skillset 6 months Location: Atlanta GA (Onsite no remote work allowed Need Local) Required skills: Snowflake/dbt/GCP/Python skillset Design develop and implement data integration solutions to move data between disparate systems (Database is Snowflake). Analyze data sources and target systems to...
-
Data Engineer EDM III
1 mese fa
Re, Italia ACCELON PREMIERE CONSULTANTS PRIVATE LIMITED A tempo pienoDescription Job Title : Data Engineer Location : Bangalore (Hybrid) Position Overview We are looking for an exceptional data engineer to transform optimize test and maintain architectures for enterprise analytics databases data apis as well as optimizing data flow and collection for cross functional teams. The mission of the team is to empower...
-
Snowflake Data Engineer
1 mese fa
Re, Italia Risk Resources LLP A tempo pienoOverview:The Snowflake Data Engineer plays a critical role in designing developing and maintaining data pipeline solutions within the organization. This role is important for ensuring efficient and reliable data ingestion transformation and storage for data analytics and business intelligence purposes.Key Responsibilities:Designing and implementing scalable...
-
Data Engineer Distributed Systems
1 mese fa
Re, Italia Value pro A tempo pienoData Engineer Distributed Systems Client: Tavant Technologies End Client : Apple Job Title Data Engineer Distributed Systems Job Type Contract Location Remote or Austin Texas Key skills are snowflake Data Modelling and Distributed database DRUID Skill is most Imp Note Client is looking for an expert in Druid development POSITION TITLE Data...
-
Cloud Data Engineer
1 mese fa
Re, Italia Acunor Inc A tempo pienoPosition: Cloud Data Engineer Location: Remote position One year contract Job Description Role and Responsibilities: Work closely with application development and data engineers on daytoday tasks. Participate in project planning and implementation. Coordinate with Data Scientists Product Managers and business leaders to understand data needs and...
-
Data Visualization Software Engineer
1 mese fa
Re, Italia Arata Global A tempo pienoRole : Data Visualization Software Engineer (Frontend Software Engineer) Location: Remote (Canada) Job Type Contract Project Duration: 1 year with possible extension based on performance. Must have Biotechnology Pharmaceutical LifeScience Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate...
-
Senior Databricks Data Engineer
1 mese fa
Re, Italia IT Force Inc A tempo pienoJob Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Client: Data Piper Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse...
-
Spark Data Reconciliation Engineer
1 mese fa
Re, Italia Purple Fly Solutions A tempo pienoJob Summary: 1. Role: Spark Data Reconciliation Engineer fulltime position in Jersey City NJ. 2. Responsible for designing implementing and maintaining Javabased applications for complex data reconciliations. 3. Implement data transformation and matching algorithms using Java and relevant frameworks. 4. Develop robust error handling and exception management...
-
GCP Data Engineer
1 mese fa
Re, Italia People Prime Worldwide A tempo pienoAbout client: Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...
-
Data Security Engineer
1 mese fa
Re, Italia Pi Square Technologies A tempo pienoJob Description PSTI 1989 Client Name Infosys Client Location Bangalore Position Name Data Security Engineer Job Description Job Roles & Responsibilities Build deploy and manage Data security products to secure and implement governance policies on the data...
-
Data Engineer
1 mese fa
Re, Italia Risk Resources LLP A tempo pienoData Engineer Snowflake / Azure (ADLS ADF Synapse) /AWSOverview:The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.Key...
-
Azure Data Engineer
1 mese fa
Re, Italia People Prime Worldwide A tempo pienoAbout Client: Our client is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients. With its extensive domain and technology...
-
Re, Italia Godspeed Workforce A tempo pienoTitle: Data Visualization Software Engineer (Frontend Software Engineer) Location: Canada Work Location: Remote Project Duration: 1 year with possible extension based on performance. Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or Pacific Time Zone. Description: Data...
-
Data Engineer
1 mese fa
Re, Italia Pi Square Technologies A tempo pienoJob Description PSTI 1990 Client Name Infosys Client Location Bangalore Position Name Data Engineer Job Description Responsibilities: Provide expert solutions in field of Cloud Native bigdata application design and development in Data Platform To work closely...
-
PH Data Engineer II
1 mese fa
Re, Italia Somewhere A tempo pienoWe are looking for a Data Engineer II. Working hours: M F 9am 5pm EST. Contract: Independent Contractor. Location: 100% remote for candidates based in The Philippines. Key Responsibilities: Design construct install test and maintain highly scalable data management systems ensuring they meet business requirements and industry practices. Develop and...
-
AI Solutions Engineer
1 mese fa
Re, Italia Artmac Soft LLC A tempo pienoWho we are: Artmac Soft is a technology consulting and serviceoriented IT company dedicated to providing innovative technology solutions and services to the Customers. Job Description: Job Title : AI Solutions Engineer Synthetic Data & Vector Databases Job Type : W2 Experience : 5 to 10 years Location : Lisle Illinois Responsibilities: ...