Data Engineer Distributed Systems
1 mese fa
Data Engineer Distributed Systems
Client: Tavant Technologies
End Client : Apple
Job Title Data Engineer Distributed Systems
Job Type Contract
Location Remote or Austin Texas
Key skills are snowflake Data Modelling and Distributed database
DRUID Skill is most Imp
Note Client is looking for an expert in Druid development
POSITION TITLE
Data Engineer Distributed Systems for our premier Cupertinobased multinational technology client
SUMMARY
Tavant is a niche software services firm with over 3200 associates worldwide. Were looking for a topnotch Data Engineers to lead the design development and optimization of our distributed data store particularly in Druid for one of our premier Cupertinobased multinational technology client.
You will represent Tavant in our client engagement and work with crossfunctional team comprised of Data Engineers Administrators Platform Engineers and Architects. You will incorporate sound data modeling principles in design to optimize storage & retrieval and develop solutions on top of distributed data stores.
If youre passionate about data engineering and have a keen design acumen in building scalable systems we encourage you to apply Were building an incredible consulting team and believe youll find a highly energized environment to share your expertise and help boost engineering innovation.
Our clients Advertising Platforms group makes it possible for people around the world to easily access informative and imaginative content on their devices while helping publishers and developers promote and monetize their work. Our client group power advertising operations in News in the App Store and in other platforms.
KEY RESPONSIBILITIES
Design and Development:
Design and implement data ingestion pipelines to load data into Apache Druid.
Develop and optimize Druid schemas and data models for efficient querying and performance.
Design and implement data aggregations against eventlevel data in distributed database (preferably in Druid)
Migration from existing data stores to Druid
Optimization:
Implement best practices for data ingestion storage and querying to improve system performance.
Optimize query performance and resource utilization.
KEY QUALIFICATIONS
5 years of experience in data engineering or analytics in distributed data systems i.e. Druid Snowflake Redshift CockroachDb or Pinot (Druid experience preferred).
Strong understanding of distributed data store architecture data ingestion methods scaling mechanisms and querying capabilities.
Proficiency in SQL and experience with data modeling and ETL processes.
Handson application coding experience in Java Python or others.
A fast learner of new technologies.
Experience with performance tuning and optimization of data systems.
Excellent problemsolving skills and the ability to work independently as well as in a team.
Familiarity with other big data technologies (e.g. Hadoop Spark Kafka) is a plus.
Highly beneficial:
Familiarity with cloud platforms (e.g. AWS GCP Azure) and containerization (e.g. Docker Kubernetes).
Knowledge of programming languages such as Scala.
Experience generating reports against distributed data systems with SQL and visualization tools.
-
Data Engineer
1 mese fa
Re, Italia DHAL INFORMATION SYSTEM A tempo pienoData Engineer Location Alpharetta GA Salary $69/hr W2 The Data System Engineer will be responsible for tasks such as data engineering data modeling ETL processes data warehousing and data analytics & science. Our platform run both on premise and on the cloud (AWS/Azure). Knowledge/Skills: Able to establish modify or maintain data structures and...
-
Databricks Data Engineer
1 mese fa
Re, Italia IT Force Inc A tempo pienoJob Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse and Delta Lake. ...
-
Data Engineer
2 mesi fa
Re, Italia Risk Resources LLP A tempo pienoData Engineer Snowflake / Azure (ADLS ADF Synapse) /AWSOverview:The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.Key...
-
Senior Data Engineer HK
2 mesi fa
Re, Italia Hunarstreet Technologies A tempo pienoSenior Data EngineerLocation: RemoteWe are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture optimizing data flow and supporting crossfunctional teams. The ideal candidate has extensive experience in handling big data and enjoys...
-
Data Visualization Software Engineer
1 mese fa
Re, Italia Arata Global A tempo pienoRole : Data Visualization Software Engineer (Frontend Software Engineer) Location: Remote (Canada) Job Type Contract Project Duration: 1 year with possible extension based on performance. Must have Biotechnology Pharmaceutical LifeScience Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate...
-
Senior Databricks Data Engineer
1 mese fa
Re, Italia IT Force Inc A tempo pienoJob Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Client: Data Piper Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse...
-
Re, Italia Godspeed Workforce A tempo pienoTitle: Data Visualization Software Engineer (Frontend Software Engineer) Location: Canada Work Location: Remote Project Duration: 1 year with possible extension based on performance. Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or Pacific Time Zone. Description: Data...
-
Sr Data engineer
1 mese fa
Re, Italia UrBench A tempo pienoSr. Data engineer (1) Snowflake/dbt/GCP/Python skillset 6 months Location: Atlanta GA (Onsite no remote work allowed Need Local) Required skills: Snowflake/dbt/GCP/Python skillset Design develop and implement data integration solutions to move data between disparate systems (Database is Snowflake). Analyze data sources and target systems to...
-
Python Backend Software Engineer
1 mese fa
Re, Italia Arata Global A tempo pienoRole : Python Backend Software Engineer Location: Remote (Canada ) Job Type Contract Project Duration: 1 year with possible extension based on performance. Must have Biotechnology Pharmaceutical LifeScience Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or...
-
Systems EngineerSRE
1 mese fa
Re, Italia Meta Force Technology Staffing LLC A tempo pienoJOB TITLE: Systems Engineer/SRE LOCATION: 100% Remote RemoteEST Time zone working hours it can be remote but need to travel for PI planning DURATION: One year contract potential extension START DATE: 2 Weeks DUE DATE: 24 48 Hours Interview Process/# of Rounds: 2 rounds Top 3 Requirements: Experience with Data Platforms: Data platform engineering...
-
Python Backend Software Engineer
1 mese fa
Re, Italia Godspeed Workforce A tempo pienoTitle: Python Backend Software Engineer Location: Canada Work Location: Remote Project Duration: 1 year with possible extension based on performance. Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or Pacific Time Zone. Description: Background The Visualization and...
-
GCP Data Engineer
1 mese fa
Re, Italia People Prime Worldwide A tempo pienoAbout client: Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...
-
Snowflake Data Engineer
2 mesi fa
Re, Italia Risk Resources LLP A tempo pienoOverview:The Snowflake Data Engineer plays a critical role in designing developing and maintaining data pipeline solutions within the organization. This role is important for ensuring efficient and reliable data ingestion transformation and storage for data analytics and business intelligence purposes.Key Responsibilities:Designing and implementing scalable...
-
Memory Systems Engineer
1 mese fa
Re, Italia Trilyon, Inc. A tempo pienoFor over 15 years Trilyon has been at the forefront of providing comprehensive global workforce solutions and staffing services. Leveraging our extensive expertise across multiple domains such as Cloud technology Salesforce AI Machine Learning and Technical Writing we consistently exceed expectations in catering to a wide range of requirements. Currently...
-
Data Engineer EDM III
1 mese fa
Re, Italia ACCELON PREMIERE CONSULTANTS PRIVATE LIMITED A tempo pienoDescription Job Title : Data Engineer Location : Bangalore (Hybrid) Position Overview We are looking for an exceptional data engineer to transform optimize test and maintain architectures for enterprise analytics databases data apis as well as optimizing data flow and collection for cross functional teams. The mission of the team is to empower...
-
Process Automation Engineer
3 mesi fa
Re, Italia Lilly A tempo pienoAt Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...
-
NET Sr Software Engineer
1 mese fa
Re, Italia Trinus A tempo pienoJob Title: .NET: Sr. Software Engineer Duration: 6 Months (Contract to Hire) Location: 100% Remote (preferably located local to Dallas area as they may ask to come for monthly meeting) Job Description: 10 years of software development experience. C# .NET stack .Net Version 9 Typescript Kafka and asynchronous messaging processing systems Microservices...
-
Information Systems Engineer 2
1 mese fa
Re, Italia V R Della Infotech Inc A tempo pienoDescription: IMPORTANT: Suppliers should not submit workers whose physical residence is within the following states due to Intuitive tax and operating entity structure: Alabama Arkansas Delaware Florida Indiana Iowa Louisiana Maryland Mississippi Missouri Oklahoma Pennsylvania South Carolina and Tennessee. Please interpret this as Intuitive policy to...
-
Data Engineer
2 mesi fa
Re, Italia TecQubes Technologies A tempo pienoJob Role Data Engineer MDM Experience 6 years Budget 25 LPA Notice period 30 days – 45 days Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. ...
-
Cloud Data Engineer
1 mese fa
Re, Italia Acunor Inc A tempo pienoPosition: Cloud Data Engineer Location: Remote position One year contract Job Description Role and Responsibilities: Work closely with application development and data engineers on daytoday tasks. Participate in project planning and implementation. Coordinate with Data Scientists Product Managers and business leaders to understand data needs and...