Data Engineer Distributed Systems

1 mese fa


Re, Italia Value pro A tempo pieno

Data Engineer Distributed Systems

Client: Tavant Technologies

End Client : Apple

Job Title Data Engineer Distributed Systems

Job Type Contract

Location Remote or Austin Texas

Key skills are snowflake Data Modelling and Distributed database

DRUID Skill is most Imp

Note Client is looking for an expert in Druid development

POSITION TITLE

Data Engineer Distributed Systems for our premier Cupertinobased multinational technology client

SUMMARY

Tavant is a niche software services firm with over 3200 associates worldwide. Were looking for a topnotch Data Engineers to lead the design development and optimization of our distributed data store particularly in Druid for one of our premier Cupertinobased multinational technology client.

You will represent Tavant in our client engagement and work with crossfunctional team comprised of Data Engineers Administrators Platform Engineers and Architects. You will incorporate sound data modeling principles in design to optimize storage & retrieval and develop solutions on top of distributed data stores.

If youre passionate about data engineering and have a keen design acumen in building scalable systems we encourage you to apply Were building an incredible consulting team and believe youll find a highly energized environment to share your expertise and help boost engineering innovation.

Our clients Advertising Platforms group makes it possible for people around the world to easily access informative and imaginative content on their devices while helping publishers and developers promote and monetize their work. Our client group power advertising operations in News in the App Store and in other platforms.

KEY RESPONSIBILITIES

Design and Development:

Design and implement data ingestion pipelines to load data into Apache Druid.

Develop and optimize Druid schemas and data models for efficient querying and performance.

Design and implement data aggregations against eventlevel data in distributed database (preferably in Druid)

Migration from existing data stores to Druid

Optimization:

Implement best practices for data ingestion storage and querying to improve system performance.

Optimize query performance and resource utilization.

KEY QUALIFICATIONS

5 years of experience in data engineering or analytics in distributed data systems i.e. Druid Snowflake Redshift CockroachDb or Pinot (Druid experience preferred).

Strong understanding of distributed data store architecture data ingestion methods scaling mechanisms and querying capabilities.

Proficiency in SQL and experience with data modeling and ETL processes.

Handson application coding experience in Java Python or others.

A fast learner of new technologies.

Experience with performance tuning and optimization of data systems.

Excellent problemsolving skills and the ability to work independently as well as in a team.

Familiarity with other big data technologies (e.g. Hadoop Spark Kafka) is a plus.

Highly beneficial:

Familiarity with cloud platforms (e.g. AWS GCP Azure) and containerization (e.g. Docker Kubernetes).

Knowledge of programming languages such as Scala.

Experience generating reports against distributed data systems with SQL and visualization tools.


  • Data Engineer

    1 mese fa


    Re, Italia DHAL INFORMATION SYSTEM A tempo pieno

    Data Engineer Location Alpharetta GA Salary $69/hr W2 The Data System Engineer will be responsible for tasks such as data engineering data modeling ETL processes data warehousing and data analytics & science. Our platform run both on premise and on the cloud (AWS/Azure). Knowledge/Skills: Able to establish modify or maintain data structures and...


  • Re, Italia IT Force Inc A tempo pieno

    Job Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse and Delta Lake. ...

  • Data Engineer

    2 mesi fa


    Re, Italia Risk Resources LLP A tempo pieno

    Data Engineer Snowflake / Azure (ADLS ADF Synapse) /AWSOverview:The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.Key...


  • Re, Italia Hunarstreet Technologies A tempo pieno

    Senior Data EngineerLocation: RemoteWe are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture optimizing data flow and supporting crossfunctional teams. The ideal candidate has extensive experience in handling big data and enjoys...


  • Re, Italia Arata Global A tempo pieno

    Role : Data Visualization Software Engineer (Frontend Software Engineer) Location: Remote (Canada) Job Type Contract Project Duration: 1 year with possible extension based on performance. Must have Biotechnology Pharmaceutical LifeScience Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate...


  • Re, Italia IT Force Inc A tempo pieno

    Job Title: Senior Databricks Data Engineer Role: Contract US Location: Remote Client: Data Piper Salary: W2 or 1099 Experience: 7 years of handson experience with Databricks and data engineering. Strong experience with Python Scala PySpark and Spark SQL. Proven experience with building ETL/ELT pipelines. Good experience with Databricks Lakehouse...


  • Re, Italia Godspeed Workforce A tempo pieno

    Title: Data Visualization Software Engineer (Frontend Software Engineer) Location: Canada Work Location: Remote Project Duration: 1 year with possible extension based on performance. Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or Pacific Time Zone. Description: Data...

  • Sr Data engineer

    1 mese fa


    Re, Italia UrBench A tempo pieno

    Sr. Data engineer (1) Snowflake/dbt/GCP/Python skillset 6 months Location: Atlanta GA (Onsite no remote work allowed Need Local) Required skills: Snowflake/dbt/GCP/Python skillset Design develop and implement data integration solutions to move data between disparate systems (Database is Snowflake). Analyze data sources and target systems to...


  • Re, Italia Arata Global A tempo pieno

    Role : Python Backend Software Engineer Location: Remote (Canada ) Job Type Contract Project Duration: 1 year with possible extension based on performance. Must have Biotechnology Pharmaceutical LifeScience Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or...


  • Re, Italia Meta Force Technology Staffing LLC A tempo pieno

    JOB TITLE: Systems Engineer/SRE LOCATION: 100% Remote RemoteEST Time zone working hours it can be remote but need to travel for PI planning DURATION: One year contract potential extension START DATE: 2 Weeks DUE DATE: 24 48 Hours Interview Process/# of Rounds: 2 rounds Top 3 Requirements: Experience with Data Platforms: Data platform engineering...


  • Re, Italia Godspeed Workforce A tempo pieno

    Title: Python Backend Software Engineer Location: Canada Work Location: Remote Project Duration: 1 year with possible extension based on performance. Note: As the team is distributed between US (San Francisco) and Canada (Vancouver) the successful candidate should work in the Eastern or Pacific Time Zone. Description: Background The Visualization and...

  • GCP Data Engineer

    1 mese fa


    Re, Italia People Prime Worldwide A tempo pieno

    About client: Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...


  • Re, Italia Risk Resources LLP A tempo pieno

    Overview:The Snowflake Data Engineer plays a critical role in designing developing and maintaining data pipeline solutions within the organization. This role is important for ensuring efficient and reliable data ingestion transformation and storage for data analytics and business intelligence purposes.Key Responsibilities:Designing and implementing scalable...


  • Re, Italia Trilyon, Inc. A tempo pieno

    For over 15 years Trilyon has been at the forefront of providing comprehensive global workforce solutions and staffing services. Leveraging our extensive expertise across multiple domains such as Cloud technology Salesforce AI Machine Learning and Technical Writing we consistently exceed expectations in catering to a wide range of requirements. Currently...


  • Re, Italia ACCELON PREMIERE CONSULTANTS PRIVATE LIMITED A tempo pieno

    Description Job Title : Data Engineer Location : Bangalore (Hybrid) Position Overview We are looking for an exceptional data engineer to transform optimize test and maintain architectures for enterprise analytics databases data apis as well as optimizing data flow and collection for cross functional teams. The mission of the team is to empower...


  • Re, Italia Lilly A tempo pieno

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...


  • Re, Italia Trinus A tempo pieno

    Job Title: .NET: Sr. Software Engineer Duration: 6 Months (Contract to Hire) Location: 100% Remote (preferably located local to Dallas area as they may ask to come for monthly meeting) Job Description: 10 years of software development experience. C# .NET stack .Net Version 9 Typescript Kafka and asynchronous messaging processing systems Microservices...


  • Re, Italia V R Della Infotech Inc A tempo pieno

    Description: IMPORTANT: Suppliers should not submit workers whose physical residence is within the following states due to Intuitive tax and operating entity structure: Alabama Arkansas Delaware Florida Indiana Iowa Louisiana Maryland Mississippi Missouri Oklahoma Pennsylvania South Carolina and Tennessee. Please interpret this as Intuitive policy to...

  • Data Engineer

    2 mesi fa


    Re, Italia TecQubes Technologies A tempo pieno

    Job Role Data Engineer MDM Experience 6 years Budget 25 LPA Notice period 30 days – 45 days Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. ...


  • Re, Italia Acunor Inc A tempo pieno

    Position: Cloud Data Engineer Location: Remote position One year contract Job Description Role and Responsibilities: Work closely with application development and data engineers on daytoday tasks. Participate in project planning and implementation. Coordinate with Data Scientists Product Managers and business leaders to understand data needs and...