Big Data Engineer

7 giorni fa

Re, Italia Talent Giants Consultancy Services LLP A tempo pieno
Job Title: Big Data Engineer Company Name: Affine Job Type: Technical No Of Openings: 6 CTC: 1531 LPA Location: Bangalore (Remote) Experience: 312 Years
About Company: Affine is a global leader in professional services and solutions at the forefront of AI data engineering and cloud technologies. With our distributed team of over 500 analytics professionals across North America Europe and Asia we are dedicated to enabling global enterprises to transform and innovate through the power of AI (Artificial Intelligence) data engineering and cloud technologies.
Job Description Data Engineer will be responsible for expanding and optimizing our data and database architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers database architects data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be selfdirected and comfortable supporting the data needs of multiple teams systems and products.
Roles & Responsibilities:
  • Sound knowledge in Spark architecture and distributed computing.
  • Proficient in Spark including RDD and Dataframes core functions troubleshooting and performance tuning.
  • Good understanding of objectoriented concepts and hands on experience on Scala or on java with excellent programming logic and technique.
  • Good in functional programming and OOPS concept on Scala
  • Good experience in SQL should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding the project.
  • Understand the client requirement and able to design develop from scratch and deliver.
  • AWS cloud experience would be preferable.
  • Design build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services DynamoDB RedShift Kinesis Lambda S3 etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing rearchitecting and replatforming onpremises data warehouses to data platforms on AWS (preferred)
  • Leading the client calls to flag off any delays blockers escalations and collate all the requirements.
  • Managing project timing client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on a regular basis.
  • Understand business requirements and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization maintenance and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

Must have Skills:
  • Scala
  • Spark
  • AWS preferable/Any cloud
  • SQL (Intermediate to advanced level)
  • ObjectOriented Programming
  • Good knowledge on ETL/ELT processes and tools

Good to Have Skills:
  • AWS Certification
  • Basic knowledge of streaming
  • Knowledge on hive Hadoop Kafka Streaming
  • Git/similar version control tool
  • Knowledge in CI/CD Microservices
Special Remarks from Company: From 3 to 6 years Designation will be Sr. Associate Big Data Engineer From 6 to 12 years Designation will be Sr. Big Data Engineer.

hadoop,sql,scala,spark,aws,data engineering,spark architecture,aws certification,object-oriented programming,aws cloud experience,flag off any delays,cloud,big data

  • Big Data Architect

    7 giorni fa

    Re, Italia HireOn A tempo pieno

    Job Description: Big Data ArchitectPosition: Big Data ArchitectExperience: 10 YearsLocation: Lahore Karachi Islamabad (Onsite)Employment Type: FulltimeSalary: USD 4000 per monthBenefits: Health Insurance Provident Fund etc.About the RoleHireOn is recruiting a seasoned Big Data Architect on behalf of our international client. The ideal candidate will have...

  • Big Data Architect

    1 giorno fa

    Re, Italia HireOn A tempo pieno

    Job Description: Big Data ArchitectPosition: Big Data ArchitectExperience: 10 YearsLocation: Lahore Karachi Islamabad (Onsite)Employment Type: FulltimeSalary: USD 4000 per monthBenefits: Health Insurance Provident Fund etc.About the RoleHireOn is recruiting a seasoned Big Data Architect on behalf of our international client. The ideal candidate will have...

  • Senior Data Engineer HK

    7 giorni fa

    Re, Italia Hunarstreet Technologies A tempo pieno

    Senior Data EngineerLocation: RemoteWe are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture optimizing data flow and supporting crossfunctional teams. The ideal candidate has extensive experience in handling big data and enjoys...

  • Senior Data Engineer HK

    1 giorno fa

    Re, Italia Hunarstreet Technologies A tempo pieno

    Senior Data EngineerLocation: RemoteWe are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture optimizing data flow and supporting crossfunctional teams. The ideal candidate has extensive experience in handling big data and enjoys...

  • Data Engineer

    7 giorni fa

    Re, Italia Risk Resources LLP A tempo pieno

    Data Engineer Snowflake / Azure (ADLS ADF Synapse) /AWSOverview:The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.Key...

  • Data Engineer

    1 giorno fa

    Re, Italia Risk Resources LLP A tempo pieno

    Data Engineer Snowflake / Azure (ADLS ADF Synapse) /AWSOverview:The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.Key...

  • Data Engineer

    7 giorni fa

    Re, Italia TecQubes Technologies A tempo pieno

    Job Role Data Engineer MDM Experience 6 years Budget 25 LPA Notice period 30 days – 45 days Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. ...

  • Data Engineer

    1 giorno fa

    Re, Italia TecQubes Technologies A tempo pieno

    Job Role Data Engineer MDM Experience 6 years Budget 25 LPA Notice period 30 days – 45 days Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. ...

  • Data Engineer

    7 giorni fa

    Re, Italia TecQubes Technologies A tempo pieno

    Job Role Data Engineer MDM Experience 6 years Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. Participate in the development of cloud data warehouses data as a service business...

  • Data Engineer

    1 giorno fa

    Re, Italia TecQubes Technologies A tempo pieno

    Job Role Data Engineer MDM Experience 6 years Location Trivandrum Bangalore Introduction We are looking for 6years experienced candidates for this role. Responsibilities include: Work as part of a team to develop Data and Analytics solutions. Participate in the development of cloud data warehouses data as a service business...

  • Data Engineer

    7 giorni fa

    Re, Italia Ground Control A tempo pieno

    Join us were an Investors in People Silver Standard CompanyAs we continue to evolve we are looking for a talented and motivated Data Engineer to join our dynamic team. If youre passionate about data and eager to make an impact we want to hear from you!Key Responsibilities: Redesign & Development: Work on the redesign of our platform solution and...

  • Data Engineer

    1 giorno fa

    Re, Italia Ground Control A tempo pieno

    Join us were an Investors in People Silver Standard CompanyAs we continue to evolve we are looking for a talented and motivated Data Engineer to join our dynamic team. If youre passionate about data and eager to make an impact we want to hear from you!Key Responsibilities: Redesign & Development: Work on the redesign of our platform solution and...

  • Snowflake Data Engineer

    6 giorni fa

    Re, Italia Risk Resources LLP A tempo pieno

    Overview:The Snowflake Data Engineer plays a critical role in designing developing and maintaining data pipeline solutions within the organization. This role is important for ensuring efficient and reliable data ingestion transformation and storage for data analytics and business intelligence purposes.Key Responsibilities:Designing and implementing scalable...

  • Snowflake Data Engineer

    1 giorno fa

    Re, Italia Risk Resources LLP A tempo pieno

    Overview:The Snowflake Data Engineer plays a critical role in designing developing and maintaining data pipeline solutions within the organization. This role is important for ensuring efficient and reliable data ingestion transformation and storage for data analytics and business intelligence purposes.Key Responsibilities:Designing and implementing scalable...

  • Data Scientist

    7 giorni fa

    Re, Italia sarvajith infotech A tempo pieno

    We are looking for experienced Data Scientist for our Client in Chennai (5 locations in Tamil Nadu / Bangalore)Experience Required: 5 to 8 yrsResponsibilities Leverage data science tools and techniques keeping abreast with the latest in the community to solve problems. Present recommendations from complex analysis to business partners in clear and actionable...

  • Data Scientist

    1 giorno fa

    Re, Italia sarvajith infotech A tempo pieno

    We are looking for experienced Data Scientist for our Client in Chennai (5 locations in Tamil Nadu / Bangalore)Experience Required: 5 to 8 yrsResponsibilities Leverage data science tools and techniques keeping abreast with the latest in the community to solve problems. Present recommendations from complex analysis to business partners in clear and actionable...

  • Devops Engineer

    7 giorni fa

    Re, Italia Telamon HR Solutions A tempo pieno

    ResponsibilitiesResponsibilities: Support Database Engineering in the architecture design development and deployment of NoSQL database environments. This includes the advanced to expert engineering and implementation of the following: Provide technical expertise to design the most efficient and cost effective solutions for NOSQL database...

  • Devops Engineer

    1 giorno fa

    Re, Italia Telamon HR Solutions A tempo pieno

    ResponsibilitiesResponsibilities: Support Database Engineering in the architecture design development and deployment of NoSQL database environments. This includes the advanced to expert engineering and implementation of the following: Provide technical expertise to design the most efficient and cost effective solutions for NOSQL database...

  • Data Scientist

    6 giorni fa

    Re, Italia Ennoventure Technologies Pvt. Ltd. A tempo pieno

    Ennoventure is a venturebacked deeptech company with revolutionary technology to detect counterfeit goods. Our vision is to create a trusted value chain for delivering authentic products and experiences. We offer a fastpaced and highly collaborative work environment with significant opportunities for professional growth.As a Data Scientist you will be...

  • Data Scientist

    1 giorno fa

    Re, Italia Ennoventure Technologies Pvt. Ltd. A tempo pieno

    Ennoventure is a venturebacked deeptech company with revolutionary technology to detect counterfeit goods. Our vision is to create a trusted value chain for delivering authentic products and experiences. We offer a fastpaced and highly collaborative work environment with significant opportunities for professional growth.As a Data Scientist you will be...