Data Engineer

Bitrock is a high-end consulting and system integration company,strongly committed to offering cutting-edge and innovative solutions.Our tailored consulting services enable our clients to preserve the value of legacy investments while migrating to more efficient systems and infrastructure.We take a holistic approach to technology: we consider each system in its totality, as a set of interconnected elements that work together to meet business needs.We thrive on overcoming challenges to help our clients reach their goals, by supporting them in the following areas: Data, AI & ML Engineering; Back-end Engineering, Platform Engineering, Front-end Engineering, Product Design & UX Engineering, Mobile App Development, Quality Assurance, FinOps, Governance.The effectiveness of our solutions also stems frompartnershipswith key technology vendors, like HashiCorp, Confluent, Lightbend, Databricks, and Meterian.Who we are looking forWe are seeking a Senior Data Engineer to architect scalable distributed systems and lead the evolution of our data platform.In this role, you will treat data infrastructure as software, combining high-levelsystem designwith production-gradeprogrammingto deliver robust pipelines that support advanced analytics, machine learning, and RAG capabilities.We hire smart engineers, not just tool users.If you have strong fundamentals in distributed systems and software engineering but haven't used every tool in our specific stack, we still want to hear from you.We believe great engineers can learn new tools quickly.Who you areEngineering First:You approach data problems with a software engineering mindset, prioritizing maintainability and scalability.Tool Agnostic:While we use Databricks, you understand the underlying principles of distributed computing and can adapt to any stack.Architectural Vision:You understand why to use a specific architecture (e.g., Lakehouse vs. Warehouse) for specific use cases.Key ResponsibilitiesSystem Design & Architecture:Architect end-to-end data platforms that balance latency, throughput, and cost.Make high-level trade-off decisions (e.g., batch vs. streaming, consistency vs. availability) and select appropriate infrastructure.Advanced Software Engineering:Write production-ready, modularPythoncode.Enforce software best practices including unit/integration testing, CI/CD, and code reviews, ensuring our data pipelines are as robust as our application code.AI & RAG Infrastructure:Design the system topology for retrieval-based AI features.Build pipelines that ingest, chunk, and embed unstructured data, managing the flow from raw documents to Vector Search indices.Data Modeling:Implement dimensional modeling (Star Schema) and modern table formats to ensure data quality and usability for downstream analytics.Performance Optimization:Diagnose bottlenecks in distributed systems.Tune SQL queries and compute jobs (e.g., Spark) for efficiency at scale.The ??? StackCompute & Storage:Distributed processing (e.g., Spark, Databricks) and Lakehouse formats (Delta Lake, Iceberg).Languages:Python (Advanced/OOP), SQL.GenAI:LLM Orchestration, Vector Databases, Embeddings.Requirements5+ yearsin Data Engineering with a focus on building distributed systems.Distributed Computing:Experience with large-scale processing frameworks (e.g.,Apache Spark, Databricks, or similar).GenAI Competency:Proven experience building infrastructure forLLMs, working withVector Databases, and semantic search.System Design:Ability to whiteboard complex data architectures and defend your technology choices.Recruitment ProcessOur recruitment process has 3 stages:First discovery short interview with our HR teamTechnical interview with our Team LeadersFinal interview with our Head of AreaHow to ApplyYou can apply via LinkedIn or send your CV toSeniority LevelMid-Senior levelEmployment TypeFull-timeJob FunctionConsultingIT Services and IT ConsultingReferrals increase your chances of interviewing at Bitrock by 2x#J-*****-Ljbffr