Overview

We are looking for a Lead Data Engineer to take ownership of end to end technical delivery of an AWS Lakehouse platform. This is a hands-on leadership role split approximately 60–70% engineering and 30–40% technical leadership. The successful candidate will define the platform’s technical architecture, set engineering standards, make critical build-vs-buy decisions, and actively mentor senior and mid-level engineers within a shared backlog environment.
Client:
The client is a major player within the high-volume, regulated iGaming and betting sector, operating across multiple international markets. They focus on delivering data-driven solutions and high-performance digital entertainment experiences.
Project Overview:
This initiative involves a major cloud migration and modernization effort, shifting legacy on-premises data infrastructure (including Kafka, NiFi, ClickHouse, and PostgreSQL workloads) into a modern, native AWS Lakehouse environment. The project is executed under a structured program governance model using a distributed, multi-market team delivery approach.

Responsibilities:
  • Design and lead the implementation of an AWS native lakehouse platform using Medallion architecture with S3 and Iceberg
  • Define and maintain Infrastructure as Code using Terraform, including environment setup and CI CD pipelines
  • Design and implement Change Data Capture and streaming ingestion frameworks for migrating legacy data workloads
  • Establish engineering standards including code reviews, automated testing, data quality validation, and reusable pipeline design
  • Evaluate AWS services and align architecture with Well Architected principles
  • Collaborate with product management to break down data products and guide engineering execution
  • Mentor data engineers and support knowledge transfer to build internal capabilities
  • Ensure platform observability, monitoring, and reliability across the data ecosystem
Required Qualifications:
  • 8+ years of experience in data engineering including at least 2 years in a technical leadership role
  • Hands on experience with AWS data services including S3, Glue, Redshift, Athena, MSK Kafka, EMR Spark, Lake Formation, IAM
  • Strong experience with Infrastructure as Code using Terraform and implementing CI CD pipelines
  • Proficiency in Python and SQL for building data pipelines and data models across batch and streaming workloads
  • Experience with open table formats such as Apache Iceberg, Delta Lake, or Apache Hudi
  • Experience designing and implementing Change Data Capture and real time streaming pipelines using Kafka, Flink, or Spark Structured Streaming
  • Experience delivering end to end data platforms or leading large scale data migrations
  • Experience migrating on premises data systems to cloud environments
  • Ability to communicate technical decisions clearly to both engineering and business stakeholders
  • Experience mentoring engineers and supporting team capability development
Nice To Have:
  • Experience migrating legacy platforms such as ClickHouse, Apache NiFi, or PostgreSQL
  • AWS certifications such as Data Engineer or Solutions Architect
  • Experience working in regulated industries with high volume real time data processing
  • Exposure to data governance tools such as AWS Lake Formation, AWS Glue Data Catalog, or Amazon Macie
  • Experience with business intelligence tools such as Tableau
Note:

✨ Our intelligent job search engine discovered this job and republished it for your convenience.
Please be aware that the job information may be incorrect or incomplete. The job announcement remains the property of its original publisher. To view the original job and its full details, please visit the job's URL on the owner’s page.

Please clearly mention that you have heard of this job opportunity on https://ijob.am.