Overview

We are looking for a Senior Data Engineer to design, build and maintain the data layer of the platform. You will own canonical data modelling, transformation pipelines and the reporting semantic layer, integrate data from enterprise systems, and keep the whole data flow healthy — pipelines running, services alive, datasets trustworthy.
Project Overview:
This project focuses on building a scalable and reliable data platform on GCP. It starts as a greenfield build, with data models and pipelines designed from scratch, and is expected to grow further from there. Data comes from several enterprise systems as well as from automated services, supporting analytics, reporting and day to day operational processes.

Responsibilities:
  • Design and develop canonical data models in BigQuery, harmonising sources so that models can potentially be reused as the platform expands
  • Build and maintain data transformation workflows using Dataform
  • Develop and improve the Looker LookML semantic layer for reporting and analytics
  • Build ingestion pipelines on GCP, including event driven data flows
  • Integrate data from Sage 200, Dynamics 365 and other enterprise systems
  • Work with structured and semi structured data, including JSON payloads produced by automated services
  • Ensure data accuracy and consistency, with validation checks built into pipelines
  • Monitor data workflows and keep them running, with logging and alerting on failures
  • Apply security and data protection practices, including UK GDPR requirements
  • Monitor and optimize data workflows for performance and scalability
Required Qualifications:
  • Experience with BigQuery and cloud based data warehousing
  • Strong SQL skills and understanding of data modeling techniques
  • Hands on experience with Dataform or similar transformation tools
  • Python for data pipelines and services
  • Working knowledge of the wider GCP platform: object storage, messaging and event services, containerised services, IAM and secrets management
  • Experience building and maintaining data pipelines and ETL ELT processes, including event driven flows, with an understanding of orchestration principles
  • Comfortable working with both structured and semi structured data
  • Familiarity with Looker and LookML or similar semantic layer tools
  • Git based workflow with code review and separate development and production environments
  • Understanding of data quality practices and validation techniques
  • Ability to collaborate effectively with cross functional teams
Nice To Have:
  • Experience integrating data from enterprise or ERP systems such as Sage 200 or Dynamics 365
  • Infrastructure as code (Terraform) and deployment automation
  • Exposure to data governance and data catalog tools such as Dataplex
  • Domain experience with ERP finance flows, field service operations or purchase order to invoice processes
  • Experience with other cloud platforms or data tools
  • Experience working in analytics or reporting focused environments
Note:

✨ Our intelligent job search engine discovered this job and republished it for your convenience.
Please be aware that the job information may be incorrect or incomplete. The job announcement remains the property of its original publisher. To view the original job and its full details, please visit the job's URL on the owner’s page.

Please clearly mention that you have heard of this job opportunity on https://ijob.am.