Senior Data Engineer – Data Platform / CDQ / Integration

Key Responsibilities:

- Build and manage data pipelines (batch and real-time) using Databricks / Snowflake

- Implement data ingestion frameworks (API, streaming, batch) for external sources

- Develop data transformation, standardisation, and enrichment pipelines

- Implement data quality checks and CDQ rules within pipelines

- Integrate pipelines with metadata and lineage platforms

- Automate workflows and integrate with ServiceNow for issue management

- Support implementation of data governance controls and audit traceability

- Build reusable data engineering components for scalability

Required Skills:

- Strong hands-on experience in Databricks (Spark, Delta Lake) / Snowflake

- Experience in ETL/ELT pipelines, API integrations, streaming (Kafka/Event Hub)

- Knowledge of data quality frameworks and validation techniques

- Familiarity with data lineage integration and metadata tagging

- Programming skills (Python, SQL, Spark)

- Experience with cloud platforms (Azure / AWS / GCP)

- Understanding of governance integration (Collibra / Atlan / Purview preferred)