Azure Data Engineer

We are looking for a highly skilled Azure Data Engineer for an engagement to build scalable, production-ready data solutions.

The ideal candidate will have strong hands‑on experience with Python, PySpark, Azure Databricks, and Azure Data Factory, along with a solid understanding of modern data engineering best practices.

Responsibilities

* Build and optimize data pipelines using Python, PySpark, Spark SQL, and Azure Databricks

* Develop clean, modular code for data ingestion, transformation, validation, and quality checks

* Work with Azure Data Lake Storage Gen2 and Azure SQL to deliver reliable solutions

* Implement best practices for data quality, integrity, and security

* Troubleshoot issues independently and collaborate with cross-functional teams

* Maintain clear technical documentation and support production environments

📌 Required Skills

* Strong expertise in PySpark, Spark SQL, and Spark optimization/performance tuning

* Hands-on experience with Azure Databricks (notebooks, workflows, job clusters)

* Solid understanding of Delta Lake (schema evolution, partitioning, merges, optimization)

* Experience with Azure Data Lake Storage Gen2

* Git-based version control and production support experience

✨ Nice to Have

* Exposure to data governance, compliance, and security

* Knowledge of SAP ERP systems