Data Engineer

Responsibilities Champion Data Access and User Experience • Assess and coordinate data requests from business users, acting as a trusted advisor to understand their requirements and recommend the most appropriate datasets for their objectives. • Convert complex data availability assessments into clear, practical guidance, enabling users to navigate HPB’s data ecosystem with confidence. • Work closely with requestors, the data operations team, and domain data engineers to ensure approved data requests are fulfilled efficiently and effectively. Deliver Excellence in Data Engineering and Service • Develop and implement reliable data extraction and delivery processes that support varied business needs while upholding high standards of accuracy and security. • Manage recurring data contributions to government partners, ensuring smooth coordination from data ingestion through to compliant and timely delivery. • Ensure all data services adhere to established governance frameworks and access control standards, maintaining trust, reliability, and compliance. Enhance Data Discovery and Organisational Intelligence • Manage and maintain comprehensive metadata for HPB’s data discovery platform, ensuring datasets are accurately documented and easy to discover for informed decision-making. • Partner with data owners and the engineering team to improve metadata quality and build comprehensive catalogues that help users locate and utilise data effectively. • Continuously refine dataset descriptions, classifications, and catalogue information to improve the overall user experience across the organisation. Provide Expert Support and Continuous Innovation • Provide strong Level-1 support through the CDOO service management system, offering triaging and guidance to ensure smooth day-to-day operations. • Identify and drive process improvements that enhance service quality, shorten turnaround times, and improve user satisfaction across all data service touchpoints. • Maintain thorough documentation and knowledge repositories to support operational excellence and team capability development. Qualifications • Experience • Minimum 2 years of experience in data engineering, operations, analytics support, integration, or metadata management roles at Associate Consultant level. Experience in public health would be advantageous. • Education • Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, Data Analytics, or a related discipline from a recognised institution. • Alternatively, professional certifications in data engineering, data analytics, or data science from accredited bodies, together with relevant experience, may be accepted for candidates with a Bachelor’s degree in Engineering or Science. Required Skills • SQL and PySpark and/or Python, with hands-on experience working with structured datasets and data transformation processes. • Cloud-based data platforms, preferably Microsoft Azure, including Databricks and enterprise data warehouse environments. • Data governance, metadata management, and data catalogue concepts. Preferred Skills • Experience with Microsoft Purview and Unity Catalog. • Professional certifications in cloud, data engineering, data governance, or analytics-related domains.