Data Engineer

Key Responsibilities:

1) Database Migration Support

• Support end-to-end database migration activities, including data validation, transformation, and reconciliation.
• Assist in migrating data sources that underpin large-scale visualization dashboards.
• Identify and resolve data integrity, performance, and compatibility issues arising from migration.

2) Data Engineering & Platform Management

• Develop and maintain SQL and Python-based data pipelines using Databricks and Jupyter Notebooks.
• Create and manage Databricks compute clusters and SQL Warehouses; and configure Unity Catalog for data governance and access control.
• Optimize queries and data models to ensure performance and scalability post-migration.

3) BI & Dashboard Enablement

• Reconfigure, test, and validate Tableau dashboards impacted by database changes.
• Partner with dashboard owners to ensure data accuracy, performance, and functional parity after migration.
• Support ad-hoc analysis and troubleshooting related to Tableau and SpotFire dashboards.

4) Collaboration & Documentation

• Work closely with Data Analysts, Business Stakeholders, and IT teams within ASM.
• Document migration steps, data mappings, and known issues to support knowledge transfer and audit readiness.
• Follow ASM data governance, security, and compliance standards.
• Collaborate with global network/database team to identify, engineer and key data elements in-line with existing needs.

Qualifications and Experience:

Technical Skills (Mandatory)

• Tableau certification (required; active or recently obtained).
• Strong proficiency in SQL / MySQL for querying, transformation, and validation.
• Hands-on experience with Python for data processing and automation.
• Experience using Databricks, including: Creating and managing compute clusters and SQL Warehouses.
• Working with Unity Catalog.
• Experience working with Jupyter Notebooks.

Technical Skills (Nice-to-Have / Highly Favored)

• Experience with SpotFire (dashboard development or support).
• Prior involvement in database or platform migration projects.
• Familiarity with manufacturing, biotech, or regulated environments.