Data Engineer

Our client, one of Asia-Pacific’s leading organizations is looking for:
Data Engineer

Scope of Work:
Key Responsibilities

• Design, develop, and maintain data pipelines that extract data from various sources and formats, transform it according to business requirements, and load it into target systems.
• Perform data extraction, cleaning, transformation, and flow.
• Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks.
• Integrate and collate data silos in a manner which is both scalable and compliant.
• Collaborate with the Project Manager, Data Architect, Business Analysts, Frontend Developers, Designers and Data Analysts to build scalable data driven products.
• Work in an Agile Environment that practices Continuous Integration and Delivery.
• Work closely with fellow developers through pair programming and code review process.

Qualifications:

• Bachelor's degree in Computer Science, Software Engineering, or related field.
• At least 3–5 years’ experience in ETL/data integration projects.
• Proficient in general data cleaning and transformation using scripting languages (mandatory: SQL, Python; added advantages: R, etc) to ensure data accuracy and consistency. Knowledge in R will be an advantage.
• Proficient in building ETL pipeline (mandatory: SQL Server Integration Services SSIS, Python, Snowflake; added advantages: AWS Lambda, ECS Container task, Eventbridge, AWS Glue, Spring, etc). Proven hands-on experience with Microsoft SSIS and Snowflake.
• Proficient in database design and various databases (mandatory: SQL, AWS S3, RDS; added advantages: PostgreSQL, Athena, MongoDB, Postgres/GIS, MySQL, SQLite, VoltDB, Apache Cassandra, etc).
• Experience in building production-grade data pipelines, ETL/ELT data integration.
• Experience in CI/CD pipelines and DevOps tools (e.g. GitLab).

---------------------------------------------------------------------------------------------------------------------------------------------

Interested applicants can also email CV at [email protected] (for faster processing, please state the exact job / position title applied “Data Engineer”

Only shortlisted candidates will be notified.

---------------------------------------------------------------------------------------------------------------------------------------------

EA License Number: 10C3636
EA Personnel Name: Chauhan, Asmita
EA Personnel Registration Number: R1980706

By applying for this role, you have read and acknowledge the Data Privacy statement - http://www.nsearchglobal.com/data-protection-notice/