Data Engineer - Databricks & Informatica

Job Description

Create technical, functional, and operational documentation for data pipelines and applications.
Understand business requirements to drive the design of data solutions/applications and technical architecture.
Work with other developers, designers, and architects (local and remote) to ensure data applications meet requirement and performance, data security, and analytics goals.
Lead the configuration, build, and testing of data applications and technical architecture.
Establish and grow a data engineering framework to ensure the reliability, scalability, quality and efficiency of data pipelines, storage, processing and integration.
Coordinate and participate in structured peer reviews / walkthroughs / code reviews.
Maintain and/or update technical and/or industry knowledge and skills through continuous learning activities.
Mentor and develop junior engineers

Requirements & Qualifications

• Experience: 6 – 8 Years
• Has more than 2 Years of experience in developing data lakes, and datamarts on the Databricks/Hadoop platform.
• 1-3 years of experience in INFORMATICA IDMC/PowerCenter Services
• Skilled in Spark, Python, PySpark and SQL.
• Must be a have Certified Data Engineer from Databricks AND/OR Should possess a INFORMATICA Professional-level certificate on IDMC Integration Services (CDI or CAI)
• Good understanding of developing data warehouses, data marts, etc.

Good presentation skills with the ability to convey complex ideas to peers and management.