Strong hands‑on experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestration.
Proficiency in Java, Python, shell scripting, RESTful API development, and web frameworks such as Flask and React.
Create EDW ETL/ELT codes using Teradata SQL, Informatica, Apache Spark, QueryGrid to perform various transformations and load into Teradata based data warehouse or datamarts
Performance tuning of highly complex applications to reduce resource usage
Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control
Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable
Install and build Master Data Management (MDM) application for various user uploads along with data validations and approval workflow.

Data Engineer with ETL