SalaryPeak

Python Data Engineer - Cloudera

D L RESOURCES PTE LTD
Singapore 6+ years Posted 1w ago

Salary Range

SGD 72,000 - SGD 108,000 /year

SGD 6,000 - SGD 9,000/month

Skills Required

Global MarketingScalaBig Data FrameworkFinancial ManagementSystems IntegrationBanking OperationsCore TechnologiesApache KafkaBASICCDPEDjangoMarket Datadata understanding

Job Description

Client: Bank Sector Technology Operations

Hands-on techno-functional role working with technology teams across infrastructure and other divisions to deliver system solutions for the business

Involve in development and system integration relevant systems with CDP / CDSW

Strong understanding of Cloudera framework including CDP (Cloudera Data Platform) and CDSW (Cloudera Data Science Workbench)

Hands-on experience in Big Data solution and development based on Python technologies stack

Design and implement secure, scalable and high-performance data processing pipelines

Key technologies: Python, SQL, Spark, PySpark, Hadoop, Hive, Impala, Kafka, Zookeeper, Ranger, Atlas, Cloudera Manager, Django, Red Hat Linux, Shell Script, ETL, data pipelines, Parquet, ORC, JSON, basic Java / Scala

Good to have financial industry experience, especially global market products, market data analytics, data science projects, and identifying risk factors affecting pricing of products