Big Data Engineer (Cloudera / Hadoop)

Job Description

About the Role

We are seeking a motivated Hadoop Administrator with at least 3 years of hands-on experience in managing Cloudera Hadoop environments. The successful candidate will support daily platform operations, assist in patching and upgrades, and participate in migration activities under senior guidance.

Key Responsibilities

• Monitor Hadoop cluster performance and ensure high availability of services
• Perform incident management and vendor log collection for Cloudera products
• Execute application start/stop and configuration requests based on operational needs
• Collaborate with infrastructure teams (OS, Storage, Network, Compute) for issue resolution
• Assist in job failure analysis, queue management, and resource allocation
• Perform patching and minor upgrades of Hadoop clusters
• Support NiFi template migration activities
• Contribute to backup and recovery operations for critical datasets
• Manage user access and authentication (Kerberos, Ranger, LDAP)
• Assist in Cloudera version upgrades and hotfix deployments
• Support Disaster Recovery (DR) drills and environment synchronization
• Monitor platform health using Cloudera Manager, Grafana, and ELK dashboards

Requirements

• Minimum 3 years of experience in Hadoop ecosystem (HDFS, YARN, Hive, Spark, Oozie)
• Basic hands-on experience with Cloudera Manager and administration tools
• Strong Linux administration and shell scripting skills
• Familiarity with Kerberos authentication, Ranger security, and access control
• Understanding of patching and upgrade processes in Hadoop environments
• Good troubleshooting, log analysis, and communication skills

Good to Have

• Experience with Python or Ansible scripting for automation
• Exposure to CI/CD pipelines for platform operations