Big Data Platform Engineer

Key Responsibilities

• Build and manage scalable big data platforms and pipelines (ETL/ELT)
• Implement automation and CI/CD for data and infrastructure
• Develop streaming and batch data solutions using Kafka & Spark
• Ensure platform reliability through monitoring and performance tuning
• Collaborate with cross-functional teams using Agile & DevSecOps practices

Mandatory Skills

• Hadoop, Spark, Kafka
• Strong experience in DevOps & CI/CD
• Experience with distributed systems and data pipelines
• Proficiency in Python / Java / Scala
• Linux/Unix environment experience
  
  Preferred Skills
• Kubernetes, Docker, Cloud (AWS/Azure/GCP)
• Data formats: Parquet, ORC, Avro

Tools: Ansible, Jenkins

Exposure to Dataiku / ML Ops is a plus

• Education
• Bachelor’s degree in Computer Science or related field