Senior Data Engineer

You will architect, develop, and test large scale and efficient solutions that provide senior management with the accurate data to make business decisions.

Description

Design and implement scalable and high-quality methods of consuming data from a diverse set of sources with variable quality and predictability
Create data products, enabling self-service and predictability by consumer
Build libraries and frameworks that drive leverage and productivity for the team
Optimize and maintain solutions, driving improvements in efficiency, data quality, and operational excellence

Requirements:

BS or MS in Engineering/Computer Science
6+ years software engineering, including strong SQL and data focus
Expertise in languages like Python, Java, or Scala and technologies like Airflow, Spark, Trino, Kafka, Docker, Iceberg
Ability to analyze complex datasets and design solutions with quality and efficiency
Familiarity with SDLC best practices, version control, CI/CD
Experience with cloud services such as AWS, GCP, or Azure for data infrastructure and storage
Knowledge of infrastructure as code (e.g., Terraform) and container orchestration tools (e.g., Kubernetes)