Intermediate Java Spark/SQL Developer

Job Description

• Deliver fully tested source code complying with quality indicators objectives.
• Address technical aspects with architect and functional aspects with business analyst.
• Liaise with business analysts for clarification and understanding of requirements.
• Analyze technical constraints considering functional impacts with technical lead’s help.
• Organize and keep up to date detailed technical documentation.
• Provide detailed estimation for development of solutions.
• Develop tests strategy in coordination with project manager / Business Analysts.
• Perform design and code review for other team members.
• Mentor junior team members.
• Be pro-active and ensure a continuous improvement mindset for the team.

Requirements:

Work Experience:

• At least 7 years solid hands-on experience in Java/J2EE development.
• At least 3 years of experience in Apache Spark development.
• Strong experience with Apache Spark(Dataframe, APIs, RDDs, Spark SQL) for building scalable ETL pipelines.
• Proficient in Shell scripting ( Bash or similar) for process Automation.
• Extensive expertise in MS SQL Server performance tuning.
• Query optimization and index tuning.
• Understanding of execution plans.
• Database monitoring and troubleshooting.
• Partitioning strategies, locking, blocking and deadlock analysis.

Functional:

• Basic understanding of risk domain.
• General banking, finance and investment banking understanding and knowledge.

Technical:

• Java/J2EE ,Spring, Spring Boot, RESTFUL Webservices, Apache Spark.
• Knowledge on both frontend and backend development.
• Solution design using proven patterns, awareness of anti-patterns, performance tuning.
• In depth knowledge on Relational databases – MS SQL Server, sql profiler, query analyzer.
• Experience with CI/CD pipelines(Jenkins/GitLab or similar).
• Knowledge of scheduling tools(Airflow, Control-M).
• Strong understanding of data warehousing concepts, ETL design patterns and large-scale data processing.

The following skills and experiences is a plus:

• Experience in Docker, Kubernetes.
• Exposure with cloud platforms (AWS, Azure or GCP) for data processing.
• Experience working in enterprise or financial services environments is an advantage.

Other Professional Skills and Mindset:

• Strong maturity in software development latest market practices.
• Strong analytic skills.
• Capable to effectively interact with technical and functional team.
• Strives to deliver the solution in the most effective and timely manner.
• Team spirit - Like explain and share knowledge.
• Hands on and versatile.