Organization:

At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Associate Data Engineer

Location: Bengaluru

Business & Team: Ops Tech – Financial Crime Technology

Impact & contribution:

You will play a pivotal role in driving business outcomes through effective data management and analysis.

• Enhancing Decision Making with Data
• Ensuring Data Security and Compliance
• Future Trends in Data Engineering

Roles & Responsibilities:

• Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
• Provide technical governance of product delivery to ensure successful delivery and adoption.
• Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
• Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks.
• Contribute to domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy.
• Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
• Collaborate with stakeholders to analyse and translate requirements to technical implementation.
• Identify and drive opportunities for continuous improvement within the team and in delivery of products.
• Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers.

Essential Skills:

• Minimum of 2-3 years of hands-on experience in Software Engineering or development to build solution in on-prem bigdata platform and AWS cloud which includes S3, Athena, EC2, EMR, Airflow, hive, spark, HDFS, etc.
• Minimum 2-3 years of hands-on experience in any of the language (Scala/Python) with spark ETL development.
• Hands-on experience in any of them (Teradata / Oracle / SQL Server / MySQL) with strong SQL expertise
• Hands-on experience in any of the CI/CD tools like Intellij teamcity, Github Actions, etc
• Hands-on experience in any of the code maintenance repository like Github cloud
• Hands-on experience in Shell Scripting
• Good to have hands-on experience in any ETL Tool- Ab initio GDE/BRE
• Good Understanding of Distributed system and computing
• Good to have hands on experience on Performance Tuning
• Should be well aware of AGILE processes and methodologies
• ITIL, familiarity with incident/problem management, root cause analysis, troubleshooting and post-mortem review
• A natural ability to effectively communicate, educate and influence the different stakeholders/ peers, to solve challenging problems, while working in collaboration with other cross-functional engineering and solution design teams
• A positive desire to contribute towards initiatives, along with a strong ‘can- do’ attitude in juggling between constantly changing priorities
• Flexible to cross trained to organisational adopted tools & technologies

Educational Qualifications: A degree in Engineering / Computer Science or a related discipline