Role is required to support the transformation programmes Cloudera Upgrade and Modern Data Platform onboarding subsequently. Current on-premises data lake should be upgraded and transformed to meet the scalability, agility and modern capabilities needs as the bank embarks on the journey to implement the industry best analytics and AI services, while ensuring the stability, resilience and data security remains intact.
Minimum Qualification
- Bachelor's degree in computer science, Computer Engineering, IT, or related fields
- 7+ years of overall experience with at least 2 years of leading teams delivering data lakes, data warehouses, data lakehouse
Minimum Experience
- Data Engineering skills:
- Proficiency in at least one of the programming languages viz. Python, Scala
- Proficiency in Data Integration tool Informatica DEI or Big Data Management (BDM)
- Minimum 2 years experience on developing and deploying workloads on Apache Spark
- Cloudera CDP platform engineering and development is MUST have
- SQL skills are must
- Experience in deploying Lakehouse on Azure/AWS
- Must have Cloud DevOps skills to be able to build and maintain the infrastructure as a code,
- At least 3 years of experience in Cloud, preferably Azure
- Communication skills to be able to explain the technical scenarios to senior IT and business stakeholders.
- Experience in agile way of working.