Data Engineer

Role Overview

We are seeking a highly skilled and motivated Data Engineer with 5–7 years of experience

to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will

have strong expertise in SQL, Databricks, Confluent (Kafka), Azure Data Factory (ADF), and

Azure Data Lake Storage (ADLS), with a solid understanding of banking domain processes

and regulatory considerations. This role involves working closely with cross-functional

teams to enable data-driven decision-making across critical banking functions.

Key Responsibilities

Design, develop, and maintain robust, scalable data pipelines using Azure Data Factory

(ADF) and Databricks

Implement batch and real-time data ingestion frameworks leveraging Confluent Kafka

Build and optimize data models, transformations, and ETL/ELT pipelines using SQL and

Spark

Develop and manage data storage solutions in Azure Data Lake Storage (ADLS)

Ensure high data quality, integrity, and governance standards

Support data integration across systems including core banking and CRM

Optimize performance of large-scale datasets

Collaborate with stakeholders to translate requirements into solutions

Ensure compliance with banking regulations and data privacy

Troubleshoot production issues

Required Skills & Experience

Strong expertise in SQL (complex queries, tuning, modeling)

Hands-on experience with Databricks, Spark, PySpark

Experience with Confluent Kafka and event-driven architecture

Experience with Azure Data Factory (ADF)

Experience with Azure Data Lake Storage (ADLS)

Understanding of data warehousing concepts

Familiarity with CI/CD and DevOps for data platforms

Domain Knowledge (Preferred)

Experience in banking or financial services

Understanding of core banking systems

Knowledge of payments, lending, wealth management

Awareness of regulatory frameworks (KYC, AML)

Soft Skills

Strong analytical and problem-solving skills

Excellent communication and stakeholder engagement

Ability to work in fast-paced environments

Strong ownership and collaboration mindset

Qualifications

Bachelor's or Master's degree in relevant field

Azure/Data engineering certifications preferred

Good to Have

Experience with Python or Scala

Exposure to data governance tools

Knowledge of APIs and microservices

Experience with BI tools like Power BI

Key Success Indicators

Delivery of scalable pipelines

Improved data reliability

Reduced data latency

Alignment with business requirements