Senior Azure Databricks Data Engineer

Hiring: Senior Azure Databricks Data Engineer

Experience: 5+ Years (Minimum 5+ years of hands-on Azure Databricks experience)

Shift Timing: UK Shift – 3:00 PM to 12:00 AM IST

Salary: Open, based on experience and technical expertise

Job Overview

We are looking for an experienced Senior Azure Databricks Data Engineer to design, develop, and maintain scalable data pipelines and enterprise data solutions.

Key Responsibilities

• Develop batch, incremental, CDC, and streaming data pipelines.
• Build and maintain lakehouse solutions using Azure Databricks, Delta Lake, and Unity Catalog.
• Work on data integration, transformation, validation, and data modeling.
• Develop solutions using Python, PySpark, Spark SQL, and SQL.
• Implement data security, quality, monitoring, and performance optimization.
• Manage CI/CD, GitHub/Azure DevOps, automated testing, and deployments.
• Provide production support and collaborate with cross-functional teams.

Required Skills

• Azure Databricks, PySpark, Python, Spark SQL, and SQL.
• Delta Lake and Unity Catalog.
• Azure Data Lake Storage Gen2 (ADLS Gen2).
• Databricks Jobs and Workflows.
• Azure Key Vault, Microsoft Entra ID, and RBAC.
• Data Modeling, CDC, CI/CD, and Production Support.

Interested Candidates:

Candidates currently working with relevant Azure Databricks experience are encouraged to share their updated profiles for further discussion.

Compensation is open and will depend on experience and technical expertise.