Senior Azure Data Engineer

Job Title: Senior Azure Data Engineer

Experience: 12–18 Years

Notice Period: 1 Month

Location: Pan-India

Employment Type: Full-Time

Job Summary:

We are looking for an experienced Senior Azure Data Engineer with 12–18 years of overall experience in data engineering, data warehousing, and analytics. The ideal candidate should have strong expertise in designing, building, and optimizing scalable cloud-based data platforms on Microsoft Azure, with hands-on experience in Microsoft Fabric and modern data engineering technologies.

The candidate will be responsible for developing end-to-end data solutions, implementing lakehouse and data warehouse architectures, and working closely with business and technology stakeholders to deliver high-quality data platforms that support analytics and reporting requirements.

Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions on Microsoft Azure.
• Build and manage end-to-end data pipelines using Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.
• Develop and optimize Lakehouse and Data Warehouse solutions using Microsoft Fabric and Azure technologies.
• Implement ETL/ELT processes for ingesting, transforming, and loading large-scale data.
• Work with structured and unstructured data from multiple source systems.
• Develop and optimize PySpark and SQL-based data transformation workflows.
• Design and implement data models including Star Schema, Snowflake Schema, and Data Vault 2.0.
• Ensure data quality, performance optimization, security, and governance across the data platform.
• Collaborate with business users, architects, and global stakeholders to understand requirements and deliver effective solutions.
• Implement CI/CD pipelines and DevOps best practices using Azure DevOps.
• Support cloud infrastructure automation and deployment using Terraform and Docker.

Required Skills

• Strong hands-on experience with Microsoft Fabric (Lakehouse, OneLake, Data Pipelines, Semantic Models, Power BI).
• Expertise in Azure Data Factory (ADF).
• Strong experience with Azure Synapse Analytics and Azure SQL Database.
• Hands-on experience with Azure Databricks, Apache Spark, and PySpark.
• Experience working with Azure Data Lake Storage Gen2 (ADLS Gen2).
• Strong knowledge of data warehousing concepts, ETL/ELT frameworks, and modern data architectures.
• Proficiency in SQL, Python, and PySpark.
• Experience with Azure DevOps, Git, and CI/CD implementation.
• Knowledge of security and governance practices including RBAC, Managed Identity, and Azure Key Vault.
• Strong problem-solving and stakeholder management skills.

Preferred Skills

• Experience with Snowflake.
• Knowledge of Terraform and Docker.
• Exposure to REST APIs and KQL.
• Experience working in enterprise-scale cloud migration and modernization projects.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• Relevant Microsoft Azure certifications will be an added advantage.