Senior Azure Data Engineer

YOUR KEY RESPONSIBILITIES:

• Design, build, and maintain scalable ELT/ETL pipelines using Azure Data Factory, ensuring reliability and performance at terabyte scale.

• Own end-to-end pipeline health: monitoring, alerting, incident response, and continuous improvement.

• Identify and resolve bottlenecks across ingestion, transformation, and serving layers; drive measurable performance gains.

• Contribute to the design and evolution of our medallion architecture and golden layer strategy.

• Implement data ingestion processes from multiple heterogeneous sources, ensuring accuracy, completeness, and consistency.

• Support the migration from SAP BW, ensuring data continuity and quality throughout.

• Ensure data integrity and availability through appropriate storage solutions, partitioning strategies, and access controls.

• Work autonomously to deliver complex data engineering tasks with minimal supervision, while proactively communicating progress and blockers.

• Collaborate closely with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions.

• Participate in agile ceremonies, contribute to sprint planning, and own your backlog items end-to-end.

ARE THESE YOUR SECRET INGREDIENTS

• Bachelor's degree in Information Technology, Computer Science, or related field.

• 5+ years of experience in data engineering with a strong focus on Azure (Azure Data Factory, Azure Data Lake Storage, Fabric).

• Proven experience designing and building production-grade data pipelines that handle large volumes of data reliably.

• Strong SQL skills and experience with data modelling, schema design, and query optimization.

• Hands-on experience with Databricks (PySpark / Spark SQL) for large-scale data transformation.

• Proficiency in at least one programming language: Python (preferred), Scala, or C#/.NET.

• Solid understanding of data warehouse and lakehouse concepts.

• Strong ability to work independently, manage your own priorities, and deliver under ambiguity.

• Excellent communication skills - able to translate technical concepts for business stakeholders and vice versa.

• Excellent problem-solving and debugging skills.

• Excellent spoken and written English

• Communication, organizational and analytical skills

Preferred Qualifications:

• Experience with real-time or near-real-time streaming pipelines (Azure Event Hubs, Apache Kafka, Spark Streaming).

• Hands-on experience with CI/CD for data pipelines using Azure DevOps, Git, and infrastructure-as-code (Terraform).

• Familiarity with DevSecOps principles and experience working within the SAFe Agile framework.

• Knowledge of SAP BW (extractors, transformations, queries, data export) and experience supporting BW migrations.

• Experience with big data technologies such as Hadoop, Spark, and Hive, and large data volume management.

• Strong analytical and problem-solving mindset - you enjoy finding root causes, not just symptoms.

• Experience with Power BI and DAX for building analytical models and connecting to enterprise data.