Senior Data Engineer

Job Summary

The Senior Data Engineer designs, builds, and maintains scalable data pipelines and platforms within Microsoft Fabric and Azure SQL to support analytics, AI, and business decision-making. Responsible for the end-to-end medallion architecture (Bronze to Gold layers), ensuring reliable, well-structured, and documented data products.

Key Responsibilities

Data Architecture & Engineering

• Design, build, and optimize end-to-end medallion architecture (Bronze, Silver, Gold) in Microsoft Fabric (Lakehouse, Warehouse, Dataflows Gen2).
• Enforce engineering best practices, versioning, CI/CD, and Git-based recovery workflows.

Data Integration

• Design a reusable, API-led integration layer connecting source systems (Premier, Salesforce, Oracle Primavera Cloud, Azure SQL).
• Develop ingestion frameworks for structured and semi-structured data via REST APIs.

Data Preparation for AI & Analytics

• Curate, validate, and optimize datasets for ML/AI model training, feature engineering, AI pricing intelligence, and forecasting.

Data Quality & Governance

• Implement quality gates between layers, automated monitoring/alerting, and data lineage.
• Maintain data residency, in-tenant security, and role-based access control.

Collaboration & Enablement

• Partner with analysts and business stakeholders to turn requirements into scalable data solutions.
• Deliver operational runbooks, documentation, and data quality scorecards.

Qualifications & Experience

• Education: Bachelor's degree in Computer Science, Data Engineering, or related field (Master's preferred).
• Experience: 10+ years in data engineering; hands-on experience with Microsoft Fabric and AI data preparation.
• Technical Skills: SQL, Python, Spark, Power Query, REST APIs, Git, Azure (Functions, Service Bus, Key Vault, Blob Storage), and Infrastructure as Code.
• Domain Experience: Construction, contracting, fit-out, or engineering design highly desirable; familiarity with Salesforce, Premier, or Oracle Primavera Cloud.

Preferred Certifications

• DP-700: Microsoft Certified Fabric Data Engineer Associate
• DP-600: Microsoft Certified Fabric Analytics Engineer Associate
• AZ-104: Microsoft Certified Azure Administrator Associate