
Search by job, company or skills
Job Summary
We are seeking a Principal Data Architect to lead the design and implementation of enterprise-scale cloud data and AI platforms. The role will drive data architecture, Lakehouse platforms, AI/ML solutions, data governance, and technical strategy across complex enterprise environments.
Key Responsibilities
.Design enterprise Data & AI architecture and cloud data platforms.
.Lead Databricks Lakehouse, Delta Lake, DLT and Unity Catalog implementations.
.Develop scalable ETL/ELT, data engineering and data modelling solutions.
.Design AI/ML, GenAI and MLOps platforms and production solutions.
.Implement data governance, quality, security, lineage and access controls.
.Lead cloud platforms across Azure and AWS.
.Design real-time data solutions using Kafka, Azure Event Hub and Spark Streaming.
.Drive CI/CD, DevOps and cloud cost optimization for data platforms.
.Provide technical leadership and mentoring to Data Engineers, ML Engineers and Data Scientists.
.Engage stakeholders to define technology roadmaps, solution architecture and delivery plans.
Requirements
.15+ years experience in Data Architecture, Data Engineering or Enterprise Architecture.
.Strong experience with Databricks, Azure/AWS, PySpark, Python and SQL.
.Expertise in Lakehouse, Data Warehousing, ETL/ELT and Data Modelling.
.Experience with AI/ML, GenAI, LLM, MLOps and MLflow.
.Strong knowledge of Data Governance, Data Quality, Security and Privacy.
.Experience with Kafka/Azure Event Hub, CI/CD and DevOps.
.Strong technical leadership and stakeholder management skills.
Preferred Skills: Databricks certifications, DAMA-DMBOK, PMP, Power BI/Tableau/Qlik experience.
Job ID: 153755499
Skills:
Pyspark, Kafka, ELT, Data Governance, Python, AWS, Ml, Data Modelling, Sql, Data Quality, Devops, MLops, Databricks, Data Warehousing, Azure, Etl, GenAI, MLflow, Security, CI CD, Llm, Privacy, Ai, Lakehouse, Azure Event Hub
Skills:
snowflake , Openflow, Python, Sql, AWS, Airflow, Airbyte, Glue, NiFi
Skills:
data engineering , data warehouses , Cloud Technologies, MLops, Data Governance, AWS, lakehouse patterns, generative AI, enterprise data architecture, data sovereignty, competitive platform migrations, regulatory compliance frameworks, data lakes, analytics solution design, model development lifecycle, AI ML technologies, streaming architectures
Skills:
graph databases , snowflake , Cassandra, Kafka, ELT, Kinesis, Gcp, Neo4j, Togaf, Data Governance, Databricks, MongoDB, Data Integration, Azure, AWS, Etl, master data management, NoSQL solutions, Pub Sub, workflow automation, zachman