Data Engineer
- Posted 9 days ago
- Be among the first 10 applicants
Job Description
Experience: 5+ years in Data Engineering or a related field
Job Summary
We are looking for an experienced Data Engineer with strong expertise in building scalable ETL/ELT pipelines, data integration frameworks, and cloud-based data solutions. The candidate will be responsible for developing reliable data platforms to support enterprise analytics, AI, and reporting requirements.
Key Responsibilities
Job Summary
We are looking for an experienced Data Engineer with strong expertise in building scalable ETL/ELT pipelines, data integration frameworks, and cloud-based data solutions. The candidate will be responsible for developing reliable data platforms to support enterprise analytics, AI, and reporting requirements.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build data integration and transformation solutions using cloud technologies.
- Develop data models, data warehouses, and real-time data processing solutions.
- Implement data quality, validation, security, and performance optimisation practices.
- Support AI/ML and analytics workloads and collaborate with Data Scientists and business teams.
- Implement CI/CD and MLOps practices for automated and reliable data deployments.
- Databricks, Azure Data Factory, Azure Data Lake
- PySpark, Python, SQL, Delta Lake
- Kafka / Real-time data processing
- ETL/ELT, Data Modelling & Data Warehousing
- Data Quality & Performance Optimisation
- CI/CD, MLOps and Cloud Data Engineering
More Info
Key Skills
Cloud Data Engineering
Performance Optimisation
CI CD
Real-time data processing
Delta Lake
About Company
Skills:
Github, Pyspark, Sql, Azure Data Factory, Spark, Databricks, Python, Azure DevOps, Parquet, Synapse, Microsoft Purview, Delta, Microsoft Fabric
Skills:
Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Distributed Computing, Pyspark, Apache Spark, Data Modeling, Sql, ELT, Azure Synapse Analytics, Databricks, Azure, Python, Etl, Pipeline architecture, Delta Lake, Lakehouse architecture
Skills:
Pyspark, AWS Glue, Jira, Git, Terraform, Agile, S3, Lambda, Athena
Skills:
Data Modeling, Power Bi Desktop, Data Architecture, Data Warehousing, Excel, Advanced Sql, Data Governance, Dax, Python, API Integrations, Data Visualization Best Practices, Tabular Editor, SQL Fundamentals, KPI Development, Security, Business Analysis, DAX Studio, Power BI Service, Sharepoint, Power Query M
Skills:
ELT, Ods, Etl, Big Data Technologies, Data Lake, Data Architecture, Data Warehousing, Data Integration, Databricks, Data Modelling, Data engineering pipelines, Data platform engineering, Lake house, Project management, Data storage structures, Data quality controls, Data orchestration