Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

confidential jobs
Early Applicant
  • Posted 18 days ago
  • Be among the first 10 applicants

Job Description

This role is responsible for the design, development, and optimization of data platforms that support the organization's strategic data & analytics goals. This role will work on the implementation of data platform solutions, ensuring scalability, performance, and reliability. This role requires deep expertise in data platform engineering, a strong understanding of data architecture, and the ability to drive innovation and promote automation of work.

Key Responsibilities:

  • Implement scalable, high-performance data platform architecture and technologies using Databricks.
  • Lead the development of data engineering pipelines, standards, practices, and tools.
  • Provide technical expertise for data platform initiatives.
  • Collaborate with stakeholders (data scientists, business analysts, and others) to align data platform implementation with business plan and objectives.
  • Work on and oversee the development and deployment of data platform solutions (acquisition, storage, transformation, query, analysis, consumption), ensuring they meet performance, security, and compliance requirements.
  • Deliver industry best practices data orchestration to minimize data pipeline downtime and efficient use of resources. Optimize data ingestion, storage, retrieval, and processing technology and operations with a focus to improve performance and reduce costs.
  • Develop and manage data warehousing solutions, including data models, schema design, and database performance optimization.
  • Develop processes for data integration, ETL/ELT processes, and data quality controls within data pipelines. Ensure adherence and compliance to data governance policies.
  • Ensure seamless integration of data platforms with existing systems and data sources (including big data), supporting both batch and real-time data ingestion and processing. Implement and maintain data storage structures (e.g., data lake, lake house, ODS etc.), in addition to data warehousing, to support data analysis, reporting, and business intelligence needs.
  • Work with cross-functional business and data management teams, including data science, business intelligence, and technology teams, to ensure platform solutions meet diverse needs.

The responsibilities and duties outlined above are not exhaustive and may evolve over time. The role may require additional tasks and responsibilities as assigned by the line manager or higher authorities, in alignment with organizational needs.

What We're Looking For

Education:

  • Educated with at least bachelor's degree
  • Proficient in English
  • Proficient in Arabic is a plus
  • Excellent communication and presentation skills for all levels
  • Strong teamwork skills
  • Certifications in Databricks, and relevant big data and data integration technologies
  • Proficiency in Vietnamese, Russian, Turkish, or Central Asian languages is a plus

Experience:

  • 7+ years of experience in data engineering, data platform development, or a related field
  • Extensive experience with big data technologies and data platforms
  • Strong understanding of data modelling, data warehousing, and ETL/ELT processes
  • Proven experience in designing and optimizing large-scale data solutions
  • Experience in project management
  • Excellent leadership, communication, and problem-solving skills
  • Able to lead a project team
  • Able to deal with varied tasks and to work under pressure to meet deadlines and target
  • Able to work effectively and responsibly without close supervision
  • Able to foster a culture of collaboration, innovation, transparency, and accountability
  • Able to execute clear strategies and corporate requirements
  • Able to articulate ideas to both technical and non-technical audiences
  • Professional demeanour and presentation, leads by example
  • Demonstrates ability to manage change and foster teamwork

Why Join Us

  • Opportunities for continuous learning, certifications, and professional development.
  • Dedicated to building a diverse and inclusive workplace where everyone feels valued and empowered to be their authentic selves.
  • Committed to building a stable, forward-thinking organization where innovation thrives.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Data engineering pipelines

Data platform engineering

Lake house

Data storage structures

Data quality controls

Data orchestration

About Company

Similar Jobs

7-12 yrs
Abu Dhabi, United Arab Emirates
Skills:
Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Distributed Computing, Pyspark, Apache Spark, Data Modeling, Sql, ELT, Azure Synapse Analytics, Databricks, Azure, Python, Etl, Pipeline architecture, Delta Lake, Lakehouse architecture
10-12 yrs
Abu Dhabi, United Arab Emirates
Skills:
Data Warehousing, Azure Databricks, Azure Sql, Azure Data Factory, Data Visualization, Data Lake, big data handling, data integration workflow orchestration, distributed processing, ADLS Gen2, Microsoft Azure data stack, data querying and manipulation, data analysis programming language, business intelligence, cloud data platform, lakehouse storage architecture, data-model lifecycle, data-cleansing automation, ETL ELT design, statistical methods
5-7 yrs
Abu Dhabi, United Arab Emirates
Skills:
Data Modelling, Pyspark, Kafka, Sql, ELT, Data Quality, Azure Data Factory, MLops, Azure Data Lake, Databricks, Data Warehousing, Python, Etl, Cloud Data Engineering, Performance Optimisation, CI CD, Real-time data processing, Delta Lake
10-13 yrs
Abu Dhabi, United Arab Emirates
Skills:
data engineering , Data Management, Digital Transformation, Data Governance, Data Analytics, Cloud Data Engineering, Data Lakes, ETL processes, Business Intelligence
7-9 yrs
United Arab Emirates, Abu Dhabi
Skills:
Databricks, Data Migration, Pyspark, Sql, Spark performance tuning, Delta Lake, Medallion-layer design, Data quality frameworks, Partitioning strategies, Data Validation, Agile delivery processes, Git-based CI/CD