Search Jobs

Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

Atain
Early Applicant
  • Posted 4 days ago
  • Be among the first 10 applicants

Job Description

Job Title: Senior Data Engineer – Airline Domain

Experience: 7 to 12 Years

Location: Abu Dhabi, UAE (Work from Office)

  • Primary Skills: Azure + Databricks ecosystem (Mandatory), PySpark, Delta Lake, and Azure services, Python, SQL, ETL. Airline domain.

Job Summary:

We are looking for an experienced Senior Data Engineer with 7+ years of hands-on experience in designing and building scalable data platforms using Databricks, Apache Spark, and Azure.

The ideal candidate should have strong expertise in data engineering, distributed data processing, ETL/ELT pipelines, and Lakehouse architecture, along with relevant Airline/Aviation domain experience.

Key Responsibilities:

  • Design and develop scalable ETL/ELT pipelines using Databricks & Apache Spark
  • Build high-performance batch and real-time data processing solutions
  • Develop and maintain data platforms using: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics
  • Implement Lakehouse architecture using Delta Lake
  • Optimize data pipelines for performance, scalability, and cost
  • Implement data quality, governance, monitoring, and reliability frameworks
  • Collaborate with architects, developers, and business teams to deliver enterprise-scale data solutions

Required Skills:

  • 7+ years of Data Engineering experience
  • Strong hands-on experience with Databricks & Apache Spark
  • Strong expertise in the Azure Data ecosystem
  • Proficiency in Python and/or Scala
  • Strong understanding of distributed computing and data processing
  • Experience in data modeling and pipeline architecture
  • Strong software engineering and system design practices
  • Airline / Aviation / Travel domain experience is mandatory/preferred

About Atain:

(http://www.atain.com)

Atain is an enterprise orchestration partner that aligns people, processes, and platforms with AI to redefine work and deliver assured outcomes. It is enabled through the SMART Frameworkdriving superior metrics with AI-redefined work, the TechBud platform, a GenAI foundation built on zero-pilot architecture and ISO 42001 standards, a robust partner ecosystem, and deep domain expertise. Atain's Unified Hub continuously senses, predicts, and re-orchestrates work across people, processes, and platforms to deliver assured outcomes. The centers of skill and scale combine deep expertise with AI to deliver assured outcomes. For more information, visit www.atain.com

Atain is ISO 27001:2013, CMMI SVC Level 5 and ISAE-3402 compliant for IT, and COPC Certified v6.0, ISO 27001:2013 and PCI DSS 3.2 certified for BPO processes. The organization follows Six Sigma rigor for process improvements.

It is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Pipeline architecture

Azure Data Lake Storage (ADLS)

Delta Lake

Lakehouse architecture

Azure Data Factory (ADF)

About Company

Similar Jobs

10-12 yrs
Abu Dhabi, United Arab Emirates
Skills:
Data Warehousing, Azure Databricks, Azure Sql, Azure Data Factory, Data Visualization, Data Lake, big data handling, data integration workflow orchestration, distributed processing, ADLS Gen2, Microsoft Azure data stack, data querying and manipulation, data analysis programming language, business intelligence, cloud data platform, lakehouse storage architecture, data-model lifecycle, data-cleansing automation, ETL ELT design, statistical methods
7-9 yrs
United Arab Emirates, Abu Dhabi
Skills:
Databricks, Data Migration, Pyspark, Sql, Spark performance tuning, Delta Lake, Medallion-layer design, Data quality frameworks, Partitioning strategies, Data Validation, Agile delivery processes, Git-based CI/CD
5-7 yrs
Abu Dhabi, United Arab Emirates
Skills:
data warehouses , Scala, Kafka, Sql, Devops, Git, Azure Data Factory, Gcp, Spark, Azure, Python, AWS, Airflow, Data Lakes, Lakehouse architectures, Dagster
8-10 yrs
United Arab Emirates, Abu Dhabi
Skills:
Kinesis, Docker, Terraform, Kafka, Python, Sql, ClickHouse, QuestDB, TimescaleDB, MSK, Redpanda
8-10 yrs
United Arab Emirates, Abu Dhabi
Skills:
Gcp, Sql, Java, Rest Apis, Kubernetes, Python, Azure, Git, Cognite Data Fusion®