Job Title: Data Engineer
Location: Abu Dhabi, on site
Core Responsibilities:
- Architect Data Solutions: Design and maintain scalable ETL/ELT pipelines to ingest, clean, and transform multi-source data.
- Dataset Management: Curate and optimize complex datasets to drive business intelligence and advanced analytics.
- Continuous Improvement: Regularly test and refine data pipelines to maximize performance and efficiency.
- Data Integrity: Champion best practices in validation and monitoring to ensure high-quality, reliable data.
- Cross-Functional Partnership: Work closely with AI, ML, and Software Engineering teams to streamline data accessibility.
- Governance & Security: Uphold strict standards for data security, quality assurance, and compliance.
- Transparency: Maintain detailed documentation of data architecture, lineage, and metadata for full reproducibility.
Required Qualifications:
- Experience: 5+ years in data engineering, warehousing or ETL development
- Workflow Automation: Proven success using tools like Airflow, Luigi, or dbt to automate complex transformations.
- Big Data & Cloud: Expertise in big data architectures and cloud platforms (AWS, Azure, or GCP).
- Technical Stack: Mastery of SQL and Python, with proficiency in Scala or Java.
- Analytical Rigor: Strong ability to process large-scale, unstructured datasets and troubleshoot technical bottlenecks.
- Communication: Skilled at translating technical solutions for both engineering teams and non-technical stakeholders.
- Education: Bachelor's degree in Computer Science, Engineering, or a related field.