Search by job, company or skills

Data Engineer

Data Engineer

techcarrot
5-7 Years
Not Disclosed
  • Posted 6 hours ago
  • Be among the first 10 applicants

Job Description

Job Description

You will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.

Responsibilities

  • Collect progress updates from Squad on a regular basis.
  • Consolidate updates into weekly project status reports and share with the Squad Leads for their review.
  • You participate in early state design and feature definition activities.
  • Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
  • Responsible for creating reusable and scalable data pipelines.
  • You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  • You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
  • Develop and manage L3-level project plans with sufficient details for tasks, milestones, and dependencies

Requirements

Skills:

  • Knowledge and experience with relational and non-relational databases.
  • Strong analytic skills related to working with structured and unstructured datasets.
  • Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  • Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  • Strong proficiency in building JIRA dashboards based on tasks.
  • Strong experience in Project Management will be considered as an additional advantage.
  • Azure DevOps experience to deploy the data pipelines through CI/CD.

Qualifications

  • Minimum 5-7 years of practical experience.
  • Bachelor's degree in computer science, software engineering, information technology, or a related field.
  • Azure cloud stack in-production experience.

Job Details

Role Level: Mid-Level Work Type: Full-Time Country: United Arab Emirates City: Dubai Company Website: https://techcarrot.ae/ Job Function: Data Science & AI Company Industry/

Sector: IT Services and IT Consulting

What We Offer

About The Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at [Confidential Information].

More Info

Job Type:
Industry:
Employment Type:

Key Skills

relational and non-relational databases

JIRA dashboards

CI/CD

ETL pipelines

About Company

Similar Jobs

6-12 yrs
United Arab Emirates, Dubai
Skills:
Data Security, Hadoop, Data Modelling, PowerShell, Scala, Apache Spark, Data Warehousing, Azure Databricks, Sql, Azure Data Factory, Powerbi, Azure Synapse Analytics, Azure Data Lake, Qlik, Data Governance, Data Integration, Python, Azure DevOps, data quality management, Azure SQL Database, Azure Data Lake Storage, ETL pipelines
3-5 yrs
United Arab Emirates, Dubai
Skills:
Azure Data Factory, Pyspark, Databricks, Cloud native tools
2-8 yrs
United Arab Emirates, Dubai
Skills:
BigQuery, Gcp, Kafka, Sql, Python, Pub Sub, Airflow, dbt, Dataform
5-7 yrs
United Arab Emirates, Dubai
Skills:
Dts, Python, Sql, Hologres, MaxCompute, Alibaba Cloud DataWorks, Lakehouse architectures, AI generation tools, Lark, AI coding assistants
4-6 yrs
United Arab Emirates, Dubai
Skills:
snowflake , BigQuery, Hadoop, Power Bi, Scala, Tableau, Redshift, Sql, Gcp, Spark, Azure, Python, AWS, Airflow, Data Lakes, dbt