Data Engineer

7-9 Years

Early Applicant

Job Description

Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
Required to participate in early state design and feature definition activities.
Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
Responsible for creating reusable and scalable data pipelines
Act as a team-player while collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements

Advanced working knowledge and experience with relational and non-relational databases
Experience building and optimizing Big Data pipelines, architectures, and data sets
Strong analytic skills related to working with unstructured datasets
Expertise in Azure Data factory, Databricks, EventHub, Python, PySpark ,Azure Synapse and SQL.
Azure DevOps experience mandatory to deploy the data objects.
7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience.
Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
Automotive domain experience is a must.
Knowledge/Experience with Azure cloud stack.
Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage.
Certification on Azure platform toolset will be considered as added advantage
Bachelor's degree in Computers or allied field of study.