Data Engineer (Azure) -
Data Processing on Azure: Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Migration Service, Data Pipeline.
- Azure skills highly preferred, including provisioning, Configuring, and Developing solutions in ADL, ADF, ADW etc.
- In-depth understanding of database structure principles.
- Experience in DevOps, azure DevOps , Jenkins , airflow , azure monitor good to have.
- Hands-on experience using MS SQL Server, Oracle or similar RDBMS platform.
- Distributed Data Processing of big data batch or streaming pipelines (kafka or similar)
- Familiarity with data visualization tools (e.g. Power BI, Tableau etc.)
- Data Modelling , Data structure & strong analytics skills.
- Problem-solving attitude
- Highly selfmotivated, selfdirected, and attentive to detail
- Ability to effectively prioritize and execute tasks.
Additional Information
- We would like to see a blend of the following skills, not all of these are required, however Databricks and Spark are highly desirable:
- Azure SQL Data Warehouse
- Azure Data Factory
- Azure Data Lake
- Azure Analysis Services
- Databricks/Spark
- Python
- Data Modelling