Senior Data Engineer

Years Of Experience: 5 - 8 Years

Role Overview: As a Senior Data Engineer you will be working in end to end development of scalable Big Data pipelines and Data streams and manage various data related objectives such as system configuration and integration on multiple platforms

On a typical day you will:

• As a Data Engineer you will be working with one of the largest and most complex warehouse environments
• Coordinate with key stakeholders and ensure effective design, development, validation in line with the stakeholder needs and architectural requirements
• End to end development of scalable Big Data pipelines and Data streams
• Manage various data related objectives such as system configuration and integration on multiple platforms
• Develop key metrics for tests on data and ensure integrity of same on data architecture
• Adhere to proper documentation based on each of the development activities
• Work with huge data sets and exhibit problem solving, analytical and communication abilities
• Will be working in a self-directed environment, take up responsibilities and drive them to completion

What you will Need to be Successful:

• Problem solving, analytical and good communication abilities
• Years of development experience with Azure Cloud and Big Data Analytic solutions
• Hands on experience in Azure - Data Factory, Data Lake store/Blob storage, SQL DB
• Experience in creating Big data Pipelines with Azure components
• Good programming skills in Java, Scala or Python
• SQL experience writing stored procedures, tuning indexes and troubleshooting performance bottlenecks
• Advanced experience with Data Warehousing concepts and standards
• Experience with ETL processing or ETL toolset
• Data Management concepts and standards (SQL Server, Oracle, Cloud, Hadoop, etc.)
• Experience with Big Data Solutions. Hive, Spark or other frameworks
• Experience across cloud implementations and Solutions specially Microsoft Azure
• Exposure to large databases, BI applications, data quality and performance tuning.
• Practical knowledge of Linux or Unix, a plus
• Experience in Snowflake (cloud data warehouse), a plus
• Experience with MS Dynamics data integration and development, a plus
• Experience with Oracle - JDE ERP, a plus

Role: Data Engineer

Industry Type: Financial Services

Department: Data Science & Analytics

Employment Type: Full Time, Permanent

Role Category: Data Science & Machine Learning

Education

UG: Any Graduate

PG: Any Postgraduate