Senior Specialist - Data Engineering

Job Description

As an integral member of our delivery team, the Senior Specialist - Data Engineering is responsible for the design, development, implementation, management and support of mission critical enterprise BI reporting and Extract, Transform, Load (ETL) processes and environments. You will drive the adoption of the Analytics and Reporting experience by proto typing and showcasing the dashboards to collect additional feedback and build additional requirements in iterative manner. Working with business and cross-functional teams, you will be required to gather, document, and approve business requirements for data analytics reporting projects, as well as robust data engineering capabilities to build pipelines and report via visualization tools. Using your skills and experience as a Senior Specialist - Data Engineering, you will design, develop and implement ETL processes to transform structured, unstructured and disparate source data into the target data store(s)/ data warehouse(s) / data mart(s).

Strategic

RESPONSIBILITIES

• Support the development of data strategy and internal processes of the organization.
• Drive business to self-enable on the self-service analytics and provide enough support to upskill.
• Enable a data-driven strategy by recommending the best way to organize, analyse, and present data.
• Evaluate existing data and analytics systems and support planning of Data Analytics and Al roadmap.
• Build data community among the business and lead them deliver business value on data and embrace data as strategic asset.
  
  

Operational

• Design and develop scalable and robust data pipelines for ingesting, processing, and transforming large volumes of data from various sources.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into technical specifications and data models.
• Optimize and tune data pipelines for performance, reliability, and scalability.
• Implement data quality checks, validation rules, and monitoring systems to ensure data integrity and accuracy.
• Design and maintain data warehouses, data lakes, and other data storage systems.
• Develop and maintain data processing frameworks and tools to facilitate efficient data analysis and reporting.
• Expertise in data modelling using Star/Snowflake Schema Design, Data Marts, Relational and Dimensional Data Modelling, Fact and Dimensional tables, Physical and logical data modelling.
• Manage the business analytics portfolio for the respective business which you are going to lead.
• Business analysis to gather required needs on overall analytic needs.
• Translate business requirements into specifications that will be used to drive data store/ data warehouse/ data mart design and configuration.
• Proven track record in administering, developing and implementing Data Warehousing using Alteryx and Business Intelligence (BI) applications using Power BI/Tableau/Business Objects.
• Cloud knowledge on AWS, Azure or Google platform for data warehouse.
• Transition developed Bl systems to the Operations & Support team.
• Provide support as required to ensure the availability and performance of enterprise data and BI environments for both external and internal users.
• Must be able to perform duties with moderate to low supervision.
• Ability to manage multiple priorities and assess and adjust quickly to changing priorities.
• Stay up to date with the latest trends, technologies, and best practices in data engineering and recommend innovative solutions to improve data infrastructure and processes.
  
  

People Management

• Provide technical assistance and cross training to other team members.
• Develop team in line with target competencies.
• Motivate team members to maintain excellence in service delivery and have opportunities for professional development.
• Requires leadership qualities to mentor junior members of the team.
• Excellent interpersonal (verbal and written) communication skills are required to support working in project environments that includes internal, external and customer teams.
  
  

Product/Process Improvement

• Ensure proper configuration management and change controls are implemented for your sphere of influence.
• Design and implement technology best practices, guidelines and repeatable processes.
• Strong analytical, conceptual and problem-solving abilities.
  
  

Qualifications

Education & Certifications:

• PREFERRED : Desired if certified in Data warehousing, ETL, Analytics and Reporting Solutions.
• MINIMUM : Bachelors or master's degree in computer science.
  
  

Knowledge & Skill

• Working with users in a requirements analysis role.
• Hands on experience with Python for Data engineering.
• Knowledge on using Airflow.
• Hands on experience of working with multiple data sources and APIs.
• Good understanding of Algorithms and basic statistics.
• Extensive use of SQL and RDBMS systems (DB2, Oracle, SQL Server, etc.).
• Proficiency with Data wrangling, Data visualization, Analytics and Reporting.
• Expertise in administering, developing and implementing Data Warehousing using Alteryx and Business Intelligence (BI) applications using Power BI/Tableau/Business Objects.
• Strong experience in Query Languages like PL/SQL, SQL Server, Spark SQL, T-SQL.
  
  

Experience

• MINIMUM : 8 to 11 years experience implementing Advanced Analytics, data engineering and Reporting Solution.