We are looking for a highly skilled Senior Data Engineer to play a key role in designing, building, and optimizing the organization&aposs data pipelines, ensuring reliable, scalable, and high-performing data infrastructure to support decision-making. By managing data workflows, integrating complex data sources, and maintaining data quality, this position directly enhances the company&aposs ability to generate actionable insights, improve operational efficiency, and drive strategic business outcomes.
Key Responsibilities:
- Lead the extraction of engineering data from diverse sources, structured as well as unstructured data such as PDF documents
- Ability to develop comprehensive mapping strategies between different data sets & implement robust strategies for normalizing and standardizing data
- Able to create Source to Target mapping documents along with business rules by collaborating with different stakeholders
- Collaborate with cross-functional teams to define and enforce data standards and quality
- Design, implement, and manage scalable databases to accommodate large volumes of data
- Able to Develop and maintain efficient ETL processes for seamless data flow and transformation as well as ensure data quality and integrity through effective error handling and validation
- Collaborate with domain experts, data stewards, and project teams for effective data integration
- Utilize a range of technologies, including scripting languages and data integration tools
- Able to create and maintain comprehensive documentation for data engineering processes
Requirements
- Bachelor&aposs or master&aposs degree in computer science, Data Engineering, or related field
- Proven experience as a Data Engineer, with a focus on large-scale data extraction and normalization projects
- Strong proficiency in SQL and scripting languages like Python/Java and Spark/Pyspark/Scala for data manipulation and transformation
- Experience with ETL tools such as Talend, Informatica, etc
- In-depth knowledge of Data-Warehouse Concepts, database management systems, both relational and NoSQL
- Working understanding of dealing with unstructured data such as PDF documents and data extraction and normalization techniques
- Familiarity with data modeling, schema design, and optimization techniques
- Understanding of data governance, security, and compliance standards
- Excellent problem-solving and analytical skills with a keen attention to detail
- Effective communication skills to collaborate with diverse stakeholders
- Previous experience in transportation, asset management or digital transformation and normalization engineering-related projects is required
- Familiarity with Agile methodologies for project execution