Senior Data Engineer

About Our Client

Our client is supporting a government-related technology project in Singapore, focused on modernising data infrastructure and enhancing large-scale data processing capabilities.

This is a long-term contract opportunity (approximately 29 months) involving the development and modernisation of enterprise data pipelines, statistical data processing systems, and engineering frameworks.

The successful candidate will work closely with technical teams, data analysts, and business stakeholders to deliver scalable, reliable, and production-ready data solutions.

About the Role

We are looking for an experienced Data Engineer with strong Python and SQL expertise to design, develop, and optimise large-scale data pipelines and processing workflows.

The role involves building reliable ETL pipelines, modernising legacy data processing systems, and implementing engineering best practices to support complex statistical and business operations.

Beyond hands-on development, you will also provide technical guidance on solution architecture, code quality, and engineering standards, working closely with other engineers and stakeholders to deliver robust data solutions.

Key Responsibilities

Data Engineering & Pipeline Development

• Design, develop, and maintain scalable ETL pipelines and data processing workflows.
• Build and optimise batch and real-time data pipelines, ensuring reliability, performance, and data quality.
• Develop robust data transformation and integration solutions using Python and SQL.
• Design and optimise database schemas, data models, and storage structures for large datasets.
• Implement pipeline monitoring, error handling, recovery mechanisms, and performance optimisation.

System Modernisation & Engineering Excellence

• Modernise legacy data processing systems while preserving existing business logic and ensuring data accuracy.
• Develop reusable engineering components, frameworks, and utilities to improve maintainability and efficiency.
• Implement automated testing, CI/CD pipelines, and deployment workflows across Development, UAT, and Production environments.
• Establish and maintain version control, code review, and engineering best practices using Git/GitLab.
• Troubleshoot production issues, investigate root causes, and implement long-term improvements.

Technical Leadership & Collaboration

• Provide technical guidance on system architecture, solution design, and implementation approaches.
• Conduct code reviews and mentor other data engineers to maintain high engineering standards.
• Collaborate with analysts, business users, and technical stakeholders to translate business requirements into scalable technical solutions.
• Identify technical risks, recommend improvements, and contribute to engineering decisions.

Requirements

Must-Have Qualifications

• 5–8 years of experience in Data Engineering, Data Platform Development, or related Software Engineering roles.
• Strong hands-on proficiency in Python and SQL, including complex data transformations, query optimisation, and data quality validation.
• Solid experience designing and building ETL pipelines, batch processing systems, and data integration workflows.
• Strong understanding of data pipeline architecture, database design, and performance optimisation.
• Experience working with Linux/Unix environments, shell scripting, and command-line tools.
• Good software engineering fundamentals, including modular design, exception handling, logging, automated testing, and documentation.
• Hands-on experience with Git/GitLab, code reviews, and CI/CD pipelines.
• Experience in technical solution design, system migration, or legacy modernisation projects.
• Ability to provide technical guidance, review code, and contribute to engineering best practices.
• Strong problem-solving and communication skills.

Nice to Have

• Experience with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with data orchestration tools such as Apache Airflow or similar workflow scheduling platforms.
• Experience working with large-scale statistical datasets or complex data processing systems.
• Previous experience in government, public sector, or enterprise-scale technology projects.
• Experience leading technical initiatives or mentoring junior engineers.

Why Join This Project

• Long-Term Opportunity: Approximately 29-month contract supporting a government-related technology project in Singapore.
• Meaningful Technical Challenges: Work on large-scale data infrastructure, complex processing workflows, and system modernisation.
• Technical Ownership: Contribute to architecture decisions, engineering standards, and technical improvements.
• Collaborative Environment: Work alongside experienced engineers, analysts, and business stakeholders.

Interested

If you have a strong background in Python, SQL, and data engineering, and enjoy building reliable, scalable data solutions, we'd love to hear from you.

Apply now or reach out to learn more about this opportunity.

AIM Global Talent Pte. Ltd. | EA Licence No. 25C3207