Job Summary
We are looking for a Senior Data Engineer / Senior Specialist with 7–11 years of experience in Python and Google Cloud Platform (GCP). The ideal candidate should have hands-on experience in developing and optimizing data pipelines, building scalable data solutions using GCP services, and delivering data analytics solutions. The role requires expertise in Python, DataProc, Dataflow, Data Fusion, Dataform, DMS, SQL, and ETL/ELT pipelines, along with the ability to collaborate with cross-functional teams and mentor junior engineers.
Job Description
- Develop, maintain, and optimize data pipelines using Python for data analytics.
- Design and implement scalable data solutions using Google Cloud Platform (GCP).
- Utilize GCP services such as DataProc, Database Migration Service (DMS), Dataform, Data Fusion, and Dataflow.
- Analyze large datasets to generate actionable insights and support data-driven decision-making.
- Collaborate with cross-functional teams to integrate data analytics solutions into business processes.
- Ensure data quality, integrity, security, and governance throughout the data lifecycle.
- Stay updated with the latest advancements in Python and GCP Data Analytics technologies.
Roles & Responsibilities
- Lead the design and implementation of data analytics solutions using Python and GCP.
- Architect, develop, and manage end-to-end data workflows using DataProc, DMS, Dataform, Data Fusion, and Dataflow.
- Build and optimize scalable ETL/ELT data pipelines.
- Troubleshoot and resolve performance bottlenecks in data processing pipelines.
- Collaborate with business stakeholders to gather requirements and deliver technical solutions.
- Mentor junior team members on Python programming and GCP data services.
- Drive continuous improvements to enhance data processing efficiency, scalability, and reliability.
