Lead Data Engineer

About the Role

The Data Platform team at Chargebee builds and maintains scalable data systems that power internal analytics, business intelligence, and customer-facing data featur

es.As a Lead Data Engineer, you will play a key role in shaping the architecture, scalability, and reliability of Chargebee's data platform. You will lead the design and development of large-scale data systems, mentor engineers on the team, and drive best practices across data engineering workflo

ws.You will work closely with product engineers, analysts, platform teams, and leadership to ensure that data is ingested, processed, and made available efficiently for analytics and product use cases. This role involves designing robust data pipelines, optimizing distributed data processing systems, and guiding the evolution of the data platform to support Chargebee's growing data need

s.The team operates in a fast-paced and collaborative environment, building reliable and scalable infrastructure that powers data-driven decision making across the compa

ny

What You Will Wor

k On

As a Lead Data Engineer, you will lead the development and evolution of Chargebee's data platform. This includes designing scalable data architectures, building robust ingestion and processing pipelines, and ensuring data systems operate reliably

at scale.You will also guide the technical direction of the platform, mentor engineers, and collaborate across teams to enable efficient and scalable data work

flows.
The role provides expos

• ure to:
  Large-scale data ingestion and processing p
• ipelinesStreaming and event-driven archi
• tecturesDistributed data processing fr
• ameworksCloud-based data infras
• tructureBuilding and maintaining data lake and data warehouse archi
• tecture.Designing scalable data platforms powering both internal analytics and customer-facing
• productsLeading architectural decisions and platform evolution for large-scale data

systems
Key Respons

• ibilities
  Design and architect scalable, reliable data ingestion and processing pipelines across the data
• platform.Lead the development and optimization of ETL/ELT workflows to support high-volume and scalable data p
• rocessing.Build and maintain distributed data processing systems using frameworks such as Apa
• che Spark.Design and implement event-driven data architectures using streaming systems such
• as Kafka.Define data modeling standards and transformation strategies to support analytics and product
• use cases.Ensure high standards of data reliability, integrity, scalability, and performance across the data
• platform.Lead troubleshooting and debugging efforts for complex production data pipelines and distribute
• d systems.Collaborate with data analysts, product teams, and engineering teams to design scalable data
• solutions.Mentor and guide data engineers, providing technical leadership and promoting engineering best
• practices.Lead design discussions, architecture reviews, and technical decision-making within the data plat
• form team.Participate in and drive code reviews, technical design reviews, and agile development p
• rocesses. Document architecture decisions, platform standards, and data engineering

workflows.
Minimum Qua

• lificationsBachelor's degree in Computer Science, Mathematics, Engineering, or a related technical field, or equivalent practical
• experience.6+ years of experience building and maintaining large-scale data processing systems and
• pipelines.Strong experience designing and operating production-grade distributed da
• ta systems.Hands-on experience with distributed computing frameworks such as Ap
• ache Spark.Strong proficiency in SQL and dat
• a modeling.Proficiency in at least one programming language such as Java, Python
• , or Scala.Strong understanding of data structures, distributed systems, and data platform ar
• chitecture.Experience working with relational databases such as PostgreSQL, MySQL, or simil
• ar systems.Experience designing and building ETL/ELT data pipeline
• s at scale.Experience working with Git workflows in collaborative development en
• vironments.Experience working in an Agile development e

nvironment.
Good-to-Have Qu

• alifications
  Experience working within the A
• WS ecosystem.Experience building and operating large-scale Apache Spark-based da
• ta pipelines.Experience with streaming systems such as Kafka or similar event-driv
• en platforms.Strong understanding of data lake and data warehouse
• architecturesExperience designing scalable cloud-native da
• ta platforms.Knowledge or prior experience with open table formats such as Delta Lake, Apache Iceberg, or
• Apache Hudi.Strong technical leadership, communication, and problem-so
• lving skills.Ability to investigate and debug issues across large-scale distrib