Lead Data Engineer

How You'll Help Us Keep Climbing (Overview & Key Responsibilities)

Data Engineering & Platform Development

• Design, develop, and maintain scalable data pipelines using AWS serverless technologies including Amazon S3, AWS Lambda, AWS Glue, Redshift Serverless, Step Functions, and EventBridge.
• Build robust ETL/ELT frameworks to ingest, transform, validate, and publish data from multiple enterprise sources.
• Develop reusable data ingestion and transformation components to accelerate onboarding of new datasets.
• Implement CDC (Change Data Capture), incremental processing, and event-driven architectures.
• Optimise Redshift workloads, SQL processing, storage strategies, and query performance.
• Establish data quality, monitoring, reconciliation, and alerting frameworks.
  
  

Full Stack Application Development

• Design and develop self-service applications and internal data products.
• Build RESTful APIs and backend services using Python and AWS Lambda.
• Develop responsive web applications using modern front-end frameworks such as React, Angular, or Vue.
• Integrate applications with AWS services, authentication mechanisms, and enterprise platforms.
• Create intuitive user experiences enabling business users to access, analyse, and manage data without technical expertise.
  
  

Architecture & Technical Leadership

• Define end-to-end solution architecture for data and analytics platforms.
• Lead technical design reviews, code reviews, and architecture governance activities.
• Drive adoption of cloud-native and serverless design patterns.
• Establish engineering standards, CI/CD automation, security controls, and operational best practices.
• Mentor and coach engineers on software engineering, data engineering, and cloud architecture.
  
  

Operations & Reliability

• Ensure platform availability, scalability, performance, and resiliency.
• Implement proactive monitoring using CloudWatch, logging, dashboards, and automated alerting.
• Perform root cause analysis and resolve production issues.
• Define and manage SLA, data freshness, and reliability metrics.
• Continuously improve platform performance, security, and cost efficiency.
  
  

Stakeholder Engagement

• Collaborate with business stakeholders, product owners, architects, and engineering teams.
• Translate business problems into scalable technical solutions.
• Communicate technical concepts effectively to both technical and non-technical audiences.
• Drive innovation by identifying opportunities for automation, self-service, and AI-driven capabilities.
  
  

What You Need To Succeed (Minimum Qualifications)

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
• 7+ years of experience in Data Engineering, Software Engineering, or Cloud Platform development.
• 3+ years of experience leading technical teams or solution delivery initiatives.
• Strong experience with AWS serverless technologies: Amazon S3, AWS Lambda, AWS Glue, Amazon Redshift / Redshift Serverless, Step Functions, EventBridge, CloudWatch, and IAM.
• Advanced proficiency in Python, PySpark, SQL, and data modelling.
• Experience building REST APIs and microservices.
• Experience with modern front-end frameworks such as React, Angular, Vue, or similar.
• Knowledge of DevOps and CI/CD practices.
• Experience implementing data quality, governance, and monitoring frameworks.
  
  

Behavioral Competencies

• Lead initiatives with high accountability, create a collaborative environment with a solution-based approach.
• Serve as a trusted advisor and mentor for the team offering technical advice.
• Ability to communicate with precision, engaging team and stakeholders to build trust and reliable working relationships across cross-functional teams and geographies enabling organizational alignment.
• Ability to set priorities with the team by understanding interdependence, inspiring team members with consistent focus, quality output, and timelines.
• Constantly keep oneself updated on current technology & trends to drive innovative decisions through piloting forward-thinking approaches to complex problems in one's own area of work.
• Inquisitive to understand customer priorities and business challenges while creating value for technical solutions.
  
  

What Will Give You a Competitive Edge (Preferred Qualifications)

• Experience with Apache Iceberg, Delta Lake, or modern table formats.
• Experience with Amazon Bedrock and Generative AI solutions.
• Experience building self-service analytics and data products.
• AWS certification such as Solutions Architect, Data Engineer, or Developer.
• Experience in Finance, Revenue Management, or Enterprise Analytics domains.
  
  

About The Company

What started as a humble, little aerial crop-dusting operation called Huff Daland Dusters in 1924 has now grown into the U.S. global airline leader in safety, innovation, reliability, and customer experience. Headquartered in Atlanta, Georgia, Delta Air Lines is known for its operational excellence and award-winning customer service.

Powered by our employees worldwide, Delta has led the airline industry in operational excellence for a decade while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good.

In 2026, Delta Air Lines continued to earn global recognition for its performance, culture and operational excellence. Delta was named to Glassdoor's 2026 Top 100 Best Places to Work list for the ninth time, standing as the only airline recognized. Delta also secured the 11th spot on Fortune's World's Most Admired Companies list, marking its 13th consecutive year earning this distinction. Delta was also recognized by Cirium as the top on-time airline in North America for the fifth consecutive year, underscoring its unwavering commitment to reliability and customer experience.

About The Delta Technology Hub (DTH), Bangalore

The DTH is one of Delta Air Lines investments in world-class business capabilities and technology aimed at transforming how Delta Air Lines operates and provides world-class travel experiences to its customers through innovation and cutting-edge methodologies. By continuously reimagining processes and driving technology-led transformation, the Delta Technology Hub plays a pivotal role in Scripting The Future Of Aviation. The organization is certified by the Great Place to Work Institute (India). The Delta Technology Hub was a finalist for the iVolunteer Awards 2024/2025 in the Leader in Employee Volunteering category. This nomination highlights our remarkable volunteering initiatives and the outstanding practices we implement to encourage and support our employee volunteering program.

For more information, please visit www.deltatechhub.com

Why join

Technology is a key enabler of the differentiated services that Delta provides. At the DTH, you get the opportunity to work on projects with a significant impact on business outcomes and customer experience.

Deepen your knowledge by taking part in multifaceted learning and development programs –exposure to extensive internal and partner repositories, institutional affiliations, and industry SIG (Special Interest Groups) partnerships.

Immerse yourself in an employee-centric culture.

Develop deep and broad business acumen on airline operations while retaining focus on cutting-edge technology driven solutions.

Avail a full range of benefits that support you and your family: Medical Insurance, Transportation to and from the DTH office, Complementary Cafeteria Meals, Special Travel opportunities and Travel Privileges, Car Lease Program, Paid time off, Parental Benefits and National Pension Scheme.