Search by job, company or skills

Persistent

Sr Data Engineer

Persistent
Ahmedabad, Bengaluru, Pune
10-15 Years
Save
  • Posted 21 days ago
  • Over 50 applicants
Quick Apply

Job Description

What You'll Do:

  • Design and Develop: Analytics workloads using Apache Spark and Scala for big data processing.
  • Create and Optimize: Data transformation pipelines using Spark or Apache Flink.
  • Migrate Workloads: From cloud platforms to open-source Apache Spark infrastructure on Kubernetes.
  • Implement Optimization: Performance techniques for large-scale data processing

Expertise You'll Bring:

  • Scala Programming: Focus on functional programming paradigm.
  • Apache Spark: Extensive experience with core concepts and APIs, including:
  • Spark SQL and DataFrame APIs
  • Spark Structured Streaming
  • Spark MLlib for analytics
  • Distributed Computing: Strong understanding of big data processing frameworks.
  • Data Modeling: Expertise in optimization techniques for large-scale datasets.
  • Performance Tuning: Proficiency in optimizing Spark jobs.
  • Lakehouse Storage: Good understanding of technologies like Delta Lake and Apache Iceberg

More Info

Job Type:
Permanent Job
Industry:
Information Technology
Role:
Software Engineer/Programmer
Function:
IT
Employment Type:
Full time

About Company

Persistent

We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.

Job ID: 107757673

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 27-05-2026 09:32:01 AM
Homejobs in AhmedabadSr Data Engineer

Similar Jobs

Sr. Data Engineer

Eaton
Pune, India

Skills:

snowflake , Sql, Data Quality, Python, Github, Data Governance, Data Observability, DataOps, GenAI

Sr Data Engineer

Juniper Networks
Bengaluru

Skills:

Python, Sql, Aws

Sr. Data Engineer\/Modeler

Varite India Private Limited
V
Pune, India

Skills:

snowflake , Azure, SSIS, Sql Queries, Data Visualization, Agile Methodologies, Azure Data Lake, Python, Waterfall, Informatica, Data Structures, Azure Data Factory, Data Modeling, Databases, DataBricks, master data management solutions, Kafka Streaming, data cataloging solutions, Azure SQL server, Project Management Collaboration tools, Debezium, Dimensional Models, manufacturing experience, data quality management solutions

Sr. Data Engineer- BLR

cortex consultants llc
Bengaluru, India

Skills:

T-sql, Python, Azure Data Factory, Pyspark, Azure DevOps, Git integration, CI CD, Star Schema modeling, Fabric Pipelines, Microsoft Fabric, Delta Lake

Sr. Data Engineer

Krish Technolabs
Ahmedabad, India

Skills:

snowflake , Spark, Sql, BigQuery, AWS, Java, Python, Azure, Gcp, Scala, Kafka, Redshift