Search by job, company or skills

zorba ai

PySpark Data Engineer

zorba ai
Bengaluru, India
5-10 Years
Save
  • Posted a month ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Role: PySpark Data Engineer

Experience: 5–10 Years

Locations: Chennai, Bangalore, Hyderabad, Delhi, Pune

Open Positions: 10

Required Technical Skills

  • Strong experience in Python and PySpark
  • Hands-on experience with Big Data technologies
  • Expertise in Hadoop ecosystem components such as Hive and Impala
  • Strong SQL knowledge including Joins, Subqueries, and CTEs
  • Experience with Spark optimization, debugging, and Spark UI analysis
  • Good Python scripting and automation skills
  • Exposure to database technologies
  • Hands-on AWS cloud experience with:
    • EMR
    • S3
    • IAM
    • Lambda
    • SNS
    • SQS
    • Redshift
Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark
  • Process and analyze large-scale structured and unstructured datasets
  • Develop ETL/ELT workflows on Big Data platforms
  • Work on Spark performance tuning and debugging
  • Integrate AWS cloud services within data engineering solutions
  • Collaborate with cross-functional teams for data integration and analytics initiatives
  • Ensure data quality, reliability, and performance across pipelines

Must-Have Skills

  • PySpark
  • Python
  • Big Data/Hadoop ecosystem
  • Hive / Impala
  • SQL
  • AWS EMR & S3

Good-to-Have Skills

  • Scala
  • Spark UI optimization techniques
  • AWS Lambda, SNS, SQS, IAM
  • Redshift
  • Strong debugging and scripting skills

Skills: aws,pyspark,big data

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Data Engineering
Employment Type:
Full time

About Company

zorba ai

Job ID: 147198925

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 24-05-2026 05:35:17 PM
Homejobs in Bengaluru / BangalorePySpark Data Engineer

Similar Jobs

PySpark Data Engineer | Big Data & Analytics

Synechron
S
Bengaluru, India

Skills:

Cassandra, Pyspark, Apache Airflow, Nosql, Numpy, Docker, Azure Data Lake, Python, AWS, Spark SQL, Pycharm, Hadoop, Sql, Jenkins, Hive, Pandas, Azure, Kubernetes, DataFrames, GitHub Actions, Spark MLlib, HDFS, Jupyter, VSCode

Data Engineer (PySpark)

Clover Infotech
Bengaluru

Skills:

Pyspark, Scripting, Big Data Technologies, Data Warehousing, Cloudera Data Platform

Python, Pyspark, GCP Data Engineer

Zensar Technologies
Bengaluru, India

Skills:

Pyspark, Sql, Apache Spark, DataFlow, BigQuery, MySQL, Nosql, Python, Terraform, Docker, Git, PostgreSQL, Cloud DataProc, Cloud Functions

Big Data Engineer - Python / PySpark

Qcentrio
Q
Bengaluru

Skills:

AWS, Python, Sql, Github, Aws Cloud, Airflow

Data Engineer Data-AWS ,Pyspark , Advanced SQL, AWS Glue , Redshift ,

zorba ai
Bengaluru, India

Skills:

Amazon Redshift, Pyspark, Amazon S3, AWS Glue, Advanced Sql, AWS