Search by job, company or skills

zorba ai

PySpark Data Engineer

zorba ai
Delhi, India
5-10 Years
Save
  • Posted a month ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Role: PySpark Data Engineer

Experience: 5–10 Years

Locations: Chennai, Bangalore, Hyderabad, Delhi, Pune

Open Positions: 10

Required Technical Skills

  • Strong experience in Python and PySpark
  • Hands-on experience with Big Data technologies
  • Expertise in Hadoop ecosystem components such as Hive and Impala
  • Strong SQL knowledge including Joins, Subqueries, and CTEs
  • Experience with Spark optimization, debugging, and Spark UI analysis
  • Good Python scripting and automation skills
  • Exposure to database technologies
  • Hands-on AWS cloud experience with:
    • EMR
    • S3
    • IAM
    • Lambda
    • SNS
    • SQS
    • Redshift
Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark
  • Process and analyze large-scale structured and unstructured datasets
  • Develop ETL/ELT workflows on Big Data platforms
  • Work on Spark performance tuning and debugging
  • Integrate AWS cloud services within data engineering solutions
  • Collaborate with cross-functional teams for data integration and analytics initiatives
  • Ensure data quality, reliability, and performance across pipelines

Must-Have Skills

  • PySpark
  • Python
  • Big Data/Hadoop ecosystem
  • Hive / Impala
  • SQL
  • AWS EMR & S3

Good-to-Have Skills

  • Scala
  • Spark UI optimization techniques
  • AWS Lambda, SNS, SQS, IAM
  • Redshift
  • Strong debugging and scripting skills

Skills: aws,pyspark,big data

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Data Engineering
Employment Type:
Full time

About Company

zorba ai

Job ID: 147202773

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 24-05-2026 05:35:17 PM
Homejobs in DelhiPySpark Data Engineer

Similar Jobs

Azure Data Engineer Gurgaon (PySpark + Databricks)

digitalxnode
Gurugram, India

Skills:

Hive, Azure Data Factory, Pyspark, Azure Data Lake, Apache Spark, Kafka, Azure Databricks, Sql, Azure Data Engineering, Azure Synapse SQL Data Warehouse

Senior/Lead Data Engineer - PySpark/Azure Databricks

Netconnect
Delhi, India

Skills:

Pyspark, Apache Spark, Automation, Data Quality, Gitlab, Databricks, Data Governance, Python, CI CD Pipelines, AI ML Workflows, LLMOps, RAG Pipelines, Vector-Space Architectures, Vector Search, SQL Optimization, metadata, Delta Lake, Spark Performance Optimization, Databricks REST APIs, Distributed Data Processing, Scalable Data Platform Architecture

Data Engineer - ( PySpark, SQL, Python, ETL & cloud )

getege edtech pvt. ltd.
Noida, India

Skills:

data engineering , Spark, Sql, Databricks, ELT, Cosmos DB, Data Modeling, Azure Data Factory, Data Lake, Hadoop, Numpy, Pandas, Etl, Python, Azure SQL Database, Synapse Analytics, Blob Storage

Data Engineer - Python & Pyspark with AWS

Staffice Global Private Limited
Gurugram

Skills:

Python, Sql, Aws, Etl