Databricks Engineer

Impetus Technologies

2-6 Years

Delhi, Bengaluru, Pune

Quick Apply

Posted a month ago
Over 300 applicants have applied

Job Description

Databricks Engineers with 2-6 years of hand-on experience in Pyspark, Cloud Platform and SQL.
Proven experience in implementing data solutions on the Databricks platform withhands on experience in setting up Databricks cluster, working in Databricks modules,data pipelines for ingestingand transforming data from various sources into Databricks.
Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.

Roles & Responsibilities

Bachelors or Master's degree with 2-6 years of professional experience.
Proven experience in implementing data solutions on the Databricks platform.
Solid understanding of Databricks fundamentals and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
Configure, set up, and manage Databricks clusters, workspaces, and notebooks to ensure optimal performance, scalability, and resource allocation.
Implement data pipelines for ingesting, cleansing, and transforming data from various sources into Databricks, ensuring data quality, consistency, and reliability. Develop ETL (Extract, Transform, Load) processes as needed.
Develop, optimize, and maintain Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.
Knowledge of Performance Optimization, Monitoring and Automation would be a plus.
Understanding of data governance, compliance, and security best practices.
Strong Proficiency in Pyspark, Databricks Notebooks, SQL, Python, Scala, or Java.
Proficiency in SQL for data querying and manipulation.
Experience with data modeling, ETL processes, and data warehousing concepts.
Strong problem-solving and troubleshooting skills.
Excellent communication and collaboration skills.
Certifications in Databricks would be beneficial.

Role: Data Engineer

Industry Type: IT Services & Consulting

Department: Engineering - Software & QA

Employment Type: Full Time, Permanent

Role Category: Software Development

Education

UG: B.Tech/B.E. in Any Specialization

PG: M.Tech in Any Specialization, MCA in Any Specialization

More Info

Job Type:

Permanent Job

Industry:

Software

Role:

Software Engineer /Programmer, System Analyst /Tech Architect

Function:

Employment Type:

Full time

About Company

Impetus Technologies

Impetus designs and develops state-of-the-art products, spanning all leading-edge development platforms, for a host of fast-paced and innovative software companies. We offer product-oriented services, across the entire product development lifecycle, to our clients.
We keep very successful company-all our clients are leaders in their spaces. They range from some of the finest startups in the Silicon Valley, such as Scalix, KnowNow, Navic, Sennari, to well established players including NeuStar, 3M, LiveCapital and PeopleSoft. Leading blue-chip VCs like Sequoia, Kleiner Perkins, Redrock, and Venrock recommend us as the preferred offshore service provider for companies they are incubating.
Our sister companies, Servigistics, ClearTrail and Intellicus, and the intellectual property we create, have been phenomenally successful, setting innovative trends and establishing new markets.

Job ID: 113268497

Jobs by Skill - IT