Data Engineer Databricks (IBU Consumer)
Data Engineer Databricks (IBU Consumer)
RADcube- Posted 6 days ago
- Over 50 applicants have applied
Job Description
Build and maintain scalable data pipelines on Databricks for consumer-facing IBU data products.
- Develop ETL/ELT pipelines using PySpark, Spark SQL and Delta Lake
- Implement medallion architecture (bronze/silver/gold), Unity Catalog and Workflows
- Optimize cluster performance and cost; monitor and troubleshoot jobs in production
- Must have: 4+ yrs data engineering, Databricks, PySpark, SQL, Git/CI-CD.
- Nice to have: pharma/consumer data, Databricks certification
More Info
Key Skills
About Company