Senior Specialist - Data Engineering

Role Description

We are looking for an Azure Databricks Platform Administrator with 6–13 years of experience, with strong expertise in Databricks platform administration and Azure cloud services.

Platform Administration

• Administer and support Databricks workspaces across development testing and production environments
• Configure and maintain Databricks accountlevel and workspacelevel settings
• Manage clusters SQL Warehouses jobs pools policies and platform configurations
• Support platform upgrades runtime updates and feature enablement activities.
  
  

Security Access Management

• Manage user provisioning and deprovisioning through Azure ADIdentity Management systems
• Administer Workspace Admin Account Admin and Unity Catalog permissions
• Implement RBAC and leastprivilege access controls
• Conduct periodic access reviews and support audit compliance activities
• Ensure adherence to organizational security standards and governance policies
  
  

Unity Catalog Data Governance

• Manage catalogs schemas tables grants and data access permissions
• Support data governance and metadata management initiatives
• Monitor compliance with enterprise data security requirements
  
  

Operations Monitoring

• Monitor platform health performance utilization and availability
• Perform proactive capacity management and optimization
• Troubleshoot cluster job notebook and connectivity issues
• Create and maintain operational dashboards and monitoring.
  
  

Incident Problem Management

• Participate in incident response and root cause analysis
• Coordinate with cloud network security and Databricks vendor teams to resolve issues
• Drive problem management and continuous service improvement initiatives
  
  

Release Change Management

• Support platform changes upgrades and release deployments
• Execute change management procedures and documentation
• Assess operational risks associated with platform changes
  
  

Platform Enablement

• Support onboarding of new applications and projects onto Databricks
• Assist development teams with platform best practices and standards
• Create and maintain operational runbooks SOPs and technical documentation
  
  

Strong Experience With Below

• Azure Databricks or AWS Databricks
• Unity Catalog
• Azure Active Directory Identity Management
• SQL and data platform concepts
• Access management and RBAC
• Incident and change management processes monitoring tools
• Experience supporting production platforms in regulated enterprise environments
  
  

Nice To Have Certifications

• Databricks Certified Data Engineer AssociateProfessional
• Databricks Certified Platform Administrator