About the role:
The BI Technical Expert is responsible for the deployment, configuration, monitoring, and maintenance of enterprise-grade data platforms including Cloudera (CDP), Confluent Kafka, Apache NiFi, RabbitMQ, and Starburst Enterprise. This role ensures the reliability, scalability, and security of data pipelines and distributed query engines supporting real-time and batch analytics across the organization.
Responsibilities:
- Manage Hadoop ecosystem components (HDFS, Hive, Impala, Spark)
- Monitor and optimize cluster performance using Cloudera Manager
- Implement security (Kerberos, Ranger) and perform upgrades
- Design and manage data flows for ingestion and transformation
- Monitor flow performance and ensure secure data movement
- Integrate with Kafka, HDFS, S3, and relational databases
- Deploy and manage RabbitMQ clusters and plugins
- Configure queues, exchanges, and user permissions
- Monitor broker health and implement HA and DR strategies
- Deploy and manage Starburst Enterprise clusters
- Configure catalogs for data sources (Hive, Iceberg, Delta Lake, RDBMS)
- Optimize distributed SQL queries and manage resource groups
- Implement access control, query auditing, and data governance policies
Required Skills & Qualifications:
- Bachelor's degree in computer science, Engineering, or related field
- 4+ years of experience in System administration
- 4+ years of experience in Data Platform Administration.
- Strong Linux administration and scripting (Bash, Python)
- Experience with distributed systems, SQL engines, and messaging platforms
- Familiarity with monitoring tools (Prometheus, Grafana, Cloudera Manager)
Preferred Certifications:
- Cloudera Certified Administrator (CCA)
- Confluent Certified Administrator
- Apache NiFi Certification
- RabbitMQ Certified Expert
- Starburst or Trino/Presto Certification
