Hands on Tier 2 production experience with Cloudera :
Installing and maintenance
Enabling security requirements for CDP
Optimizing cluster performance
Working with data engineers to optimize Spark job performance
Automation - Ansible, data/analytics jobs CI/CD
Observability
Installation, configuration and maintenance of the CDP latest version of CDP 7.1.9 or CDP latest version experience with Cloudera data services 1.5.4 and 1.5.5
Trouble shooting the Spark job , Hive Jobs and Yarn jobs
CDP Containerization with data services
experience in writing automation using Shell, Terraform, Groovy and Ansible.
Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
Automating security/regulatory checks
Automated patching
Containerization - Podman, Docker, OCP ,
Container Management - Kubernetes/OpenShift
Linux OS & Networking basics
Source control (git)
Agile engineering and practices
Required Experience
At least 4 years production Hadoop experience
8+ years hands on Technology experience
Experience with large and complex global enterprises defined by high availability, broad observability, and high level of reliability.
At least 1 project experience in Data Science project/products
