Lead Big Data Administrator

Qualification

Primary Skills
• Periodic Cluster maintenance ( including applying regular patch and upgrade )
• Monitoring services and keeping cluster in healthy state
• Help team to troubleshoot and resolve cluster related issues ( e.g. Slow cluster performance,change queue capacity, add or remove LLAP Containers, MySQL Log cleanup, MySQl Instances out of sync etc )
• Able to resolve networking/Security/server issues.
• In-depth understanding of Private Cloud Base Cluster
• Familiarity with the changes in services and versions in CDP
• Understanding of strategy of moving on-prem workloads to CDP Public Cloud
• Aware of manual settings required after upgrade from CDH to CDP
• Good Knowledge of all Data Services in CDP
• Hands on experience in deploying CDH clusters and upgrade to CDP
• Familiarity with Kubernetes, Networking and Storage in Cloud
• Abillity to setup DE and DW cluster with desired capacity for each team

Roles and Responsibilities
• Onboaring Team's on CDP
• Should be able to create required Environment in any Cloud End to End
• CDP Base Cluster Setup (CDP Public Cloud)
• Work closely with engineering team and support team
• Assist team with Workload monitoring post DW and DE setup
• Setup security including IdP integration
• Getting/Creating minimum access required in Cloud Providers for different users.
• Minimize cost of CDP Public Cloud
• Register or add on-prem/PvC clusters to CDP public Cloud.
• Assigning users or groups to environment
• Setting up Ranger authorization for Data Lake
• Provisioning compute resources
• Contribute to improve the efficiency of the assignment by quality improvements & innovative suggestions
• Scan logs, errors, exception and get to the root cause of the issue
• Maintain customer loyalty through Integrity and accountability

Role

Technical Skills :

Hadoop Administrator, Cloudera, Cdp