14/04/2025) Hadoop Administrator

Job Description

We are seeking an experienced Hadoop Administrator with 6-10 years of experience in managing and supporting Cloudera CDP (Hadoop, Spark, HDFS, Hive, YARN, etc.) on Unix/Linux platforms.

The ideal candidate will have a solid foundation in Unix/Linux operating systems, shell scripting, and operational procedures.

A minimum of 7 years of IT experience in Hadoop Administration is essential.

Key responsibilities include:
• Managing and supporting Cloudera CDP on Unix/Linux platforms
• Effective management of codebases and configurations
• Leading technical teams
• Vendor relationship management
• Knowledge of ITIL, including change and incident management

The successful candidate will also have:
• Proficiency in automation and system management using scripting languages such as Shell and Python
• Demonstrated continuous deployment experience in deploying big data solutions onto medium to large Hadoop clusters
• Experience working as a senior SRE engineer in a big data environment
• Ability to install, configure, and maintain Cloudera clusters
• Knowledge of networking, file system management, and security best practices
• Strong skills in Linux/Unix (RHEL 7)
• Ability to document system configurations, procedures, and changes for knowledge sharing and business continuity
• Knowledge of authentication and authorization using Kerberos, TLS, and Active Directory
• Experience with Apache Ranger

Nice to have skills include:
• Familiarity with Docker
• Experience with encryption services (HSM, Keytrustee, etc)
• Skilled in configuration management tools, with a focus on Puppet
• Experience with CI/CD tools (Jenkins, GitHub Actions or Bamboo)

Bachelor's degree in computer science, engineering, or a related field is required for this engineer-level position. Read more