Assistant Manager - Big Data Administrator.MGN Pak - Digital Data Platforms.MIT - PAKCOE

We are looking for a skilled Cloudera Administrator with 4 to 7 years of experience to manage and support our enterprise-grade Cloudera Hadoop ecosystem. The successful candidate will be responsible for ensuring the stability, performance, and security of Cloudera clusters while supporting data ingestion, processing, and analytics workloads. This role requires strong expertise in Cloudera/HDP/CDP distributions, Linux system administration, and big data platforms in an enterprise environment.

Key Responsibilities

- Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters across production and non-production environments.
- Monitor cluster health, performance, and resource utilization to ensure high availability and reliability.
- Manage and support core Hadoop ecosystem components including HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, and Atlas.
- Perform cluster upgrades, patches, and migrations with minimal downtime.
- Implement and maintain security controls using Kerberos, Ranger, and LDAP/Active Directory integration.
- Manage user access, roles, and privileges throughout the Cloudera ecosystem.
- Automate routine administrative tasks using Python, Shell scripting, or Ansible to improve operational efficiency.
- Troubleshoot cluster-related issues, performance bottlenecks, and job failures.
- Support backup and disaster recovery planning to ensure data integrity and availability.
- Collaborate with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
- Generate reports on cluster usage, job performance, and capacity planning.
- Ensure compliance with data governance policies using tools like Atlas and Ranger, supporting audits and governance requirements.
- Continuously update knowledge on Cloudera/CDP advancements and recommend improvements to architecture and operations.

Required Qualifications

- Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent experience.
- 4 to 7 years of hands-on experience administering Cloudera/Hadoop ecosystems.
- Strong Linux/Unix system administration skills, including shell scripting.
- Expertise with Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Impala, Kafka, and HBase.
- Proficient in using Cloudera Manager for monitoring, configuration, and cluster administration.
- Experience with security frameworks including Kerberos, Ranger, Sentry, and LDAP/AD integration.
- Skilled in troubleshooting, log analysis, and performance tuning of big data platforms.
- Knowledge of backup, recovery, and disaster recovery strategies for Hadoop clusters.
- Familiarity with cloud platforms (AWS, Azure, GCP) and cloud-based Cloudera deployments is advantageous.

Preferred Qualifications and Benefits

- Cloudera Certified Administrator for Apache Hadoop (CCAH) or equivalent certification.
- Experience with containerization technologies such as Docker and Kubernetes for big data workloads.
- Working knowledge of SQL, Python, and PySpark to assist in debugging data pipelines.
- Strong problem-solving and analytical abilities.
- Excellent communication and documentation skills, with the ability to work collaboratively across teams.
- Proactive, self-motivated, and committed to continuous learning and improvement.

This role offers the opportunity to work in a dynamic environment where you will play a critical part in maintaining and enhancing a robust big data infrastructure. If you have a passion for big data technologies and a proven track record in Cloudera administration, we encourage you to apply.