Assistant Manager - Big Data Administrator.MGN Pak - Digital Data Platforms.MIT - PAKCOE

We are looking for a skilled Cloudera Administrator with 4 to 7 years of experience to join our team as an Assistant Manager (J+). The successful candidate will be responsible for managing, configuring, and supporting our enterprise-grade Cloudera Hadoop ecosystem. This role demands ensuring the stability, performance, and security of Cloudera clusters while supporting data ingestion, processing, and analytics workloads. The ideal professional will have strong expertise in Cloudera/HDP/CDP distributions, Linux system administration, and enterprise big data platforms.

Key Responsibilities

- Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters across production and non-production environments.
- Monitor cluster health, performance, and resource utilization to ensure high availability and reliability.
- Manage and support Hadoop ecosystem components including HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, and Atlas.
- Perform cluster upgrades, patches, and migrations with minimal downtime.
- Implement and maintain security controls using Kerberos, Ranger, and LDAP/Active Directory integration.
- Manage user access, roles, and privileges within the Cloudera ecosystem.
- Automate routine administrative tasks using Python, Shell scripting, or Ansible to improve operational efficiency.
- Troubleshoot cluster-related issues, performance bottlenecks, and job failures promptly.
- Support backup and disaster recovery planning for Hadoop clusters to ensure data integrity and availability.
- Collaborate closely with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
- Generate reports on cluster usage, job performance, and capacity planning.
- Ensure compliance with data governance policies using tools like Atlas and Ranger, and support audits and compliance checks.
- Stay current with Cloudera/CDP advancements and proactively suggest improvements in architecture and operations.

Required Qualifications

- Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.
- 4 to 7 years of hands-on experience administering Cloudera/Hadoop ecosystems.
- Strong Linux/Unix system administration skills and proficiency in shell scripting.
- In-depth knowledge of Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Impala, Kafka, and HBase.
- Experience with Cloudera Manager for monitoring, configuration, and cluster administration.
- Familiarity with security frameworks including Kerberos, Ranger, Sentry, and LDAP/Active Directory integration.
- Proven ability in troubleshooting, log analysis, and performance tuning.
- Experience with backup, recovery, and disaster recovery strategies for big data platforms.
- Understanding of cloud platforms (AWS, Azure, GCP) and cloud-based Cloudera deployments is advantageous.

Preferred Qualifications and Benefits

- Cloudera Certified Administrator for Apache Hadoop (CCAH) or equivalent certification is highly desirable.
- Knowledge of containerization technologies such as Docker and Kubernetes for big data workloads.
- Proficiency in SQL, Python, and PySpark for debugging and optimizing data pipelines.
- Strong problem-solving and analytical skills, with the ability to work collaboratively across cross-functional teams.
- Excellent communication and documentation skills, combined with a proactive and self-motivated approach focused on continuous improvement.

This role offers the opportunity to work in a dynamic environment where your expertise will directly impact the performance and reliability of critical big data infrastructure. You will be a key contributor to maintaining high availability, security, and operational excellence within our Cloudera ecosystem.