Assistant Manager - Big Data Administrator.MGN Pak - Digital Data Platforms.MIT - PAKCOE

We are looking for an experienced Cloudera Administrator with 4 to 7 years of expertise to manage, configure, and support our enterprise-grade Cloudera Hadoop ecosystem. The role focuses on ensuring the stability, performance, and security of Cloudera clusters while supporting data ingestion, processing, and analytics workloads. The ideal candidate will have strong knowledge of Cloudera/HDP/CDP distributions, Linux system administration, and enterprise big data platforms.

Key Responsibilities

- Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters across production and non-production environments.
- Monitor cluster health, performance, and resource utilization to ensure high availability and reliability.
- Manage and support Hadoop ecosystem components including HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, and Atlas.
- Perform cluster upgrades, patches, and migrations with minimal downtime.
- Implement and maintain security controls using Kerberos, Ranger, and LDAP/Active Directory integration.
- Manage user access, roles, and privileges within the Cloudera ecosystem.
- Automate routine administrative tasks using Python, Shell scripting, or Ansible to improve operational efficiency.
- Troubleshoot cluster-related issues, performance bottlenecks, and job failures.
- Support backup and disaster recovery planning for Hadoop clusters.
- Collaborate with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
- Generate reports on cluster usage, job performance, and capacity planning.
- Ensure compliance with data governance policies using tools like Atlas and Ranger, supporting audits and compliance checks.
- Stay current with Cloudera/CDP advancements and proactively suggest improvements in architecture and operations.

Required Qualifications

- Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent experience.
- 4 to 7 years of hands-on experience administering Cloudera/Hadoop ecosystems.
- Strong Linux/Unix system administration skills, including shell scripting.
- Expertise in Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Impala, Kafka, and HBase.
- Proficient in using Cloudera Manager for monitoring, configuration, and cluster administration.
- Familiarity with security frameworks including Kerberos, Ranger, Sentry, and LDAP/Active Directory integration.
- Skilled in troubleshooting, log analysis, and performance tuning of big data platforms.
- Experience with backup, recovery, and disaster recovery strategies for Hadoop clusters.
- Knowledge of cloud platforms (AWS, Azure, GCP) and cloud-based Cloudera deployments is advantageous.

Preferred Qualifications and Benefits

- Cloudera Certified Administrator for Apache Hadoop (CCAH) or equivalent certification.
- Experience with containerization technologies such as Docker and Kubernetes for big data workloads.
- Working knowledge of SQL, Python, and PySpark for debugging and optimizing data pipelines.
- Strong problem-solving and analytical skills with the ability to work collaboratively across cross-functional teams.
- Excellent communication and documentation skills, with a proactive and self-motivated approach focused on continuous improvement.

This role offers the opportunity to work in a dynamic environment supporting critical big data infrastructure, with a focus on innovation, security, and operational excellence.