Assistant Manager - Big Data Administrator.MGN Pak - Digital Data Platforms.MIT - PAKCOE

We are looking for an experienced Cloudera Administrator with 4 to 7 years of hands-on experience to manage, configure, and support our enterprise-grade Cloudera Hadoop ecosystem. The role focuses on ensuring the stability, performance, and security of Cloudera clusters while supporting data ingestion, processing, and analytics workloads. The ideal candidate will have strong expertise in Cloudera/HDP/CDP distributions, Linux system administration, and enterprise big data platforms.

Key Responsibilities

- Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters across production and non-production environments.
- Monitor cluster health, performance, and resource utilization to ensure high availability and reliability.
- Manage and support core Hadoop ecosystem components such as HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, and Atlas.
- Perform cluster upgrades, patches, and migrations with minimal downtime.
- Implement and maintain security controls using Kerberos, Ranger, and LDAP/Active Directory integration.
- Manage user access, roles, and privileges within the Cloudera ecosystem.
- Automate routine administrative tasks using Python, Shell scripting, or Ansible to improve operational efficiency.
- Troubleshoot cluster-related issues, performance bottlenecks, and job failures.
- Support backup and disaster recovery planning for Hadoop clusters to ensure data integrity and availability.
- Collaborate with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
- Generate reports on cluster usage, job performance, and capacity planning.
- Ensure compliance with data governance policies using tools like Atlas and Ranger, and support audits and compliance checks.
- Stay updated with Cloudera/CDP advancements and proactively suggest improvements in architecture and operations.

Required Qualifications

- Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent experience.
- 4 to 7 years of practical experience administering Cloudera/Hadoop ecosystems.
- Strong Linux/Unix system administration skills and proficiency in shell scripting.
- Expertise with Hadoop ecosystem components including HDFS, YARN, Hive, Spark, Impala, Kafka, and HBase.
- Experience with Cloudera Manager for monitoring, configuration, and cluster administration.
- Familiarity with security frameworks such as Kerberos, Ranger, Sentry, and LDAP/Active Directory integration.
- Proven ability in troubleshooting, log analysis, and performance tuning.
- Experience with backup, recovery, and disaster recovery strategies for big data platforms.
- Knowledge of cloud platforms such as AWS, Azure, or GCP, and cloud-based Cloudera deployments is an advantage.

Preferred Qualifications and Benefits

- Cloudera Certified Administrator for Apache Hadoop (CCAH) or equivalent certification.
- Familiarity with containerization technologies like Docker and Kubernetes for big data workloads.
- Knowledge of SQL, Python, and PySpark for debugging and optimizing data pipelines.
- Strong problem-solving and analytical skills.
- Ability to work collaboratively with cross-functional teams.
- Excellent communication and documentation skills.
- Proactive and self-motivated with a focus on continuous improvement.

This role offers the opportunity to work in a dynamic environment where you will play a key part in maintaining and enhancing critical big data infrastructure. You will collaborate closely with various teams to ensure data platform reliability, security, and performance, while continuously improving operational processes.