Assistant Manager - Big Data Administrator - Cloudera (Mashreq Global Network Pakistan)

We are looking for an experienced Cloudera Administrator with 4 to 7 years of hands-on experience to manage, configure, and support our enterprise-grade Cloudera Hadoop ecosystem. The role focuses on maintaining the stability, performance, and security of Cloudera clusters while supporting data ingestion, processing, and analytics workloads. The ideal candidate will have deep expertise in Cloudera/HDP/CDP distributions, Linux system administration, and enterprise big data platforms.

Key Responsibilities
- Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters across production and non-production environments.
- Monitor cluster health, performance, and resource utilization to ensure high availability and reliability.
- Manage and support core Hadoop ecosystem components including HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, and Atlas.
- Perform cluster upgrades, apply patches, and execute migrations with minimal downtime.
- Implement and maintain security controls using Kerberos, Ranger, and LDAP/Active Directory integration.
- Manage user access, roles, and privileges within the Cloudera ecosystem.
- Automate routine administrative tasks using Python, Shell scripting, or Ansible.
- Troubleshoot cluster-related issues, resolve performance bottlenecks, and address job failures.
- Support backup strategies and disaster recovery planning for Hadoop clusters.
- Collaborate closely with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
- Generate reports on cluster usage, job performance, and capacity planning to inform operational decisions.

Required Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent professional experience.
- 4 to 7 years of practical experience administering Cloudera/Hadoop ecosystems.
- Strong Linux/Unix system administration skills with proficiency in shell scripting.
- In-depth knowledge of Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Impala, Kafka, and HBase.
- Experience with Cloudera Manager for cluster monitoring, configuration, and administration.
- Familiarity with security frameworks including Kerberos, Ranger, Sentry, and LDAP/AD integration.
- Proven ability in troubleshooting, log analysis, and performance tuning of big data platforms.
- Experience in backup, recovery, and disaster recovery strategies tailored for Hadoop environments.
- Understanding of cloud platforms like AWS, Azure, or GCP and cloud-based Cloudera deployments is advantageous.

Preferred Qualifications
- Cloudera Certified Administrator for Apache Hadoop (CCAH) or equivalent certification.
- Experience with containerization technologies such as Docker and Kubernetes for managing big data workloads.
- Knowledge of SQL, Python, and PySpark to assist in debugging and optimizing data pipelines.

This position offers the opportunity to work in a dynamic environment with cutting-edge big data technologies, contributing to the scalability and reliability of enterprise data platforms.