Assistant Manager - Big Data Administrator - Cloudera (Mashreq Global Network Pakistan)

We are looking for a skilled Cloudera Administrator with 4 to 7 years of experience to manage and support our enterprise-level Cloudera Hadoop ecosystem. The successful candidate will be responsible for ensuring the stability, security, and optimal performance of Cloudera clusters while supporting data ingestion, processing, and analytics workloads. This role requires deep expertise in Cloudera/HDP/CDP distributions, Linux system administration, and managing large-scale big data platforms.

Key Responsibilities

- Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters across production and non-production environments.
- Monitor cluster health, performance, and resource utilization to guarantee high availability and reliability.
- Manage and support core Hadoop ecosystem components including HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, and Atlas.
- Execute cluster upgrades, patches, and migrations with minimal downtime to ensure continuous operation.
- Implement and maintain security protocols using Kerberos, Ranger, and LDAP/Active Directory integration.
- Administer user access, roles, and privileges within the Cloudera environment to maintain secure operations.
- Automate routine administrative tasks through Python, Shell scripting, or Ansible to improve efficiency.
- Troubleshoot cluster issues, identify performance bottlenecks, and resolve job failures promptly.
- Support backup strategies and disaster recovery planning for Hadoop clusters to safeguard data integrity.
- Collaborate closely with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
- Generate detailed reports on cluster usage, job performance, and capacity planning to inform decision-making.

Required Qualifications

- Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.
- 4 to 7 years of hands-on experience administering Cloudera or Hadoop ecosystems.
- Strong Linux/Unix system administration skills, including shell scripting proficiency.
- In-depth knowledge of Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Impala, Kafka, and HBase.
- Experience using Cloudera Manager for cluster monitoring, configuration, and administration.
- Familiarity with security frameworks including Kerberos, Ranger, Sentry, and LDAP/Active Directory integration.
- Proven ability in troubleshooting, log analysis, and performance tuning within big data environments.
- Experience with backup, recovery, and disaster recovery strategies tailored for big data platforms.
- Understanding of cloud platforms like AWS, Azure, or GCP, and experience with cloud-based Cloudera deployments is advantageous.

Preferred Qualifications

- Cloudera Certified Administrator for Apache Hadoop (CCAH) or an equivalent certification.
- Experience with containerization technologies such as Docker and Kubernetes for managing big data workloads.
- Working knowledge of SQL, Python, and PySpark for debugging and optimizing data pipelines.

This role offers the opportunity to work with cutting-edge big data technologies in a dynamic environment, contributing to the reliability and scalability of enterprise data platforms.