Located in Pine Avenue, Lake City, Lahore, this full-time, on-site Data Engineer role offers an exciting opportunity to work Monday through Friday from 2:00 PM to 11:00 PM. The ideal candidate will have extensive experience in data engineering, strong technical skills, and excellent communication abilities. This position requires confidence in client interactions and the capability to manage projects independently from initial requirements through to production deployment.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and robust data platforms to support business needs.
- Build both batch and real-time data pipelines utilizing Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse systems for efficient data storage and retrieval.
- Integrate data from various sources including APIs, databases, event streams, and external systems.
- Implement comprehensive data quality checks, validation processes, monitoring, and governance frameworks.
- Optimize SQL queries and enhance data processing performance, reliability, and cloud infrastructure costs.
- Collaborate closely with clients, product teams, data scientists, and engineering departments to ensure alignment on project goals.
- Translate client requirements into effective technical solutions that meet business objectives.
- Take full ownership of data engineering projects, managing them from requirements gathering through to production rollout.
- Troubleshoot and resolve complex issues that arise in production environments to maintain data pipeline integrity.
Required Qualifications
- Minimum of 4 years of professional experience in data engineering roles.
- Proficiency in Python and SQL for data manipulation and pipeline development.
- Hands-on experience with Spark/PySpark and Airflow for workflow orchestration.
- Practical knowledge of cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.
- Strong understanding of ETL/ELT processes, data modeling techniques, data warehousing concepts, and distributed systems architecture.
- Experience working with relational databases like PostgreSQL or MySQL, as well as NoSQL databases.
- Familiarity with containerization (Docker), version control (Git), and continuous integration/continuous deployment (CI/CD) pipelines.
- Excellent communication skills with the ability to manage stakeholders effectively.
- Demonstrated ownership mentality, strong problem-solving skills, and the ability to successfully close projects.
This role is ideal for a motivated data engineering professional looking to leverage their technical expertise and client-facing skills in a dynamic, collaborative environment. The position offers the chance to work on impactful projects while engaging with cross-functional teams and clients directly.