Located on Pine Avenue in Lake City, Lahore, this full-time, on-site Data Engineer role operates from 2:00 PM to 11:00 PM, Monday through Friday. The ideal candidate will bring extensive experience in data engineering, combining strong technical skills with effective communication and client-facing abilities. This position requires a proactive professional who can manage projects independently, from gathering requirements to delivering production-ready solutions.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and data platforms to support business needs.
- Build both batch and real-time data pipelines utilizing Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse solutions for efficient data storage and retrieval.
- Integrate data from various sources including APIs, databases, event streams, and external systems.
- Implement robust data quality checks, validation processes, monitoring, and governance frameworks.
- Optimize SQL queries and data processing workflows to enhance performance, reliability, and reduce cloud infrastructure costs.
- Collaborate closely with clients, as well as Product, Data Science, and Engineering teams to ensure alignment and successful delivery.
- Translate client requirements into effective and scalable technical solutions.
- Take full ownership of data engineering projects, ensuring timely and quality delivery from inception through production.
- Troubleshoot and resolve complex issues arising in production environments to maintain data pipeline integrity.
Required Qualifications
- Minimum of 4 years of professional experience in Data Engineering roles.
- Proficiency in Python and SQL for data manipulation and pipeline development.
- Hands-on experience with Spark/PySpark and Airflow for building and orchestrating data workflows.
- Practical knowledge of cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.
- Strong understanding of ETL/ELT processes, data modeling, data warehousing, and distributed systems architecture.
- Experience working with relational databases like PostgreSQL or MySQL, as well as NoSQL databases.
- Familiarity with containerization (Docker), version control (Git), and continuous integration/continuous deployment (CI/CD) pipelines.
- Excellent communication skills with the ability to manage stakeholders effectively.
- Demonstrated ownership mindset, strong problem-solving capabilities, and the ability to close projects independently.
This role offers the opportunity to work in a dynamic environment where technical expertise and client interaction are equally valued. Candidates who thrive in collaborative settings and enjoy end-to-end project responsibility will find this position rewarding.