Located in Pine Avenue, Lake City, Lahore, this full-time, on-site Data Engineer role offers an exciting opportunity to work Monday through Friday from 2:00 PM to 11:00 PM. The ideal candidate will bring strong technical expertise and excellent communication skills, demonstrating confidence in client-facing situations. This position requires someone who can take full ownership of projects, managing them from initial requirements through to production deployment.
Key Responsibilities
Designing and developing scalable ETL/ELT pipelines and data platforms will be a core part of this role. You will build both batch and real-time data pipelines using Python, SQL, Spark/PySpark, and Airflow. Additionally, you will be responsible for designing and optimizing data warehouses, data lakes, and lakehouse architectures. Integrating data from various sources such as APIs, databases, event streams, and external systems is essential.
Implementing data quality, validation, monitoring, and governance processes will ensure the reliability and accuracy of data. You will also optimize SQL queries and improve data processing performance, reliability, and cloud cost efficiency. Collaboration is key, as you will work closely with clients, Product, Data Science, and Engineering teams to understand requirements and translate them into effective technical solutions.
Taking ownership of data engineering projects from requirements gathering through production deployment is expected. You will troubleshoot and resolve complex production data issues to maintain smooth operations.
Required Qualifications
Candidates should have a minimum of four years of professional experience in Data Engineering. Proficiency in Python and SQL is essential, along with hands-on experience using Spark/PySpark and Airflow. Familiarity with cloud platforms such as AWS, GCP, or Azure is required.
A strong understanding of ETL/ELT processes, data modeling, data warehousing, and distributed systems is necessary. Experience working with relational databases like PostgreSQL or MySQL, as well as NoSQL databases, is important. Knowledge of containerization tools such as Docker, version control with Git, and CI/CD pipelines is also expected.
Excellent communication skills and the ability to manage stakeholders effectively are critical. The candidate must demonstrate strong ownership, problem-solving capabilities, and the ability to successfully close projects.
This role is based on-site, providing direct interaction with team members and clients, fostering a collaborative working environment.