Located in Pine Avenue, Lake City, Lahore, this full-time, on-site Data Engineer role operates from 2:00 PM to 11:00 PM, Monday through Friday. The position calls for an experienced professional who possesses strong technical skills, effective communication abilities, and confidence in client-facing interactions. The ideal candidate will demonstrate ownership of projects, managing them from initial requirements gathering through to production deployment.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and robust data platforms.
- Build batch and real-time data pipelines utilizing Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse solutions to support business needs.
- Integrate data from diverse sources including APIs, databases, event streams, and external systems.
- Implement and maintain data quality, validation, monitoring, and governance frameworks.
- Optimize SQL queries and enhance data processing performance, reliability, and cloud cost-efficiency.
- Collaborate closely with clients, Product, Data Science, and Engineering teams to ensure alignment and successful delivery.
- Translate client requirements into effective technical solutions that meet business objectives.
- Take full ownership of data engineering projects, ensuring timely delivery from requirements to production.
- Troubleshoot and resolve complex production data issues to maintain system stability and performance.
Required Qualifications
- A minimum of 4 years of professional experience in Data Engineering.
- Proficiency in Python and SQL programming languages.
- Hands-on experience with Spark/PySpark and Airflow for data pipeline orchestration.
- Practical knowledge of cloud platforms such as AWS, GCP, or Azure.
- Strong understanding of ETL/ELT processes, data modeling, data warehousing, and distributed systems architecture.
- Experience working with relational databases like PostgreSQL or MySQL, as well as NoSQL databases.
- Familiarity with containerization using Docker, version control with Git, and CI/CD pipelines.
- Excellent communication skills and the ability to manage stakeholders effectively.
- Demonstrated ownership mentality, strong problem-solving skills, and the ability to close projects successfully.
This role offers an excellent opportunity to work in a dynamic environment where technical expertise and client interaction are equally valued. The candidate will be empowered to lead projects end-to-end, contributing significantly to the organization’s data infrastructure and analytics capabilities.