Located in Pine Avenue, Lake City, Lahore, this full-time Data Engineer role offers an exciting opportunity to work on-site with a dynamic team. The position requires working hours from 2:00 PM to 11:00 PM, Monday through Friday. The ideal candidate will be an experienced Data Engineer who possesses strong technical skills, excellent communication abilities, and confidence in client-facing interactions. This role demands ownership of projects from initial requirements gathering through to production deployment, ensuring high-quality and scalable data solutions.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and data platforms to support diverse data needs.
- Build both batch and real-time data pipelines utilizing Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse environments for performance and scalability.
- Integrate data from various sources including APIs, databases, event streams, and external systems.
- Implement robust data quality checks, validation processes, monitoring, and governance frameworks.
- Optimize SQL queries and improve data processing performance, reliability, and cloud infrastructure costs.
- Collaborate closely with clients, Product teams, Data Science, and Engineering departments to align technical solutions with business goals.
- Translate client requirements into effective, scalable technical solutions.
- Take full ownership of data engineering projects, ensuring timely delivery and quality from requirements through production.
- Troubleshoot and resolve complex production data issues to maintain system stability.
Required Qualifications
- Minimum of 4 years of professional experience in Data Engineering.
- Proficiency in Python and SQL for data manipulation and pipeline development.
- Hands-on experience with Spark/PySpark and Airflow for workflow orchestration.
- Practical knowledge of cloud platforms such as AWS, GCP, or Azure.
- Strong understanding of ETL/ELT processes, data modeling, data warehousing, and distributed systems.
- Experience working with relational databases like PostgreSQL/MySQL and NoSQL databases.
- Familiarity with containerization and version control tools including Docker and Git.
- Exposure to CI/CD pipelines to automate deployment processes.
- Excellent communication skills and the ability to manage stakeholder expectations effectively.
- Demonstrated ownership mindset, strong problem-solving skills, and ability to close projects successfully.
This role is ideal for a proactive Data Engineer who thrives in a collaborative environment and is eager to drive impactful data solutions. The position offers the chance to work closely with cross-functional teams and clients, contributing to innovative data infrastructure projects in a fast-paced setting.