Located in Pine Avenue, Lake City, Lahore, this full-time, on-site position offers working hours from 2:00 PM to 11:00 PM, Monday through Friday. We are looking for an experienced Data Engineer who possesses strong technical skills, excellent communication abilities, and confidence in client-facing interactions. The ideal candidate will demonstrate the capability to take full ownership of projects, guiding them from initial requirements to successful production deployment.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and data platforms to support business needs.
- Build both batch and real-time data pipelines utilizing Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse solutions to ensure efficient data storage and retrieval.
- Integrate data from diverse sources including APIs, databases, event streams, and external systems.
- Implement robust data quality checks, validation processes, monitoring frameworks, and governance protocols.
- Optimize SQL queries and improve data processing performance, reliability, and cloud infrastructure costs.
- Collaborate closely with clients, product teams, data scientists, and engineering departments to align technical solutions with business objectives.
- Translate client requirements into effective and scalable technical implementations.
- Take full ownership of data engineering projects, managing them through all phases from requirements gathering to production rollout.
- Troubleshoot and resolve complex data issues that arise in production environments.
Required Qualifications
- Minimum of 4 years of professional experience in data engineering roles.
- Proficiency in Python and SQL programming languages.
- Hands-on experience with Spark/PySpark and Airflow for pipeline orchestration.
- Practical knowledge of cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.
- Strong understanding of ETL/ELT processes, data modeling techniques, data warehousing concepts, and distributed systems architecture.
- Experience working with relational databases like PostgreSQL or MySQL, as well as NoSQL databases.
- Familiarity with containerization tools like Docker, version control systems such as Git, and CI/CD pipelines.
- Excellent communication skills with the ability to manage stakeholders effectively.
- Demonstrated ownership mindset, strong problem-solving capabilities, and the ability to close projects efficiently.
This role offers an excellent opportunity for a motivated Data Engineer to work in a dynamic environment, engaging with cross-functional teams and clients directly. Candidates who thrive in a fast-paced setting and enjoy taking initiative will find this position rewarding.