Located in Lake City, Lahore, this full-time, on-site position offers a dynamic opportunity for an experienced Data Engineer to join a collaborative team. The role requires working hours from 2:00 PM to 11:00 PM, Monday through Friday. The ideal candidate will possess strong technical skills, excellent communication abilities, and confidence in client-facing interactions. They will be responsible for managing projects independently, from gathering requirements through to production deployment.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and robust data platforms.
- Build both batch and real-time data pipelines utilizing Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse solutions to support business needs.
- Integrate data from diverse sources including APIs, databases, event streams, and external systems.
- Implement comprehensive data quality checks, validation processes, monitoring, and governance frameworks.
- Optimize SQL queries and enhance data processing performance, reliability, and cloud cost efficiency.
- Collaborate closely with clients, Product, Data Science, and Engineering teams to ensure alignment and delivery.
- Translate client requirements into effective technical solutions that meet business objectives.
- Take full ownership of data engineering projects from initial requirements gathering through to production rollout.
- Troubleshoot and resolve complex production data issues promptly to minimize downtime.
Required Qualifications
- Minimum of 4 years of professional experience in Data Engineering roles.
- Proficiency in Python and SQL programming languages.
- Hands-on experience with Spark/PySpark and Airflow for data pipeline orchestration.
- Practical knowledge of cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.
- Strong understanding of ETL/ELT processes, data modeling techniques, data warehousing concepts, and distributed systems.
- Experience working with relational databases like PostgreSQL or MySQL, as well as NoSQL databases.
- Familiarity with containerization (Docker), version control (Git), and CI/CD pipelines.
- Excellent communication skills with the ability to manage stakeholders effectively.
- Demonstrated ownership mindset, strong problem-solving capabilities, and ability to close projects independently.
This role offers the chance to work in a fast-paced environment where technical expertise and proactive project management are highly valued. The successful candidate will play a critical role in shaping data infrastructure and delivering impactful solutions to clients.