Located in Pine Avenue, Lake City, Lahore, this full-time Data Engineer position operates on-site with working hours from 2:00 PM to 11:00 PM, Monday through Friday. The role calls for a seasoned professional with a strong technical background, excellent communication skills, and confidence in client interactions. The ideal candidate will demonstrate the ability to take full ownership of projects, managing them from initial requirements gathering through to production deployment.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines and data platforms to support business needs.
- Build both batch and real-time data pipelines using Python, SQL, Spark/PySpark, and Airflow.
- Architect and optimize data warehouses, data lakes, and lakehouse solutions to improve data accessibility and performance.
- Integrate data from diverse sources including APIs, databases, event streams, and external systems.
- Implement robust data quality checks, validation processes, monitoring, and governance frameworks to ensure data integrity.
- Optimize SQL queries and enhance data processing performance, reliability, and cloud cost efficiency.
- Collaborate closely with clients, as well as Product, Data Science, and Engineering teams, to align technical solutions with business requirements.
- Translate client needs into effective technical designs and solutions.
- Take full ownership of data engineering projects, ensuring successful delivery from requirements through to production.
- Troubleshoot and resolve complex data issues in production environments promptly and effectively.
Required Qualifications
- Minimum of 4 years of professional experience in Data Engineering.
- Proficiency in Python and SQL for data manipulation and pipeline development.
- Hands-on experience with Spark/PySpark and Airflow for building and orchestrating data workflows.
- Practical knowledge of cloud platforms such as AWS, GCP, or Azure.
- Strong understanding of ETL/ELT processes, data modeling, data warehousing, and distributed systems architecture.
- Experience working with relational databases like PostgreSQL and MySQL, as well as NoSQL databases.
- Familiarity with containerization tools such as Docker, version control systems like Git, and CI/CD pipelines.
- Excellent communication skills with the ability to manage stakeholders effectively.
- Demonstrated ownership mentality, strong problem-solving skills, and the ability to close projects successfully.
This role offers an excellent opportunity for a data engineering professional to work in a dynamic environment, engaging directly with clients and cross-functional teams while contributing to critical data infrastructure projects. The position emphasizes technical excellence, collaboration, and accountability, making it ideal for candidates who thrive in ownership-driven roles.