Senior Data Engineer(Databricks)

Located near FC College Lahore, this full-time position offers an exciting opportunity for an experienced Data Engineer to join a dynamic team. The role requires working on-site with hours from 3:00 PM to 12:00 AM. The ideal candidate will have over five years of experience in data engineering or related fields, demonstrating strong technical expertise and a passion for building scalable data solutions.

Key Responsibilities

- Design, build, and maintain scalable ETL/ELT pipelines integrating data from internal systems, APIs, and external sources.
- Develop and optimize data architectures, including warehouses and storage solutions, to support business needs.
- Cleanse, validate, and transform raw data to ensure accuracy and usability for analytics and reporting.
- Write and optimize complex SQL queries and data models to enhance data retrieval and processing efficiency.
- Manage and monitor data workflows to maintain performance, reliability, and timely delivery.
- Ensure data quality, integrity, consistency, and security across all systems and platforms.
- Collaborate closely with analysts and stakeholders to support reporting and business intelligence requirements.
- Automate repetitive data processes to improve workflow efficiency and reduce manual intervention.
- Maintain comprehensive documentation for data pipelines, datasets, schemas, and infrastructure components.
- Continuously evaluate and improve the company’s data stack, architecture, and engineering practices to stay current with industry standards.

Required Qualifications

- Minimum of 5 years of professional experience in Data Engineering or a related role.
- Strong proficiency in SQL and expertise in database optimization techniques.
- Proven experience in building and maintaining ETL/ELT pipelines.
- Hands-on experience with Databricks or similar data processing platforms.
- Familiarity with cloud data warehouses such as Snowflake, BigQuery, or Redshift.
- Proficiency in Python for data processing, automation, and scripting tasks.
- Experience with workflow orchestration tools like Airflow or comparable platforms.
- Solid understanding of data modeling, warehousing concepts, and scalable architecture design.
- Experience working with large datasets and distributed systems environments.
- Excellent problem-solving and debugging skills to troubleshoot complex data issues.

Preferred Qualifications and Additional Skills

- Experience with Spark, Kafka, or real-time data streaming technologies is a plus.
- Exposure to healthcare or SaaS datasets would be advantageous.
- Knowledge of data governance frameworks and metadata management practices.
- Familiarity with DevOps principles, CI/CD pipelines, or infrastructure automation tools.
- Experience supporting machine learning pipelines and related data workflows.

This role is ideal for a motivated data engineering professional seeking to contribute to a forward-thinking organization by enhancing data infrastructure and enabling data-driven decision-making. The position offers the chance to work with cutting-edge technologies and collaborate with cross-functional teams to deliver impactful solutions.