Lead Data Engineer

We are seeking a Lead Data Engineer to design and implement scalable data pipelines and solutions using a modern data stack centered on Snowflake on AWS, Snowflake Openflow (Apache NiFi), dbt, PostgreSQL, Python, and SQL. This senior, hands-on role involves translating business and data needs into technical designs, building and optimizing pipelines, and delivering reliable data products. The position also leads Data Operations support and coordinates priorities among India-based data teams, ensuring smooth workflows and removing blockers. A major focus is on advancing Data Operations through automation, monitoring, and proactive issue resolution.

Key Responsibilities

- Lead the end-to-end design and delivery of scalable data pipelines and solutions using Snowflake, Snowflake Openflow, and dbt.
- Translate business and data requirements into technical designs, data flows, integration patterns, data models, and delivery plans.
- Build and maintain ingestion and orchestration flows in Openflow, transformation models in dbt, and efficient data structures in Snowflake.
- Develop reusable patterns for batch, change data capture (CDC), API, and file-based ingestion, ensuring validation, reconciliation, restartability, and recovery.
- Write advanced SQL and Python code, participate in code reviews, troubleshoot issues, tune performance, and resolve complex engineering challenges.
- Ensure solutions meet standards for data quality, security, scalability, maintainability, observability, and cost efficiency.
- Collaborate with architecture, analytics, platform, security, application, and business teams to align designs, data contracts, dependencies, and delivery outcomes.
- Maintain clear technical documentation and contribute reusable engineering patterns and standards across the Data team.
- Lead Data Operations support, coordinating priorities, handoffs, and issue resolution among India-based colleagues within established reporting lines.
- Establish and reinforce engineering best practices including source control, peer review, testing, CI/CD, deployment, documentation, and production readiness.
- Mentor team members through design and code reviews, promote cross-training, and support independent delivery and maintenance of data solutions.
- Own and mature Data Operations processes such as support coverage, incident response, escalation paths, runbooks, recovery procedures, and service expectations.
- Drive automated monitoring, alerting, and recovery across Snowflake, Openflow, dbt, databases, and pipeline workloads to minimize manual checks and proactively identify issues.
- Track service health and incident trends, lead root-cause analysis, and maintain prioritized plans to improve reliability and operational efficiency.

Required Qualifications

- Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent education and experience.
- Over 10 years of hands-on data engineering experience, including at least 2 years in a leadership role managing technical delivery or production operations.
- Strong production experience with cloud data technologies such as Snowflake, AWS, Azure, or GCP, including solution design, data structures, performance tuning, workload management, security, and cost optimization.
- Extensive hands-on experience with dbt, including model design, testing, documentation, dependencies, reusable macros, and multi-environment deployment.
- Proficiency with Git-based development, automated testing, CI/CD pipelines, Terraform, and repeatable environment promotion.
- Advanced SQL skills with a proven track record of building maintainable, testable production data pipelines and data products.
- Experience designing ETL/ELT solutions across batch, CDC, API, and file-based ingestion, applying strong data modeling, quality, validation, and recovery practices.
- Excellent solution design, communication, and technical leadership skills, with the ability to guide decisions, mentor engineers, and collaborate across business and technology teams.

Preferred Qualifications and Benefits

- Experience working with Snowflake and production data pipelines in AWS environments.
- Hands-on knowledge of Apache NiFi or Snowflake Openflow, including reusable flow design, orchestration, error handling, monitoring, and deployment.
- Familiarity with relational databases such as RDS and PostgreSQL.
- Background in financial services or regulated environments, including auditability, reconciliation, privacy, and production control.
- Experience with automated observability, data quality, metadata, lineage, or data catalog tools.
- Certifications in Snowflake, dbt, Apache NiFi, AWS, or data management.

Employee Benefits

- Comprehensive medical coverage for employees and family members, with optional top-up coverage.
- Employer provident fund contributions to support long-term financial security.
- Performance-based annual bonuses up to 5% of base salary.
- Recognition programs including a point-based rewards platform redeemable for gift cards and experiences.
- Flexible work model currently remote, transitioning to hybrid.
- Paid leave entitlements including annual, casual, and sick leaves.
- Continuous learning culture with access to upskilling programs, mentorship, and professional development.
- Career growth opportunities through internal mobility, leadership development, certifications, and specialized training.
- Collaborative environment with global teams and exposure to international best practices.

Joining MFSG Technologies (India) Private Limited means being part of a purpose-driven organization committed to responsible innovation, ethical data use, and transforming customers’ lives for the better. We foster inclusivity, teamwork, and integrity, offering a dynamic workplace where your contributions make a real impact.