Sr Data Engineer

This role involves designing and managing relational database schemas, including tables, views, indexes, and partitioning strategies to ensure high performance. The candidate will be responsible for building and maintaining ETL/ELT pipelines that extract, transform, and load structured data from operational databases into data warehouses or analytics platforms. A key focus will be optimizing SQL queries, managing database locks, and tuning memory and storage utilization to enhance overall system efficiency. Additionally, the role requires implementing data quality and governance measures such as data validation, schema enforcement, data masking, and backup and recovery procedures. Collaboration with data analysts, data scientists, and software engineers is essential to guarantee reliable and low-latency data availability.

Key Responsibilities

- Design and manage relational database schemas, including tables, views, indexes, and partitioning strategies to optimize performance.
- Develop and maintain ETL/ELT pipelines for extracting, transforming, and loading structured data from operational sources into data warehouses or analytics stores.
- Optimize slow-running SQL queries, handle database locks, and tune memory and storage resources such as buffer pools and connection pooling.
- Implement robust data quality and governance practices, including data validation checks, schema enforcement, data masking, and backup/recovery procedures.
- Collaborate closely with cross-functional teams, including data analysts, data scientists, and software engineers, to ensure data availability is reliable and low-latency.

Required Qualifications

- Proven experience in designing and managing relational database schemas with a focus on performance optimization.
- Strong expertise in ETL/ELT pipeline development and maintenance.
- Proficiency in SQL query optimization, database locking mechanisms, and resource tuning.
- Hands-on experience with data quality frameworks, governance policies, and backup/recovery strategies.
- Ability to work effectively in a collaborative environment with diverse technical teams.

Preferred Qualifications and Benefits

- Experience working with large-scale data warehouses or analytics platforms.
- Familiarity with advanced partitioning and indexing strategies.
- Knowledge of data masking techniques and security best practices.
- Exposure to cloud-based data services and modern data engineering tools.
- Opportunity to work in a dynamic team environment focused on data reliability and performance.

This position offers a challenging opportunity to contribute to critical data infrastructure, ensuring high-quality data management and availability for analytics and operational needs.