Lead I - Data Engineering

UST is a global leader in driving digital transformation, partnering with some of the world’s top organizations to foster growth and innovation. With a workforce of over 30,000 employees across more than 30 countries, UST leverages the right talent, tools, and ideas to co-create impactful solutions that touch billions of lives worldwide. We are currently seeking a skilled Big Data Engineer with expertise in Azure cloud technologies to join our dynamic team.

Key Responsibilities
- Design, build, and maintain scalable and robust ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Develop efficient data transformation logic leveraging PySpark and Spark-based frameworks to optimize performance and scalability.
- Perform advanced SQL querying, data modeling, and implement SQL-based transformations to support business needs.
- Ensure data quality, governance, and security compliance throughout the data lifecycle.
- Collaborate closely with business stakeholders, data analysts, and solution architects to translate requirements into effective technical solutions.
- Support production deployments, monitor data workflows, and troubleshoot issues to maintain system reliability.

Required Qualifications
- Proven experience in developing scalable data pipelines using Azure Databricks, including Spark-based transformations and performance tuning.
- Strong proficiency in Azure Data Factory for designing and orchestrating ETL/ELT workflows.
- Expertise in PySpark for data processing, transformation, and optimization.
- Advanced SQL skills, including querying, performance tuning, and data modeling.
- Familiarity with big data technologies and distributed data processing concepts.
- Solid understanding of data governance, quality standards, and security best practices.

Preferred Qualifications
- Exposure to the Hadoop ecosystem and distributed data processing frameworks.
- Experience with PL/SQL, including stored procedures and performance optimization.
- Knowledge of Python scripting for automation and data manipulation.
- Background in Oracle Apps technical interfaces, conversions, reports, and integrations.
- Experience working in Azure cloud environments with CI/CD pipelines for data workflows.
- Strong analytical and problem-solving skills combined with effective communication and stakeholder management abilities.
- Familiarity with additional technologies such as Apache Spark, Scala, AWS, and ETL tools is a plus.

Join UST and be part of a collaborative environment where innovation and transformation drive meaningful impact. This role offers the opportunity to work on cutting-edge cloud data solutions and contribute to projects that influence global enterprises.