Lead I - Data Engineering

UST is a global leader in helping organizations drive transformation and achieve sustainable growth. With over 30,000 employees across more than 30 countries, we combine the right talent, tools, and ideas to co-create impactful solutions that touch billions of lives. We are currently seeking an experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in analyzing, coding, implementing, and testing Big Data applications (both API and batch) on AWS Cloud. Proficiency in Java, Scala, Kotlin, Python, Cassandra, Hadoop, HDFS, Spark, and MapReduce frameworks is essential. Experience with REST API and SOAP web services development is also required.

Key Responsibilities
- Design, develop, and maintain Big Data applications on AWS Cloud using Java, Scala, Kotlin, Python, Cassandra, Hadoop, HDFS, Spark, and MapReduce frameworks.
- Implement and test API and batch processing solutions ensuring high performance and scalability.
- Utilize AWS services such as EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway for building and deploying microservices and batch applications.
- Perform batch application performance tuning using Spark, Hadoop, EMR, Java, and Python to optimize processing efficiency.
- Develop and maintain REST API and SOAP web services with strong coding practices in Scala, PySpark, and Java.
- Work extensively in Linux environments, leveraging shell scripting and Python for automation and operational tasks.

Required Qualifications
- Minimum of 6 years’ experience in Big Data application development, including analysis, coding, implementation, and testing on AWS Cloud platforms.
- Strong programming skills in Java, Scala, Kotlin, and Python, with hands-on experience in Cassandra, Hadoop, HDFS, Spark, and MapReduce.
- Proven expertise in building REST API and SOAP web services.
- Solid experience with AWS services such as EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway for batch and microservices applications.
- Proficient in batch application performance tuning for Spark, Hadoop, EMR, Java, and Python workloads.
- Comfortable working in Linux environments with shell scripting and Python automation.

Preferred Qualifications and Additional Skills
- Experience with DevOps tools and practices, including version control systems like GIT, GitHub, Bitbucket, and GitLab.
- Familiarity with IDEs such as IntelliJ IDEA and PyCharm.
- Knowledge of CI/CD pipeline creation and management using tools like Maven, Gradle, Jenkins, Artifactory, AWS CodeCommit, and CloudFormation.

UST is committed to fostering a culture built on humility, humanity, and integrity. We value listening, learning, empathy, and selfless collaboration in all interactions. Our mission extends beyond business success to improving the lives of those less fortunate. We honor our commitments and act responsibly in every relationship.

As an Equal Opportunity Employer, UST embraces diversity and inclusion. We do not discriminate based on age, disability, ethnicity, gender identity or expression, religion, sexual orientation, or any other protected status. Employment decisions are made solely on qualifications and merit.

UST reserves the right to redefine roles and responsibilities as organizational needs evolve. We expect all employees to support and promote UST’s core values and comply with company policies and procedures.

Key technologies involved include AWS CloudFormation, AWS CodeCommit, AWS Step Functions, Apache Airflow, Amazon S3, Amazon EMR, and Amazon ECS.