We are seeking a skilled Cloud Platform Engineer with extensive experience in designing, building, and supporting cloud-native platforms and services on AWS. The ideal candidate will manage and enhance AWS-based environments focused on sandbox, data engineering, and AI/ML development. This role involves developing automation solutions, platform utilities, APIs, and operational tooling primarily using Python, while ensuring robust infrastructure provisioning and optimization through Infrastructure as Code practices.
Key Responsibilities
- Design, build, and maintain cloud-native platforms and services running on AWS.
- Manage and improve AWS sandbox, data engineering, and AI/ML development environments.
- Develop automation scripts, platform utilities, APIs, and operational tools using Python.
- Provision, maintain, and optimize cloud infrastructure using Terraform.
- Develop, troubleshoot, and optimize Spark and PySpark workloads on AWS EMR.
- Support large-scale data processing, analytics, and AI/ML workloads.
- Build and maintain CI/CD pipelines to streamline deployments and platform operations.
- Collaborate closely with data engineers, AI engineers, architects, and product teams to deliver scalable, reliable solutions.
- Monitor platform health, troubleshoot production issues, and drive operational excellence.
- Evaluate and implement emerging cloud, AI, and automation technologies.
- Ensure compliance with security, governance, reliability, and cloud engineering best practices.
Required Qualifications
- Bachelor’s degree in Computer Science, Computer Engineering, Information Technology, or equivalent experience.
- 5 to 8 years of experience in cloud platform engineering, software development, infrastructure automation, or related roles.
- Strong hands-on experience with AWS services including EC2, S3, IAM, VPC, RDS/Aurora, EMR, CloudWatch, Lambda, ECS/EKS.
- Proficient in Linux administration, including scripting, troubleshooting, networking, system performance monitoring, and operational support.
- Advanced Python development skills for automation, API development, platform tooling, and data processing.
- Extensive experience with Infrastructure as Code using Terraform to provision and manage AWS environments.
- Proven ability to develop, troubleshoot, and optimize Apache Spark and PySpark workloads.
- Experience provisioning, configuring, operating, and supporting AWS EMR clusters.
- Practical knowledge of AI/ML and Generative AI technologies such as LLM-based applications, AI Agents, Agentic Workflows, MCP Servers, AI Tool Integrations, Retrieval-Augmented Generation (RAG), Prompt Engineering, and AI Automation Frameworks.
- Familiarity with CI/CD tools like Jenkins, GitHub, GitLab, Bitbucket, or similar platforms.
- Strong understanding of cloud security, access management, vulnerability remediation, and secure software development practices.
- Excellent analytical, problem-solving, troubleshooting, and communication skills.
Preferred Qualifications and Benefits
- Experience with containerization and orchestration technologies such as Docker, Kubernetes, and Amazon EKS.
- Skilled in designing and integrating REST APIs and microservices.
- Familiarity with monitoring, observability, and logging frameworks.
- Experience supporting AI/ML and data science environments like JupyterHub or JupyterLab.
- Knowledge of AI development tools such as GitHub Copilot, Amazon Q, Cursor, Claude Code, or similar AI-assisted engineering platforms.
- Experience building AI-enabled platforms, agentic workflows, or enterprise AI solutions.
- Understanding of vector databases, embedding models, model gateways, and AI platform operations.
- Relevant certifications in AWS, Terraform, Kubernetes, or AI/ML are advantageous.
This role offers an exciting opportunity to work at the intersection of cloud engineering and AI innovation, contributing to cutting-edge platforms that power scalable data and AI workloads.