We are looking for a motivated Software QA Engineer to join our innovative team. In this position, you will be responsible for designing and executing both automated and manual tests to ensure the quality and reliability of our software products. Working closely with development and product teams, you will play a vital role in validating AI/ML models and improving overall product performance.
Key Responsibilities
- Validate AI/ML model outputs by comparing them against ground-truth data, test cases, and business requirements to ensure accuracy and relevance.
- Assess the correctness, fairness, consistency, and applicability of model predictions across different scenarios.
- Create detailed test cases that cover exceptions, edge cases, and out-of-distribution data to enhance model robustness.
- Monitor performance metrics such as latency, throughput, and memory usage within AI pipelines.
- Identify system bottlenecks and collaborate with engineering teams to optimize AI models and pipeline efficiency.
- Perform stress, load, and scalability testing on deployed AI systems to verify stability under various conditions.
- Develop and maintain both manual and automated test suites for AI workflows, APIs, and endpoints.
- Test system resilience against invalid inputs, adversarial samples, and potential API failures.
- Ensure fallback mechanisms and graceful error handling are properly implemented and functioning.
- Collaborate closely with machine learning engineers, data scientists, and product managers to refine testing requirements.
- Document test cases, results, and known model limitations clearly and thoroughly.
- Report quality metrics and provide actionable insights to support continuous improvement initiatives.
Required Qualifications
- Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related discipline.
- Strong proficiency in Python programming, with experience using testing frameworks such as PyTest and unittest.
- Between 6 months and 2 years of experience as an AI QA Engineer or ML/AI Tester.
- Practical experience working with AI frameworks like TensorFlow, PyTorch, and Hugging Face.
- Excellent debugging, analytical, and problem-solving abilities.
- Solid understanding of SQL and hands-on experience with relational databases such as MySQL or PostgreSQL.
- Familiarity with evaluation metrics commonly used in AI modeling techniques.
Preferred Qualifications and Benefits
Join AIO and help revolutionize the US restaurant industry through cutting-edge technology. Our mission is to empower restaurant owners with a fully integrated platform that streamlines all aspects of their business. By combining patented AI technology with outstanding customer support, our solution helps restaurants increase revenue, reduce costs, and boost profitability, especially in the post-COVID-19 environment.
Our All-In-One super app supports both front-of-house operations—including ordering, payment, marketing, and rewards—and back-of-house management such as inventory, staffing, and financials. As part of a Silicon Valley-funded startup, you will be at the forefront of a rapidly expanding $55 billion restaurant tech SaaS market. You will work alongside a world-class team dedicated to innovation and excellence.
This role offers a unique opportunity to make a meaningful impact while advancing your career in a fast-paced, mission-driven environment.