QA Engineer

We are an AI-driven healthcare technology company focused on the US market, developing innovative products that integrate directly with hospitals, healthcare providers, and payers. Our platform manages sensitive health data with a strong emphasis on security and regulatory compliance, which are integral to our product launch strategy rather than afterthoughts. As we prepare to bring our solution to market, we are seeking a skilled professional to lead and own the quality assurance function within our Islamabad engineering team.

Key Responsibilities

Own the QA function: Define and implement the overall testing strategy, standards, and release criteria for the engineering team. Develop and maintain comprehensive regression, smoke, and integration test suites. Establish a defect lifecycle and generate quality reports to inform leadership decisions. Act as the quality gatekeeper for product releases by defining and enforcing what “ready to ship” means.

Test automation and engineering: Design and maintain automated test frameworks for web UI, REST APIs, and backend services using Python-based tools. Integrate automated testing into CI/CD pipelines to catch defects before code merges rather than post-deployment. Conduct API, database, and performance/load testing across microservices and cloud environments.

AI/ML and data quality: Validate AI/ML components by assessing model output accuracy, consistency, edge-case and boundary behaviors, regression across model versions, and degradation over time. Test data pipelines end to end, ensuring completeness and integrity in ingestion, transformation, and reporting. Develop evaluation approaches for non-deterministic outputs where correctness is measured statistically rather than by exact match.

Collaboration and compliance: Collaborate closely with Backend, Frontend, AI, and Python developers from requirements gathering through release. Review specifications early to identify ambiguities before they become defects. Ensure testing practices comply with healthcare data protection standards such as HIPAA and PHI handling. Support validation and audit-readiness for a CLIA/CAP-accredited environment. Document test evidence to a standard that withstands external audits.

Required Qualifications

- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Software Engineering, or a closely related field.
- Minimum of 5 years’ experience in software quality assurance, including at least 2 years focused on test automation.
- Strong proficiency in Python, capable of independently building and maintaining test frameworks.
- Hands-on experience with modern automation frameworks such as Pytest, Playwright, Selenium, or Cypress.
- Solid skills in API testing tools like Postman or REST Assured, and strong SQL abilities for data validation.
- Familiarity with CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI) and version control using Git.
- Demonstrated understanding of the machine learning lifecycle, including training, evaluation metrics, versioning, and drift, enabling meaningful test design around model behavior.
- Excellent written English communication skills, able to document findings clearly for both technical and non-technical audiences.

Preferred Qualifications and Benefits

Experience testing AI/ML-powered or data-intensive products is highly desirable. Familiarity with LLM/model evaluation tools such as DeepEval, Ragas, or promptfoo, or experience building custom evaluation harnesses, is a plus. Exposure to healthcare IT standards and systems like HL7/FHIR, LIS/LIMS, EMR integrations, or regulated software validation adds significant value. Knowledge of performance and security testing tools (e.g., JMeter, OWASP ZAP), cloud platforms (AWS, Azure), and containerization technologies like Docker is advantageous. ISTQB certification is also preferred.

We are committed to fostering a diverse and inclusive workplace where all employees can thrive. The position offers a competitive monthly salary starting from Rs200,000. The role requires in-person work at our Islamabad location.