QA Automation Engineer

Located in Islamabad, this full-time onsite role is ideal for candidates with 1 to 3 years of experience in software QA, automation, or business requirements analysis, especially those with strong client-facing skills. As an Agentic Automation & QA Engineer, you will serve as a vital link between clients’ business needs and the delivery of quality conversational AI and automation solutions. Your primary focus will be on understanding client workflows and pain points, designing and orchestrating AI-driven automated processes using low-code/no-code platforms, and ensuring the quality and reliability of these solutions through thorough testing and client coordination. This role emphasizes requirements analysis, workflow design, chatbot and AI testing, QA automation, and managing client interactions rather than software development or AI model building.

Key Responsibilities

Client Coordination & Requirements:
Engage directly with clients to gather detailed business requirements, workflows, and expected outcomes. Translate these into process flows, functional specifications, user journeys, acceptance criteria, and test scenarios. Identify opportunities to implement AI agents and intelligent automation within client processes. Act as the primary point of contact for clarifying requirements, conducting solution walkthroughs, providing testing updates, and managing user acceptance testing (UAT) and release readiness. Collaborate with internal teams such as AI, software engineering, DevOps, and project management when custom development or infrastructure support is necessary.

Agentic Workflow Orchestration:
Design and configure agentic workflows using platforms like n8n, Microsoft Power Automate, Copilot Studio, Make, Zapier, or similar tools. Set up agent roles, prompts, triggers, actions, decision points, routing logic, integrations, approval steps, human-in-the-loop processes, and escalation mechanisms. Connect AI agents with enterprise applications, APIs, databases, messaging platforms, and other business systems. Prototype workflows and present them to clients, incorporating feedback for continuous improvement.

Chatbot & Conversational AI Testing:
Conduct comprehensive testing of chatbots and conversational AI, including conversation flows, intents, responses, context retention, and fallback scenarios. Evaluate RAG-based chatbots and AI assistants for response relevance, factual accuracy, citation correctness, and knowledge retrieval. Assess AI outputs for hallucinations, ambiguity, prompt sensitivity, and compliance with business rules and guardrails. Test chatbot behavior across positive, negative, edge-case, adversarial, and out-of-scope queries. Validate the execution of agentic tools triggered through conversational interfaces and ensure proper session handling, role-based behavior, escalation, and error management. Maintain reusable evaluation datasets, test scenarios, and quality benchmarks.

QA, Automation & Delivery:
Perform end-to-end quality assurance of agentic workflows, including functional, integration, regression, API, and exception-path testing. Develop and maintain QA automation scripts to enhance regression coverage and reduce manual testing effort. Manage UAT with clients, document feedback and defects, and ensure timely resolution. Maintain comprehensive documentation covering requirements, workflows, agent configurations, chatbot scenarios, test cases, integrations, defects, and operating procedures. Support production validation, monitoring, and continuous improvement of deployed solutions.

Required Qualifications

Candidates should have 1 to 3 years of experience in software QA, automation, or business analysis with strong client interaction skills. Core QA competencies include test planning, test case design, regression and integration testing, API testing using tools like Postman, and defect management with platforms such as Jira or Azure DevOps. Experience in chatbot and conversational AI testing is highly desirable, including familiarity with Generative AI, RAG-based applications, and evaluating probabilistic AI systems for response quality, hallucinations, and guardrail adherence. Strong written and verbal English communication skills are essential, along with the ability to independently manage client interactions, lead solution demonstrations, and produce clear documentation.

Preferred Qualifications and Benefits

Hands-on experience with low-code/no-code automation platforms such as n8n, Microsoft Power Automate, Copilot Studio, Make, or Zapier is preferred. Candidates should be comfortable designing workflows with triggers, routing logic, approvals, and human-in-the-loop steps. A solid conceptual understanding of Generative AI, large language models, prompt engineering, knowledge bases, and AI agent orchestration is advantageous. Familiarity with API integrations, JSON, webhooks, authentication, and databases is important for configuring and troubleshooting workflows.

Educational qualifications include a Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related field. The role offers a competitive salary and an exemplary work environment, with a highly selective recruitment process focused on identifying top talent.