ML Evaluation Engineer

Artificial Intelligence Delivery Unit

Lahore , Pakistan

Apply Now

Posted 5 days ago 14 views Report Job

Job Description: Qualification: Bachelor's or Master's degree (16 years of education) in Computer Science, Artificial Intelligence, Data Science or a related field from an HEC-recognized university. Preference would be given to foreign qualified candidates with proven track record. Experience: At least 5 years in machine-learning engineering or ML testing and evaluation, including production model deployment or quality assurance. Skills & Competencies: • Python and ML frameworks (PyTorch / TensorFlow / scikit-learn) • Model evaluation, red-teaming and benchmark design • Bias, fairness and robustness testing methods • MLOps, experiment tracking and monitoring tooling • Clear technical reporting for non-specialist reviewers Key Performance Indicators (KPIs): • Share of production models passing standardized evaluation before deployment (target 100 percent). • Post-deployment issues detected through monitoring and time-to-remediation. Job Responsibilities: Key Responsibilities / ToRs: • Build and maintain standardized evaluation suites (accuracy, robustness, bias and fairness, safety and drift) applied at the evaluation gates. • Design test datasets and benchmarks, including Urdu and Punjabi language evaluation sets, with the Data, AI Engineering & Platform Wing. • Run pre-deployment evaluations and continuous post-deployment monitoring for all production models, publishing results to the model registry. • Support the Impact-Assessment Reviewer and third-party assurance providers with reproducible evaluation evidence for high-risk systems. • Advise squads and outsourced vendors on evaluation requirements and acceptance criteria written into contracts. Last date to apply: 12-Nov-2026