MLOps & AI Architecture Engineer

Neural Surge AI, based in Lahore, Pakistan, is seeking an experienced MLOps and AI Architecture Engineer to join their on-site team. The company specializes in developing intelligent systems involving large language models (LLMs), retrieval-augmented generation (RAG), AI agents, machine learning models, and data pipelines. This role offers a unique opportunity to take ownership of the design, deployment, monitoring, and scaling of a proprietary AI pipeline. Candidates with hands-on experience in putting ML or LLM systems into production will find this position rewarding, as it emphasizes real responsibility and a clear path to architectural leadership from the outset.

Key Responsibilities
- Design the architecture of the AI pipeline, integrating data, models, prompts, retrieval systems, and agents.
- Develop and maintain deployment pipelines for LLM, RAG, and ML systems, incorporating CI/CD, version control, and safe rollback mechanisms.
- Implement monitoring solutions to track quality, latency, cost, and failure rates, proactively identifying issues before they impact users.
- Create evaluation frameworks and test sets to validate improvements in models or prompts.
- Optimize cost and performance by selecting appropriate models, caching strategies, and scaling methods.
- Build and manage reliable data and feature pipelines.
- Oversee cloud infrastructure, containerization, secrets management, and environment configurations, preferably on AWS.
- Establish guardrails, access controls, and audit trails to ensure AI outputs are safe, explainable, and fair.
- Evaluate new models, vendors, and tools, making informed recommendations for adoption or replacement.
- Document architecture decisions and develop runbooks to support engineering teams.

Required Qualifications
- 3 to 5 years of experience in MLOps, ML engineering, DevOps, or backend engineering, including at least 2 years deploying ML or LLM systems in production environments.
- Proficiency with Docker and experience working on a major cloud platform, with AWS preferred.
- Practical knowledge of CI/CD pipelines, monitoring, logging, APIs, and databases.
- Hands-on experience with LLM APIs such as OpenAI or Anthropic, and familiarity with RAG techniques.
- Strong systems thinking skills, able to design solutions that are reliable, scalable, and cost-effective.
- Demonstrated ownership mindset, committed to resolving issues until solutions are production-ready.

Preferred Qualifications and Benefits
- Experience with Kubernetes, Terraform, or other infrastructure-as-code tools.
- Familiarity with experiment tracking, model registries, or ML workflow tools like MLflow or Airflow.
- Background in real-time voice or speech AI technologies.
- Knowledge of vector databases and search systems.
- Expertise in load testing and reliability engineering.
- Understanding of responsible AI principles, security practices, and access control.
- Skills in model serving and optimization frameworks such as ONNX, TensorRT, vLLM, Triton, and quantization.
- Experience with LLM frameworks and agents like LangChain or LlamaIndex.
- Competence in model and prompt evaluation, drift monitoring, and observability tools including Prometheus, Grafana, and OpenTelemetry.
- Proficiency with data pipelines and processing tools such as Spark or Kafka.
- Exposure to computer vision or NLP, including support for Urdu language.
- Contributions to open-source projects or published technical writing are a plus.

Why Join Us
Joining Neural Surge AI means early-stage ownership in shaping the future of AI products. The company values fast iteration combined with production-grade discipline and offers a competitive salary based on experience. This is an excellent opportunity to influence architectural decisions in a cutting-edge AI environment.

This is a full-time, on-site position based at 116-C Etihad Town, Phase-1, Lahore. Only shortlisted candidates will be contacted.