Remote Pod Lead - Math

Turing, a rapidly growing AI company, is advancing the development and deployment of cutting-edge AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multimodality, and STEM knowledge. Leveraging these advancements, Turing builds practical AI solutions that address critical challenges faced by businesses worldwide.

Key Responsibilities:
Lead a team of 5 to 10 trainers focused on creating realistic, terminal-based scientific and technical tasks for Terminal Bench Science. Review and ensure mathematical accuracy, reproducibility, and challenge quality in trainer-created tasks. Oversee grader reliability and mentor trainers to uphold high standards in task design and evaluation. Manage quality control and throughput while maintaining documentation of guidelines and best practices. Collaborate closely with the Mathematics Team Lead and other stakeholders to enhance benchmark quality. Tasks will span numerical and applied mathematics, scientific computing, optimization, statistics, mathematical modeling, computational algebra, and formal verification. Responsibilities include reviewing problem statements, datasets, environments, reference solutions, and automated tests; verifying mathematical correctness, convergence, stability, and edge-case handling; ensuring tasks require multi-step reasoning rather than simple lookups; validating appropriate use of exact, symbolic, or floating-point computations; and designing graders based on mathematical properties such as residuals or error bounds. Additionally, ensure reproducibility through pinned tools and dependencies, prevent bypass methods like hard-coded solutions, provide actionable feedback, and track revisions through to completion. Allocate work, monitor team performance, escalate blockers, and onboard new trainers on mathematical rigor, coding practices, and evaluation standards.

Required Qualifications:
Ph.D., postdoctoral experience, or equivalent advanced expertise in mathematics, applied mathematics, statistics, or related fields. Proficiency in programming languages such as Python, Julia, C/C++, MATLAB/Octave, or computer algebra systems. Strong command of Linux and terminal environments. Hands-on experience with numerical methods, scientific computing, symbolic computation, optimization, computational statistics, or mathematical modeling. Ability to rigorously evaluate mathematical derivations, algorithms, proofs, and computational results. Experience reviewing research outputs, code, or scientific workflows. Demonstrated leadership or mentoring experience in small technical or research teams. Excellent written communication skills with the ability to provide precise and constructive feedback. Capability to assess reproducibility, test reliability, and scientific validity of computational tasks.

Preferred Qualifications and Benefits:
Experience with scientific computing libraries and tools such as NumPy, SciPy, SymPy, mpmath, SageMath, PARI/GP, GAP, Macaulay2, or Mathematica-like environments. Familiarity with ODE/PDE frameworks like FEniCS, Firedrake, DifferentialEquations.jl, or PETSc. Knowledge of optimization frameworks including CVXPY, JuMP, Pyomo, or HiGHS. Exposure to proof assistants such as Lean/mathlib, Coq, Isabelle, or similar. Experience with Docker, Git, continuous integration systems, and automated testing. Background in designing benchmarks, competition problems, or computational evaluations. Experience evaluating AI coding, reasoning, or terminal agents. Involvement in mathematics olympiads or competition problem setting/judging. Contributions to publications or open-source projects in computational mathematics, numerical software, or formalized mathematics. Prior participation in AI training, data generation, or model evaluation initiatives is a plus.

Offer Details:
This is a contractor role requiring a minimum commitment of 40 hours per week, with at least 4 hours overlapping Pacific Standard Time (PST). The assignment is expected to last four weeks, starting as early as next week. Note that this is a contractor position without medical benefits or paid leave.