Turing, a rapidly growing AI company, is advancing the development and deployment of powerful AI systems by collaborating with leading AI labs and building real-world solutions that address critical business challenges. The company focuses on frontier capabilities such as reasoning, coding, multimodality, and STEM knowledge to create impactful AI technologies.
We are looking for an experienced Mathematics expert to lead a team of 5–10 trainers in developing realistic, terminal-based scientific and technical tasks for Terminal Bench Science. This role involves reviewing tasks for mathematical accuracy, reproducibility, and challenge level, while mentoring trainers and managing quality and throughput. The position covers a broad range of areas including numerical and applied mathematics, scientific computing, optimization, statistics, mathematical modeling, computational algebra, and formal verification.
Key Responsibilities:
- Review tasks comprehensively, including problem statements, datasets, environments, reference solutions, and automated tests.
- Verify mathematical correctness, well-posedness, convergence, stability, conditioning, discretization error, and edge-case handling.
- Ensure tasks demand genuine multi-step reasoning rather than simple lookups or single library calls.
- Validate the appropriate use of exact, symbolic, arbitrary-precision, or floating-point computations.
- Confirm that numerical tolerances align with the problem’s conditioning.
- Design and review graders based on mathematical properties such as residuals, feasibility, optimality certificates, invariants, error bounds, or proof checking.
- Guarantee reproducibility through pinned tools, libraries, solver versions, and dependencies.
- Detect and prevent hard-coded solutions, test-file leakage, and other bypass methods.
- Provide precise, actionable feedback and track trainer revisions to completion.
- Mentor and onboard trainers on mathematical rigor, task design, coding standards, and evaluation criteria.
- Allocate work, monitor quality and throughput, and escalate blockers as needed.
- Maintain pod documentation including guidelines, recurring issues, and exemplary tasks.
- Collaborate with the Mathematics Team Lead and other stakeholders to enhance benchmark quality.
Required Qualifications:
- Ph.D., postdoctoral experience, or equivalent advanced expertise in mathematics, applied mathematics, statistics, or a related discipline.
- Strong programming skills in Python, Julia, C/C++, MATLAB/Octave, or computer algebra systems.
- Proficiency with Linux and terminal environments.
- Hands-on experience with numerical methods, scientific computing, symbolic computation, optimization, computational statistics, or mathematical modeling.
- Ability to rigorously evaluate mathematical derivations, algorithms, proofs, and computational outcomes.
- Experience reviewing research outputs, code, mathematical work, or scientific workflows.
- Proven experience mentoring or leading small technical or research teams.
- Excellent written communication skills with the ability to provide clear, constructive feedback.
- Capability to assess reproducibility, test reliability, and scientific validity of computational tasks.
Preferred Qualifications and Additional Information:
- Familiarity with tools such as NumPy, SciPy, SymPy, mpmath, SageMath, PARI/GP, GAP, Macaulay2, or Mathematica-like workflows.
- Experience with ODE/PDE frameworks like FEniCS, Firedrake, DifferentialEquations.jl, or PETSc.
- Knowledge of optimization frameworks including CVXPY, JuMP, Pyomo, or HiGHS.
- Exposure to proof assistants such as Lean/mathlib, Coq/Rocq, or Isabelle.
- Experience with Docker, Git, continuous integration systems, and automated testing.
- Background in designing benchmarks, competition problems, or computational evaluations.
- Experience evaluating AI coding, reasoning, or terminal agents.
- Involvement in setting or judging mathematics olympiad or competition problems.
- Publications or open-source contributions in computational mathematics, numerical software, or formalized mathematics.
- Prior participation in AI training, data generation, or model evaluation programs.
Offer Details:
- Commitment of at least 4 hours per day and a minimum of 40 hours per week, with a 4-hour overlap with Pacific Standard Time (PST).
- Contractor assignment with no medical or paid leave benefits.
- Contract duration of 4 weeks, with an expected start date in the upcoming week.
This role offers a unique opportunity to contribute to cutting-edge AI research and development by applying deep mathematical expertise in a collaborative and innovative environment.