Turing, a leading company in AGI infrastructure, partners with cutting-edge AI labs to accelerate model development by providing high-quality training data, evaluations, and engineering expertise. They are currently seeking experts in Physical Sciences to contribute to Terminal Bench Science by developing realistic, terminal-based scientific tasks. This role involves translating authentic workflows from physics, chemistry, materials science, astronomy, and computational science into reproducible benchmark environments. The goal is to help evaluate AI agents' ability to reason through scientific problems, operate command-line tools, debug calculations, and produce reliable scientific results.
Key Responsibilities:
- Design multi-step terminal tasks based on realistic physical science workflows, creating self-contained computational environments with pinned dependencies and scientific software.
- Develop input datasets, molecular structures, simulation parameters, experimental data, or model configurations relevant to the task.
- Implement expert-level solutions using programming languages such as Python, Bash, C/C++, Julia, or other domain-specific tools. These solutions may include simulations, numerical modeling, data fitting, optimization, spectroscopy, molecular analysis, or scientific visualization.
- Create automated tests to verify numerical accuracy, physical consistency, convergence, and output structure. Define appropriate numerical tolerances, units, boundary conditions, and expected scientific behavior for each task.
- Ensure tasks are reproducible and execute successfully without requiring runtime downloads. Troubleshoot and debug issues related to dependencies, numerical precision, solver stability, performance, and file formats.
Required Qualifications:
- Ph.D., postdoctoral experience, or equivalent advanced technical expertise in a relevant physical science discipline such as physics, chemistry, materials science, astronomy, or computational science.
- Strong programming skills in Python, C/C++, Julia, Bash, or other scientific programming languages.
- Experience working in Linux or terminal-based environments.
- Proficiency with numerical methods, scientific modeling, simulations, or quantitative data analysis.
- Ability to independently create and validate computational scientific workflows.
Engagement Details:
This is a contractor role requiring a commitment of at least 6 hours per day and a minimum of 40 hours per week, with a mandatory 4-hour overlap with Pacific Standard Time (PST). The contract duration is 5 weeks, with an expected start date in the upcoming week. Compensation is task-based, with payment of $300 per approved task. Please note that this is a contractor assignment and does not include medical benefits or paid leave.
This opportunity is ideal for physical science professionals who enjoy applying their expertise to develop rigorous scientific benchmarks and contribute to advancing AI capabilities in scientific reasoning and problem-solving.