Turing is a rapidly growing AI company focused on advancing and deploying powerful AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multimodality, multilinguality, STEM, and frontier knowledge. These advancements are then applied to create real-world AI solutions that address critical business challenges. This role offers an exciting opportunity to work on fine-tuning large language models by applying deep analytical skills and a strong foundation in physics. Candidates will engage in breaking down complex physical phenomena into clear, step-by-step reasoning, directly contributing to identifying model limitations and leveraging cutting-edge AI tools to enhance their expertise.
Key Responsibilities:
- Problem Creation & Solutioning: Design and solve challenging physics problems that push the limits of large language models.
- Authoring Gold-Standard Data: Develop clear, high-quality, step-by-step solutions with detailed and well-articulated reasoning.
- Research Collaboration: Partner with LLM researchers to align task designs with evaluation goals, focusing on areas where models typically struggle, such as symbolic manipulation, abstraction, and multi-step reasoning.
- Benchmark Definition: Assist in defining and building new evaluation benchmarks covering physics topics from early undergraduate to PhD-level curricula.
Required Qualifications:
- Strong analytical, research, and problem-solving skills with excellent English comprehension.
- Exceptional written communication skills, capable of providing structured, constructive feedback and detailed annotations in a remote work environment.
- Ability to think laterally and creatively to construct novel scenarios and evaluate complex reasoning pathways.
- Self-motivated and able to work independently in a fast-paced, remote-first setting.
- Access to a personal desktop or laptop with a stable, high-speed internet connection.
- Educational background or Doctorate in Physics, Applied Physics, or a closely related technical field.
Preferred Qualifications and Benefits:
- Experience in AI evaluation, data annotation, content review, quality assurance, or related analytical roles is advantageous but not mandatory.
- The role requires a commitment of at least 4 hours per day, up to 40 hours per week, with a minimum of 4 hours overlapping with Pacific Standard Time (PST).
- Engagement is on a contractor basis for a duration of 12 weeks.
- Candidates shortlisted will be invited to complete a Job Interest Form, with selected applicants progressing to onboarding and further steps.
This position offers a unique chance to contribute to setting new standards in AI capabilities within the physical sciences, while advancing your career in a cutting-edge, remote work environment.