Turing is a rapidly growing AI company focused on advancing and deploying powerful AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multilinguality, STEM, and more. These advancements are then applied to develop real-world AI solutions that address critical business challenges. This role offers the opportunity to work on innovative projects aimed at fine-tuning large language models, leveraging a strong foundation in physics and analytical expertise. The ideal candidate will engage deeply with complex physical phenomena, breaking them down into clear, logical steps while probing model limitations and utilizing cutting-edge AI tools.
Key Responsibilities:
- Problem Creation & Solutioning: Design and solve challenging physics problems that push the limits of large language models.
- Authoring Gold-Standard Data: Develop clear, detailed, and high-quality step-by-step solutions with well-articulated reasoning.
- Research Collaboration: Partner with LLM researchers to align task designs with evaluation objectives, focusing on areas where models face difficulties such as symbolic manipulation, abstraction, and multi-step reasoning.
- Benchmark Definition: Assist in defining and building new evaluation benchmarks covering physics topics from early undergraduate to PhD levels.
Required Qualifications:
- Strong analytical, research, and problem-solving skills with excellent English comprehension.
- Exceptional structured written communication skills, capable of providing constructive feedback and detailed annotations in a remote work environment.
- Ability to think laterally and creatively to construct novel scenarios and evaluate complex reasoning pathways.
- Self-motivated and able to work independently in a fast-paced, remote-first setting.
- Access to a personal desktop or laptop with a stable, high-speed internet connection.
- Educational background or doctorate in Physics, Applied Physics, or an equivalent technical field.
Preferred Qualifications and Benefits:
- Experience in AI evaluation, data annotation, content review, quality assurance, or related analytical roles is preferred but not mandatory.
- Flexible engagement as a contractor for a 12-week period, requiring a commitment of at least 4 hours per day and up to 40 hours per week, with a minimum of 4 hours overlapping with Pacific Standard Time (PST).
- Opportunity to work on frontier AI projects that directly contribute to setting new benchmarks in physical sciences and AI capabilities.
Evaluation Process:
Shortlisted candidates will receive a Job Interest Form. Those selected for final consideration will be contacted with further steps, including onboarding instructions.
This role is ideal for individuals passionate about physics and AI, eager to contribute to groundbreaking advancements while enhancing their expertise in a dynamic, remote environment.