Turing is a rapidly growing AI company focused on advancing and deploying powerful AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multimodality, multilinguality, and STEM fields. These advancements are then applied to develop real-world AI solutions that address critical business challenges. This role offers the opportunity to work on innovative projects involving the fine-tuning of large language models, leveraging a strong foundation in physics and analytical skills. The ideal candidate will have expertise ranging from advanced engineering entrance concepts to graduate and PhD-level physics, with the ability to clearly deconstruct complex phenomena through step-by-step reasoning. This position involves probing model limitations and utilizing cutting-edge AI tools, providing a pathway to future-proof your career.
Key Responsibilities:
- Problem Creation & Solutioning: Design and solve challenging physics problems that push the limits of large language models.
- Authoring Gold-Standard Data: Develop clear, high-quality, step-by-step solutions with detailed and articulated reasoning.
- Research Collaboration: Partner with LLM researchers to ensure task designs align with evaluation goals, focusing on areas where models face difficulties such as symbolic manipulation, abstraction, and multi-step reasoning.
- Benchmark Definition: Assist in defining and building new evaluation benchmarks covering physics topics from early undergraduate to PhD-level curricula.
Required Qualifications:
- Strong analytical, research, and problem-solving skills combined with excellent English comprehension.
- Exceptional structured written communication skills, capable of providing constructive feedback and detailed annotations in a remote work environment.
- Demonstrated lateral thinking ability to create novel scenarios and assess complex reasoning pathways.
- Self-motivated and able to work independently in a fast-paced, remote-first setting.
- Access to a personal desktop or laptop with a stable, high-speed internet connection.
- Educational background or Doctorate in Physics, Applied Physics, or a related technical discipline.
Preferred Qualifications and Benefits:
- Experience in AI evaluation, data annotation, content review, quality assurance, or similar analytical roles is advantageous but not mandatory.
- Commitment of at least 4 hours per day, up to 40 hours per week, with 4 hours overlapping Pacific Standard Time (PST).
- Engagement type is contractor-based, with a contract length of 12 weeks.
- The evaluation process includes submission of a Job Interest Form for shortlisted candidates, followed by onboarding steps for final selections.
This role offers a unique chance to contribute to setting new standards in AI capabilities within advanced physical sciences, while working remotely with a global team at the forefront of AI innovation.