Business Analyst (Computer Use Agent)

Turing is a San Francisco-based company dedicated to accelerating superintelligence to foster real economic progress. Collaborating with leading AI labs, Turing generates high-quality data, evaluations, and reinforcement learning environments to enhance AI model capabilities in coding, reasoning, tool use, and multimodality. Notably, Turing is the largest and longest-running data provider in the coding domain. The Business Analyst role focuses on a Computer-Using Agent (CUA) evaluation project aimed at improving AI systems’ ability to understand instructions, analyze information, reason through problems, and complete digital tasks. This position involves reviewing AI-generated outputs, validating information through research, assessing accuracy, identifying errors, and providing detailed annotations and feedback.

Key Responsibilities:
- Analyze, summarize, and organize complex written content with clarity and accuracy.
- Conduct thorough online research to verify claims, sources, and supporting evidence.
- Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based problems.
- Develop scenarios and questions to evaluate and enhance large language model performance.
- Review AI-generated responses and provide comprehensive ratings, annotations, explanations, and constructive feedback.

Required Qualifications:
- Strong English communication skills, including excellent reading comprehension.
- Ability to apply analytical, logical, critical, and creative thinking to solve complex problems.
- Skill in identifying reliable information and distinguishing it from inaccurate or unsupported claims.
- Proficiency in interpreting data, recognizing patterns, comparing information, and performing basic calculations.
- Capacity to work independently while adhering to detailed instructions, quality standards, and deadlines.

Preferred Qualifications and Benefits:
- Degree holders or candidates pursuing degrees in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or related fields are preferred.
- Relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar disciplines is advantageous.
- Candidates without a bachelor’s degree may be considered based on relevant experience and demonstrated skills.
- Familiarity with Excel, Google Sheets, Google Docs, and Google Workspace is desirable.
- Interest in artificial intelligence, large language models, online research, and emerging technologies is highly valued.

Selection Process:
Applicants are required to complete an online assessment via a Google Form, which takes approximately 45-50 minutes and should be done using a desktop or laptop. Prompt completion of this assessment is necessary for consideration. Candidates who successfully pass the internal review of the assessment will move forward in the selection process.

Project Details:
This is an hourly, long-term engagement expected to last 16 weeks, with potential for extension. The anticipated start date is around mid-October.

This opportunity offers a chance to contribute to cutting-edge AI evaluation projects within a dynamic and innovative environment.