Business Analyst (Computer Use Agent)

Turing is a leading company dedicated to advancing superintelligence to foster significant economic progress. Based in San Francisco, Turing collaborates with cutting-edge AI laboratories to produce high-quality data, evaluations, and reinforcement learning environments that enhance AI model capabilities in areas such as coding, reasoning, tool use, and multimodality. Notably, Turing is recognized as the largest and longest-running data provider in the coding category.

The Business Analyst role involves contributing to a Computer-Using Agent (CUA) evaluation project aimed at assessing and improving AI systems’ ability to understand instructions, analyze information, reason through problems, and complete tasks within digital environments. This position requires reviewing AI-generated responses and actions, validating information through online research, assessing the accuracy and completeness of task execution, identifying errors or gaps, and delivering detailed annotations, ratings, and explanations.

Key Responsibilities:
- Analyze, summarize, and clearly structure complex written content with accuracy.
- Conduct thorough online research to verify claims, sources, and supporting evidence.
- Solve a variety of analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
- Develop scenarios and questions designed to evaluate and enhance the performance of large language models.
- Review AI-generated outputs and provide comprehensive ratings, annotations, explanations, and constructive feedback.

Required Qualifications:
- Strong proficiency in English communication and reading comprehension.
- Ability to apply analytical, logical, critical, and creative thinking skills to solve complex problems.
- Capability to identify reliable information and differentiate it from inaccurate or unsupported claims.
- Competence in interpreting data, recognizing patterns, comparing information, and performing basic calculations.
- Ability to work independently while adhering to detailed instructions, quality standards, and deadlines.

Preferred Qualifications and Benefits:
- A degree or ongoing studies in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or related disciplines.
- Relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar fields.
- Candidates without a bachelor’s degree may be considered based on relevant experience and demonstrated skills.
- Familiarity with Excel, Google Sheets, Google Docs, and the Google Workspace environment.
- Interest in artificial intelligence, large language models, online research, and emerging technologies.

The selection process includes completing an assessment via a Google Form, which takes approximately 45-50 minutes and should be done on a desktop or laptop. Prompt completion of this assessment is encouraged to be considered for the opportunity. Candidates who pass the internal review of this assessment will move forward in the hiring process.

This is an hourly, long-term engagement expected to last 16 weeks, with potential for extension. The anticipated start date is around mid-October or nearby dates.