Business Analyst (Computer Use Agent)

Turing is a leading company headquartered in San Francisco, dedicated to advancing superintelligence to foster meaningful economic progress. Collaborating with cutting-edge AI labs, Turing specializes in generating high-quality data, evaluations, and reinforcement learning environments that enhance AI model capabilities in coding, reasoning, tool use, and multimodality. Notably, Turing is the largest and longest-running data provider in the coding domain.

The Business Analyst role focuses on a Computer-Using Agent (CUA) evaluation project aimed at assessing and improving AI systems’ abilities to understand instructions, analyze information, reason through problems, and execute tasks within digital environments. This position involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and delivering detailed annotations, ratings, and explanations.

Key Responsibilities:
- Analyze, summarize, and clearly structure complex written content with accuracy.
- Conduct thorough online research to verify claims, sources, and supporting evidence.
- Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
- Develop scenarios and questions designed to evaluate and enhance large language model performance.
- Review AI-generated outputs and provide comprehensive ratings, annotations, explanations, and constructive feedback.

Required Qualifications:
- Excellent English communication and reading comprehension skills.
- Strong analytical, logical, critical, and creative thinking abilities to solve complex problems.
- Ability to identify reliable information and distinguish it from inaccurate or unsupported claims.
- Competence in interpreting data, recognizing patterns, comparing information, and performing basic calculations.
- Capacity to work independently while adhering to detailed instructions, quality standards, and deadlines.

Preferred Qualifications and Benefits:
- Degree holders or candidates pursuing studies in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or related fields are preferred.
- Relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar disciplines is advantageous.
- Candidates without a bachelor’s degree may be considered based on relevant experience and demonstrated skills.
- Familiarity with Excel, Google Sheets, Google Docs, and Google Workspace is desirable.
- Interest in artificial intelligence, large language models, online research, and emerging technologies is a plus.

The selection process includes completing an online assessment via a Google Form, which takes approximately 45-50 minutes. Candidates are encouraged to use a desktop or laptop to complete this assessment promptly for consideration. Successful candidates who pass the internal review of this assessment will move forward in the hiring process.

This opportunity is an hourly, long-term engagement expected to last 16 weeks, with potential for extension. The anticipated start date is around mid-October.