Business Analyst (Computer Use Agent)

Turing is a leading company headquartered in San Francisco, dedicated to advancing superintelligence to foster significant economic progress. Collaborating with cutting-edge AI laboratories, Turing specializes in generating high-quality data, evaluations, and reinforcement learning environments that enhance AI model capabilities in areas such as coding, reasoning, tool use, and multimodality. Notably, Turing stands as the largest and longest-running data provider in the coding category.

The Business Analyst role focuses on a Computer-Using Agent (CUA) evaluation project aimed at assessing and improving AI systems’ ability to comprehend instructions, analyze information, reason through problems, and complete tasks within digital environments. This position involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations.

Key Responsibilities:
- Analyze, summarize, and clearly structure complex written content with accuracy.
- Conduct thorough online research to verify claims, sources, and supporting evidence.
- Solve various analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
- Develop scenarios and questions designed to evaluate and enhance large language model performance.
- Review AI-generated responses and deliver detailed ratings, annotations, explanations, and constructive feedback.

Required Qualifications:
- Strong command of English communication and reading comprehension skills.
- Ability to apply analytical, logical, critical, and creative thinking to solve complex problems effectively.
- Skill in identifying reliable information and distinguishing it from inaccurate or unsupported claims.
- Competence in interpreting data, recognizing patterns, comparing information, and performing basic calculations.
- Capability to work independently while adhering to detailed instructions, quality standards, and deadlines.

Preferred Qualifications and Benefits:
- Candidates holding or pursuing degrees in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or related fields are preferred.
- Relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar disciplines is advantageous.
- Applicants without a bachelor’s degree may also be considered based on relevant experience and demonstrated skills.
- Familiarity with Excel, Google Sheets, Google Docs, and Google Workspace is desirable.
- A strong interest in artificial intelligence, large language models, online research, and emerging technologies is highly valued.

Selection Process:
Candidates are required to complete an online assessment via a Google Form, which takes approximately 45-50 minutes to finish. It is recommended to use a desktop or laptop for this assessment. Prompt completion of the form is necessary to be considered for the role. Successful candidates who pass the internal assessment review will move forward in the selection process.

Project Details:
This is an hourly, long-term engagement expected to last 16 weeks, with potential opportunities for extension. The anticipated start date is around mid-October or nearby dates.

This role offers a unique opportunity to contribute to the advancement of AI capabilities while working with a pioneering company at the forefront of artificial intelligence research and development.