Context Elicitation & Conversation Evaluation Specialists

Turing is a rapidly growing AI company focused on advancing and deploying powerful AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multilinguality, and STEM. These advancements are then applied to create real-world AI solutions that address critical business challenges.

We are currently looking for Subject Matter Experts (SMEs) with backgrounds in psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, or related advisory fields. The role involves evaluating AI-driven conversations by reviewing interactions between participants and AI models. SMEs will assess if sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to enhance conversational quality.

Key Responsibilities:
- Review AI conversations that simulate real-world interpersonal and everyday decision-making scenarios.
- Identify gaps in context and suggest relevant follow-up questions.
- Evaluate whether additional information would have influenced the AI’s recommendations.
- Differentiate between critical ("load-bearing") information and non-essential details.
- Conduct qualitative reviews and document findings following structured evaluation guidelines.
- Collaborate closely with research teams to maintain consistent and high-quality assessments.

Required Qualifications:
Candidates must have 3 to 5 years of relevant professional experience and qualifications in one or more of the following areas:

- Social Work: Licensed Social Worker with MSW or equivalent graduate-level qualification. Credentials such as LCSW, LICSW, LMSW, or similar are required. Experience in client assessment, case review, interviewing, or counseling is essential.
- Counseling or Psychology: MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology. Experience in counseling, therapy, psychological assessment, interviewing, or case review is necessary.
- Qualitative Research, HCI, or Communication: Advanced degree (MA/PhD) or equivalent expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or related fields. Experience in qualitative research methods such as interviews, conversation analysis, thematic analysis, or qualitative coding is required.
- Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields: Relevant professional qualifications or demonstrated subject-matter expertise with significant direct experience in advisory roles, coaching, mediation, student advising, or organizational consulting. Experience in gathering context, understanding needs, and providing informed recommendations is important.
- Candidates must be based in the USA, Canada, or Western Europe.

Preferred Qualifications and Project Details:
- Experience eliciting relevant context when clients provide incomplete information initially.
- Ability to work across diverse domains such as relationships, education, family, wellbeing, and resource constraints, considering biological, psychological, social, spiritual, financial, and practical factors.
- Skilled in qualitative coding or structured case review.
- Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering.

Project Details:
- Duration: 3 weeks (short-term project)
- Compensation: Pay-per-task (PPT)
- Average Handling Time (AHT): Approximately 75 minutes per task
- Engagement: Full-time
- Estimated Start Date: October 1 (tentative)

This opportunity offers a chance to contribute to cutting-edge AI research by applying your expertise in human-centered fields to improve AI conversational systems.