Context Elicitation & Conversation Evaluation Specialists

Turing, one of the fastest-growing AI companies globally, is dedicated to advancing and deploying powerful AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multimodality, and multilinguality. These advancements are then applied to develop real-world AI solutions that address critical business challenges.

We are currently seeking Subject Matter Experts (SMEs) with backgrounds in psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, or related advisory fields. The role involves evaluating AI-driven conversations by reviewing interactions between participants and AI models. SMEs will assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to enhance conversational quality.

Key Responsibilities:
- Review AI conversations that simulate real-world interpersonal and everyday decision-making scenarios.
- Identify missing context and suggest relevant follow-up questions to improve understanding.
- Evaluate whether additional information would have influenced the AI’s recommendations.
- Differentiate between critical ("load-bearing") and non-essential information within conversations.
- Conduct qualitative reviews and document findings according to structured evaluation guidelines.
- Collaborate closely with research teams to maintain consistent and high-quality assessments.

Required Qualifications:
Candidates must have 3–5 years of relevant professional experience and qualifications in at least one of the following areas:

- Licensed Social Work: MSW or equivalent graduate-level qualification; LCSW, LICSW, LMSW, or comparable social work license/credential. Experience in client assessment, case review, interviewing, counseling, or related social work practice is essential.
- Counseling, Therapy, or Psychology: MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology. Experience with counseling, therapy, psychological assessment, interviewing, or case review is required.
- Qualitative Research, HCI, or Communication: MA/PhD or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or related disciplines. Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding is necessary.
- Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields: Relevant professional credentials or demonstrated subject-matter expertise with significant direct experience in advisory, client-facing, coaching, mediation, student advising, or organizational consulting roles. Proven ability to gather context, understand individual or organizational needs, and provide informed recommendations is required.
- Candidates must be based in the USA, Canada, or Western Europe.

Preferred Qualifications and Project Details:
- Experience eliciting relevant context when clients initially provide incomplete information.
- Familiarity with working across diverse domains such as relationships, work, education, family, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors.
- Proficiency in qualitative coding or structured case review.
- Ability to distinguish between context that is critical for recommendations and that which is descriptive or non-informative.
- Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering.

Project Details:
- Duration: 3 weeks (short-term project)
- Compensation: Pay-per-task (PPT)
- Average Handling Time (AHT): Approximately 75 minutes per task
- Engagement: Full-time
- Estimated Start Date: October 1 (tentative)

This opportunity offers a chance to contribute to cutting-edge AI research by applying your expertise in human behavior and communication to improve AI conversational systems.