Context Elicitation & Conversation Evaluation Specialists

Turing, a rapidly growing leader in AI innovation, partners with top AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multilinguality, and STEM. The company applies these advancements to develop practical AI systems that address critical challenges faced by businesses worldwide.

We are currently looking for Subject Matter Experts (SMEs) with backgrounds in psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, or related advisory fields. In this role, SMEs will evaluate conversations between users and AI models, ensuring that sufficient context is gathered before recommendations are made. They will identify missed opportunities for clarification and provide detailed feedback to enhance the quality of AI-driven conversations.

Key Responsibilities:
- Review AI-generated conversations involving real-life interpersonal and everyday decision-making scenarios.
- Identify gaps in context and suggest relevant follow-up questions to improve understanding.
- Assess whether additional information would have influenced the AI’s recommendations.
- Differentiate between critical ("load-bearing") information and non-essential details.
- Conduct qualitative reviews and document findings according to structured evaluation guidelines.
- Collaborate closely with research teams to maintain consistency and high standards in assessments.

Required Qualifications:
Candidates must have 3 to 5 years of relevant professional experience and qualifications in at least one of the following areas:

- Social Work: Licensed Social Worker (LCSW, LICSW, LMSW) or equivalent credentials; MSW or comparable graduate-level degree; experience with client assessment, case review, interviewing, or counseling.
- Counseling or Psychology: MA/MS with counseling/therapy licenses such as LMFT, LPC, LCPC, or a PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology; experience in psychological assessment, therapy, interviewing, or case review.
- Qualitative Research, HCI, or Communication: Advanced degree (MA/PhD) in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or related fields; experience in qualitative research methods including interviews, conversation analysis, thematic analysis, and coding.
- Mediation, Coaching, Student Services, or Organizational Consulting: Relevant professional credentials or demonstrated expertise; significant experience in advisory or client-facing roles involving context gathering, needs assessment, and providing informed guidance.
- Candidates must be based in the USA, Canada, or Western Europe.

Preferred Qualifications and Project Details:
- Experience eliciting relevant context when initial client information is incomplete.
- Ability to work across diverse domains such as relationships, education, family, wellbeing, and resource constraints, considering biological, psychological, social, spiritual, financial, and practical factors.
- Skilled in qualitative coding or structured case reviews.
- Proven ability to distinguish between essential and non-informative context in recommendations.
- Experience reviewing client interactions like interviews, coaching sessions, or consultations to identify missed opportunities for clarification.

Project Details:
- Duration: Approximately 3 weeks (short-term project)
- Compensation: Pay-per-task (PPT) model
- Average Handling Time (AHT): About 75 minutes per task
- Engagement: Full-time commitment during the project period
- Estimated Start Date: October 1 (subject to change)

This opportunity offers a unique chance to contribute to cutting-edge AI research by applying your expertise in human behavior and communication to improve AI conversational systems.