Context Elicitation & Conversation Evaluation Specialists

Turing is a rapidly growing AI company focused on advancing and deploying cutting-edge AI systems. The company collaborates with leading AI labs to push the boundaries of model capabilities in areas such as reasoning, coding, multilingual communication, and STEM knowledge. These advancements are then applied to develop practical AI solutions that address critical business challenges.

We are currently looking for Subject Matter Experts (SMEs) with backgrounds in psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, or related advisory fields. The role involves evaluating AI-driven conversations by reviewing interactions between participants and AI models. SMEs will assess whether the AI gathered sufficient context before making recommendations, identify missed opportunities for clarification, and provide detailed feedback to enhance conversational quality.

Key Responsibilities:
- Review AI conversations that simulate real-world interpersonal and decision-making scenarios.
- Identify gaps in context and suggest relevant follow-up questions to improve understanding.
- Evaluate whether additional information could have influenced the AI’s recommendations.
- Differentiate between critical (“load-bearing”) information and non-essential details.
- Conduct qualitative reviews and document findings using structured evaluation criteria.
- Collaborate closely with research teams to maintain consistency and high standards in assessments.

Required Qualifications:
Candidates must have 3 to 5 years of relevant professional experience and qualifications in one or more of the following areas:

- Social Work: Licensed Social Worker (LCSW, LICSW, LMSW, or equivalent), MSW or graduate-level qualification in Social Work, with experience in client assessment, case review, interviewing, or counseling.
- Counseling and Psychology: MA/MS with counseling licenses such as LMFT, LPC, LCPC, or a PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology. Experience in therapy, psychological assessment, interviewing, or case review is essential.
- Qualitative Research, HCI, or Communication: Advanced degree (MA/PhD) or equivalent expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, or related fields. Experience in qualitative research methods including interviews, conversation analysis, thematic coding, and user research is required.
- Advisory Fields: Professional qualifications or demonstrated expertise in mediation, coaching, student services, organizational consulting, or related advisory roles. Experience in gathering context, understanding client or organizational needs, and providing informed guidance is necessary.
- Candidates must be based in the USA, Canada, or Western Europe.

Preferred Qualifications and Project Details:
- Experience eliciting relevant context when initial client information is incomplete.
- Familiarity with working across diverse domains such as relationships, education, wellbeing, and resource constraints, considering biological, psychological, social, spiritual, financial, and practical factors.
- Ability to distinguish between essential context and descriptive or non-informative details.
- Experience reviewing interviews, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering.

This is a short-term, full-time project lasting approximately three weeks. The engagement follows a pay-per-task model, with an average handling time of about 75 minutes per task. The estimated project start date is October 1st.

This opportunity offers the chance to contribute to pioneering AI research by applying your subject matter expertise to improve AI conversational systems in meaningful, real-world contexts.