Towards A Human-in-the-Loop LLM Approach to Collaborative Discourse Analysis

  • 2024-05-06 18:53:33
  • Clayton Cohn, Caitlin Snyder, Justin Montenegro, Gautam Biswas
  • 0

Abstract

LLMs have demonstrated proficiency in contextualizing their outputs usinghuman input, often matching or beating human-level performance on a variety oftasks. However, LLMs have not yet been used to characterize synergisticlearning in students' collaborative discourse. In this exploratory work, wetake a first step towards adopting a human-in-the-loop prompt engineeringapproach with GPT-4-Turbo to summarize and categorize students' synergisticlearning during collaborative discourse. Our preliminary findings suggestGPT-4-Turbo may be able to characterize students' synergistic learning in amanner comparable to humans and that our approach warrants furtherinvestigation.

 

Quick Read (beta)

loading the full paper ...