DEEM: Dynamic Experienced Expert Modeling for Stance Detection

  • 2024-04-25 06:32:49
  • Xiaolong Wang, Yile Wang, Sijie Cheng, Peng Li, Yang Liu
  • 0

Abstract

Recent work has made a preliminary attempt to use large language models(LLMs) to solve the stance detection task, showing promising results. However,considering that stance detection usually requires detailed backgroundknowledge, the vanilla reasoning method may neglect the domain knowledge tomake a professional and accurate analysis. Thus, there is still room forimprovement of LLMs reasoning, especially in leveraging the generationcapability of LLMs to simulate specific experts (i.e., multi-agents) to detectthe stance. In this paper, different from existing multi-agent works thatrequire detailed descriptions and use fixed experts, we propose a DynamicExperienced Expert Modeling (DEEM) method which can leverage the generatedexperienced experts and let LLMs reason in a semi-parametric way, making theexperts more generalizable and reliable. Experimental results demonstrate thatDEEM consistently achieves the best results on three standard benchmarks,outperforms methods with self-consistency reasoning, and reduces the bias ofLLMs.

 

Quick Read (beta)

loading the full paper ...