Abstract
Recent progress with LLM-based agents has shown promising results acrossvarious tasks. However, their use in answering questions from knowledge basesremains largely unexplored. Implementing a KBQA system using traditionalmethods is challenging due to the shortage of task-specific training data andthe complexity of creating task-focused model structures. In this paper, wepresent Triad, a unified framework that utilizes an LLM-based agent with threeroles for KBQA tasks. The agent is assigned three roles to tackle differentKBQA subtasks: agent as a generalist for mastering various subtasks, as adecision maker for the selection of candidates, and as an advisor for answeringquestions with knowledge. Our KBQA framework is executed in four phases,involving the collaboration of the agent's multiple roles. We evaluated theperformance of our framework using three benchmark datasets, and the resultsshow that our framework outperforms state-of-the-art systems on the LC-QuAD andYAGO-QA benchmarks, yielding F1 scores of 11.8% and 20.7%, respectively.