Abstract
Generative Commonsense Reasoning (GCR) requires a model to reason about asituation using commonsense knowledge, while generating coherent sentences.Although the quality of the generated sentences is crucial, the diversity ofthe generation is equally important because it reflects the model's ability touse a range of commonsense knowledge facts. Large Language Models (LLMs) haveshown proficiency in enhancing the generation quality across various tasksthrough in-context learning (ICL) using given examples without the need for anyfine-tuning. However, the diversity aspect in LLM outputs has not beensystematically studied before. To address this, we propose a simple method thatdiversifies the LLM generations, while preserving their quality. Experimentalresults on three benchmark GCR datasets show that our method achieves an idealbalance between the quality and diversity. Moreover, the sentences generated byour proposed method can be used as training data to improve diversity inexisting commonsense generators.