Abstract
Spoken Language Understanding (SLU) models are a core component of voiceassistants (VA), such as Alexa, Bixby, and Google Assistant. In this paper, weintroduce a pipeline designed to extend SLU systems to new languages, utilizingLarge Language Models (LLMs) that we fine-tune for machine translation ofslot-annotated SLU training data. Our approach improved on the MultiATIS++benchmark, a primary multi-language SLU dataset, in the cloud scenario using anmBERT model. Specifically, we saw an improvement in the Overall Accuracymetric: from 53% to 62.18%, compared to the existing state-of-the-art method,Fine and Coarse-grained Multi-Task Learning Framework (FC-MTLF). In theon-device scenario (tiny and not pretrained SLU), our method improved theOverall Accuracy from 5.31% to 22.06% over the baseline Global-LocalContrastive Learning Framework (GL-CLeF) method. Contrary to both FC-MTLF andGL-CLeF, our LLM-based machine translation does not require changes in theproduction architecture of SLU. Additionally, our pipeline is slot-typeindependent: it does not require any slot definitions or examples.