Abstract
Sign languages, often categorised as low-resource languages, face significantchallenges in achieving accurate translation due to the scarcity of parallelannotated datasets. This paper introduces Select and Reorder (S&R), a novelapproach that addresses data scarcity by breaking down the translation processinto two distinct steps: Gloss Selection (GS) and Gloss Reordering (GR). Ourmethod leverages large spoken language models and the substantial lexicaloverlap between source spoken languages and target sign languages to establishan initial alignment. Both steps make use of Non-AutoRegressive (NAR) decodingfor reduced computation and faster inference speeds. Through thisdisentanglement of tasks, we achieve state-of-the-art BLEU and Rouge scores onthe Meine DGS Annotated (mDGS) dataset, demonstrating a substantial BLUE-1improvement of 37.88% in Text to Gloss (T2G) Translation. This innovativeapproach paves the way for more effective translation models for signlanguages, even in resource-constrained settings.