Abstract
Large Language Models (LLMs) demonstrate strong machine translationcapabilities on languages they are trained on. However, the impact of factorsbeyond training data size on translation performance remains a topic of debate,especially concerning languages not directly encountered during training. Ourstudy delves into Llama2's translation capabilities. By modeling a linearrelationship between linguistic feature distances and machine translationscores, we ask ourselves if there are potentially better central languages forLLMs other than English. Our experiments show that the 7B Llama2 model yieldsabove 10 BLEU when translating into all languages it has seen, which rarelyhappens for languages it has not seen. Most translation improvements intounseen languages come from scaling up the model size rather than instructiontuning or increasing shot count. Furthermore, our correlation analysis revealsthat syntactic similarity is not the only linguistic factor that stronglycorrelates with machine translation scores. Interestingly, we discovered thatunder specific circumstances, some languages (e.g. Swedish, Catalan), despitehaving significantly less training data, exhibit comparable correlation levelsto English. These insights challenge the prevailing landscape of LLMs,suggesting that models centered around languages other than English couldprovide a more efficient foundation for multilingual applications.