Abstract
Deep neural networks drive the success of natural language processing. Afundamental property of language is its compositional structure, allowinghumans to systematically produce forms for new meanings. For humans, languageswith more compositional and transparent structures are typically easier tolearn than those with opaque and irregular structures. However, thislearnability advantage has not yet been shown for deep neural networks,limiting their use as models for human language learning. Here, we directlytest how neural networks compare to humans in learning and generalizingdifferent languages that vary in their degree of compositional structure. Weevaluate the memorization and generalization capabilities of a large languagemodel and recurrent neural networks, and show that both deep neural networksexhibit a learnability advantage for more structured linguistic input: neuralnetworks exposed to more compositional languages show more systematicgeneralization, greater agreement between different agents, and greatersimilarity to human learners.