Abstract
State-of-the-art neurosymbolic learning systems use probabilistic reasoningto guide neural networks towards predictions that conform to logicalconstraints over symbols. Many such systems assume that the probabilities ofthe considered symbols are conditionally independent given the input tosimplify learning and reasoning. We study and criticise this assumption,highlighting how it can hinder optimisation and prevent uncertaintyquantification. We prove that loss functions bias conditionally independentneural networks to become overconfident in their predictions. As a result, theyare unable to represent uncertainty over multiple valid options. Furthermore,we prove that these loss functions are difficult to optimise: they arenon-convex, and their minima are usually highly disconnected. Our theoreticalanalysis gives the foundation for replacing the conditional independenceassumption and designing more expressive neurosymbolic probabilistic models.