Abstract
Reinforcement learning algorithms are used in a wide range of applications,from gaming and robotics to autonomous vehicles. In this paper we describe aset of reinforcement learning-based local weight update rules and theirimplementation in superconducting hardware. Using SPICE circuit simulations, weimplement a small-scale neural network with a learning time of order onenanosecond. This network can be trained to learn new functions simply bychanging the target output for a given set of inputs, without the need for anyexternal adjustments to the network. In this implementation the weights areadjusted based on the current state of the overall network response and locallystored information about the previous action. This removes the need to programexplicit weight values in these networks, which is one of the primarychallenges that analog hardware implementations of neural networks face. Theadjustment of weights is based on a global reinforcement signal that obviatesthe need for circuitry to back-propagate errors.