Abstract
Numerous online services are data-driven: the behavior of users affects thesystem's parameters, and the system's parameters affect the users' experienceof the service, which in turn affects the way users may interact with thesystem. For example, people may choose to use a service only for tasks thatalready works well, or they may choose to switch to a different service. Theseadaptations influence the ability of a system to learn about a population ofusers and tasks in order to improve its performance broadly. In this work, weanalyze a class of such dynamics -- where users allocate their participationamongst services to reduce the individual risk they experience, and servicesupdate their model parameters to reduce the service's risk on their currentuser population. We refer to these dynamics as \emph{risk-reducing}, whichcover a broad class of common model updates including gradient descent andmultiplicative weights. For this general class of dynamics, we show thatasymptotically stable equilibria are always segmented, with sub-populationsallocated to a single learner. Under mild assumptions, the utilitarian socialoptimum is a stable equilibrium. In contrast to previous work, which shows thatrepeated risk minimization can result in (Hashimoto et al., 2018; Miller etal., 2021), we find that repeated myopic updates with multiple learners lead tobetter outcomes. We illustrate the phenomena via a simulated exampleinitialized from real data.