Abstract
One of the most widely used approaches in continual learning is referred toas replay. Replay methods support interleaved learning by storing pastexperiences in a replay buffer. Although there are methods for selectivelyconstructing the buffer and reprocessing its contents, there is limitedexploration of the problem of selectively retrieving samples from the buffer.Current solutions have been tested in limited settings and, more importantly,in isolation. Existing work has also not explored the impact of duplicatereplays on performance. In this work, we propose a framework for evaluatingselective retrieval strategies, categorized by simple, independent class- andsample-selective primitives. We evaluated several combinations of existingstrategies for selective retrieval and present their performances. Furthermore,we propose a set of strategies to prevent duplicate replays and explore whethernew samples with low loss values can be learned without replay. In an effort tomatch our problem setting to a realistic continual learning pipeline, werestrict our experiments to a setting involving a large, pre-trained, openvocabulary object detection model, which is fully fine-tuned on a sequence of15 datasets.