Abstract
Recent work using Rank-One Model Editing (ROME), a popular model editingmethod, has shown that there are certain facts that the algorithm is unable toedit without breaking the model. Such edits have previously been calleddisabling edits. These disabling edits cause immediate model collapse andlimits the use of ROME for sequential editing. In this paper, we show thatdisabling edits are an artifact of irregularities in the implementation ofROME. With this paper, we provide a more stable implementation ROME, which wecall r-ROME and show that model collapse is no longer observed when makinglarge scale sequential edits with r-ROME, while further improvinggeneralization and locality of model editing compared to the originalimplementation of ROME. We also provide a detailed mathematical explanation ofthe reason behind disabling edits.