Abstract
Unsupervised semantic segmentation aims to automatically partition imagesinto semantically meaningful regions by identifying global categories within animage corpus without any form of annotation. Building upon recent advances inself-supervised representation learning, we focus on how to leverage theselarge pre-trained models for the downstream task of unsupervised segmentation.We present PriMaPs - Principal Mask Proposals - decomposing images intosemantically meaningful masks based on their feature representation. Thisallows us to realize unsupervised semantic segmentation by fitting classprototypes to PriMaPs with a stochastic expectation-maximization algorithm,PriMaPs-EM. Despite its conceptual simplicity, PriMaPs-EM leads to competitiveresults across various pre-trained backbone models, including DINO and DINOv2,and across datasets, such as Cityscapes, COCO-Stuff, and Potsdam-3.Importantly, PriMaPs-EM is able to boost results when applied orthogonally tocurrent state-of-the-art unsupervised semantic segmentation pipelines.