Abstract
The reconstruction of images observed by subjects from fMRI data collectedduring visual stimuli has made significant strides in the past decade, thanksto the availability of extensive fMRI datasets and advancements in generativemodels for image generation. However, the application of visual reconstructionhas remained limited. Reconstructing visual imagination presents a greaterchallenge, with potentially revolutionary applications ranging from aidingindividuals with disabilities to verifying witness accounts in court. Theprimary hurdles in this field are the absence of data collection protocols forvisual imagery and the lack of datasets on the subject. Traditionally,fMRI-to-image relies on data collected from subjects exposed to visual stimuli,which poses issues for generating visual imagery based on the difference ofbrain activity between visual stimulation and visual imagery. For the firsttime, we have compiled a substantial dataset (around 6h of scans) on visualimagery along with a proposed data collection protocol. We then train amodified version of an fMRI-to-image model and demonstrate the feasibility ofreconstructing images from two modes of imagination: from memory and from pureimagination. This marks an important step towards creating a technology thatallow direct reconstruction of visual imagery.