Abstract
Physically realistic materials are pivotal in augmenting the realism of 3Dassets across various applications and lighting conditions. However, existing3D assets and generative models often lack authentic material properties.Manual assignment of materials using graphic software is a tedious andtime-consuming task. In this paper, we exploit advancements in Multimodal LargeLanguage Models (MLLMs), particularly GPT-4V, to present a novel approach,Make-it-Real: 1) We demonstrate that GPT-4V can effectively recognize anddescribe materials, allowing the construction of a detailed material library.2) Utilizing a combination of visual cues and hierarchical text prompts, GPT-4Vprecisely identifies and aligns materials with the corresponding components of3D objects. 3) The correctly matched materials are then meticulously applied asreference for the new SVBRDF material generation according to the originaldiffuse map, significantly enhancing their visual authenticity. Make-it-Realoffers a streamlined integration into the 3D content creation workflow,showcasing its utility as an essential tool for developers of 3D assets.