A Methodological Approach for Unveiling the Evolution of Frescoes Through a Virtual Reality

Virtual Reality (VR) technologies offer a breakthrough in over coming architectural barriers, enabling users to visualize and interact with otherwise inaccessible places. This paper explores the application of VR, particularly in the context of Matera Sassi’s rock churches. Due to the irregular structure of the site, traditional exploration methods pose challenges, especially for individuals with motor disabilities. Using the Unreal Engine 5.2 game engine and digital photogrammetry, we reconstruct and explore 3D models of rock churches, focusing on fresco details for high-quality mesh generation. To enhance realism, we incorporate virtual avatars of real experts using motion capture systems for life like animations. Furthermore, our application supports remote, real-time user interactions, enabling immersive experiences via Head Mounted Displays (HMDs) such as the HTC Vive Focus 3. To assess this application, user studies with specialists were conducted to gather feedback on usability and sentiment, demonstrating the potential of VR in promoting accessibility and cultural heritage analysis.