Enhancing augmented reality with cognitive and knowledge perspectives: a case study in museum exhibitions

In this paper, we present our results related to the definition of a methodology that combines augmented reality (AR) with semantic techniques for the creation of digital stories associated with museum exhibitions. In contrast to traditional AR approaches, we augment real-world elements by supplementing contents of a museum exhibition with additional inputs that provide new and different meanings. In this way we augment a cultural resource with respect to both its presentation and meaning. The methodology is framed in the cultural re-mediation theory and is grounded on a set of ontologies aimed at modelling a cultural resource and correlating it with external multimedia objects and resources. To provide an easy tool for the creation of museum narratives, the methodology makes use of a set of recognised practices widely adopted by museum curators that have been formalised through inference rules. The defined methodology has been experimented in a scenario related to Flemish paintings to validate the augmentation of cultural objects with two different approaches, the first basing on similarities and the second on dissimilarities.