Localization of Visitors for Cultural Sites Management

We consider the problem of localizing visitors in a museum from egocentric (first person) images. Localization information can be useful to both assist the user during his visit (e.g., by suggesting where to go and what to see next) and to provide behavioral information to the manager of the museum (e.g., how much time has been spent by visitors at a given location?). To address the problem, we have considered a dataset of egocentric videos acquired using two cameras: a head-mounted HoloLens and a chest-mounted GoPro. We performed experiments exploiting a state-of-the-art method for room-based temporal segmentation of egocentric videos. Experiments pointed out that compelling information can be extracted to serve both the visitors and the site-manager. A web interface has been developed to provide a tool useful to manage the cultural site and to perform analysis of the videos acquired by visitors. Also a digital summary is generated as additional service for the visitors providing “sh arable” memories of their experience.