Dynamic Narratives for Heritage Tour
We present a dynamic story generation approach for the egocentric videos from the heritage sites. Given a short video clip of a ‘heritage-tour’ our method selects a series of short descriptions from the collection of pre-curated text and create a larger n
- PDF / 4,263,431 Bytes
- 15 Pages / 439.37 x 666.142 pts Page_size
- 15 Downloads / 199 Views
Abstract. We present a dynamic story generation approach for the egocentric videos from the heritage sites. Given a short video clip of a ‘heritage-tour’ our method selects a series of short descriptions from the collection of pre-curated text and create a larger narrative. Unlike in the past, these narratives are not merely monotonic static versions from simple retrievals. We propose a method to generate on the fly dynamic narratives of the tour. The series of the text messages selected are optimised over length, relevance, cohesion and information simultaneously. This results in ‘tour guide’ like narratives which are seasoned and adapted to the participants selection of the tour path. We simultaneously use visual and gps cues for precision localization on the heritage site which is conceptually formulated as a graph. The efficacy of the approach is demonstrated on a heritage site, Golconda Fort, situated in Hyderabad, India. We validate our approach on two hours of data collected over multiple runs across the site for our experiments.
Keywords: Storytelling
1
· Digital heritage · Egocentric perception
Introduction
Heritage sites are the places of interest commemorating people, places or events. These sites could be standalone structures or an agglomeration of multiple structures built across a large area. Spread across the site are the tales describing life and events over the centuries. Such tales are referred to as narratives in our present work. Digitalization and preservation attempts for heritage sites have ranged from methods dealing with restoration [1] to virtual reality based 3D re-constructions [2]. For the first time we attempt enhancing cultural diversity of heritage sites tour via a medium of text narration generation. We propose a method to create contextually aware, richer and multi-facet long descriptions instead of small ‘tags’. Describing an area as “Built in twelfth century, this gate serves as an entrance to the main site. Accompanying eleven other gates, it is most remarkable of all and is located on the eastern...” is far more apt and relevant than a static annotation – ‘Site entrance’. In recent past, we have witnessed an increased interest in the use of computer vision and localization algorithms [3] to create digital representations for each A. Ghosh and Y. Patel—Equal Contribution. c Springer International Publishing Switzerland 2016 G. Hua and H. J´ egou (Eds.): ECCV 2016 Workshops, Part I, LNCS 9913, pp. 856–870, 2016. DOI: 10.1007/978-3-319-46604-0 59
Dynamic Narratives for Heritage Tour
857
Fig. 1. Dynamic Narration generation for tour videos: Narrative generation using both vision cues and gps tags while user walks across the site. Unlike past, the site specific audio narrations are detailed and optimized over the various parameters such as relevance and content.
of the aspects of cultural heritage sites [2,4]. Use of mobile based applications [5] to identify monuments on the fly by taking images have also gained significant traction. Story driven visual localization and summar
Data Loading...
