Computer vision and augmented reality to improve information availability at tourist attractions

Arias-Figueroa K.A.; Criado-Huaylla L.L.; Ibarra-Cabrera M.J.; Aguirre-Carrasco J.A.; Quispe-Merma R.R.; Ibarra-Cabrera E.M. · CISCI - Conferencia Iberoamericana en Sistemas, Cibernetica e Informatica (2024) · DOI: 10.54808/cisci2024.01.375

Resumen

In this research, the Augmented Reality and Computer Vision approach was used to improve the availability of information about Machu Picchu in the city of Cusco and four tourist sites in the city of Abancay, both located in Peru. The methodology to develop an Augmented Reality (AR) mobile application integrated with computer vision for tourist sites included several stages; first, images of the five tourist sites were collected, which were then selected and labeled using labelImg software for training a neural network; then the training environment was prepared using YOLOv7, and the neural network was trained with the labeled images. Subsequently, a RESTful API for object recognition was developed, recognition tests were performed, and an informative database with tourist details was created. Finally, AR was implemented in Android for cell phones, allowing the display of information superimposed on the images captured by users. The main difference of this proposal is that the additional information to the real world can be text, audio or video, so that it integrates computer vision and Augmented Reality to improve the tourist experience when superimposing digital elements in the real environment. © CISCI - Simposium Iberoamericano en Educacion, Cibernetica e Informatica 2024.

Instituciones: Universidad Nacional de San Antonio Abad del Cusco; Universidad Nacional Micaela Bastidas de Apurímac