ANALYSIS OF MODERN AUDIO-VISUAL TECHNOLOGY AND HOW IT CAN BE IMPROVED

Authors

  • Alex Khapchenko National Technical University of Ukraine "Kyiv Polytechnic Institute. Igor Sikorsky »
  • Alexander Lysenko National Technical University of Ukraine “Kyiv Polytechnic Institute named after Igor Sikorsky ”

DOI:

https://doi.org/10.18372/2310-5461.52.16378

Keywords:

audio navigation, navigation for the visually impaired, Wayfindr standard, NaviLens technology

Abstract

The WHO estimates that there are now around 2.2 billion visually impaired people worldwide. This includes those with moderate or severe visual impairment or blindness due to uncorrected refractive anomalies (88,4 million), Cataracts (94 million.), Glaucoma (7,7million), Corneal opacity (4,2 million), Diabetic retinopathy (3,9 million), and Trachoma (2 million), and near vision disturbances caused by uncorrected presbyopia of the eye (826 million). However, one of the biggest problems they face is the difficulty they have in navigating independently outside their homes, including on public transport. Having analyzed recent research from the UK, it has been found that almost half of people with visual impairments wish they could move out of their homes more often.

The paper analyzed recent research and publications on modern visually impaired navigation systems. In between GPS navigation, such systems use a variety of beacons based on WiFi, Bluetooth, special pictures, and computer vision. Related applications that can help in the task of creating typhlo-technical solutions are analyzed. Among others, the system stands out created based on the open standard Wayfindr, which provides navigation systems with a single tool to provide visually impaired people with consistent, reliable, and smooth navigation. The results of its experimental testing in city conditions are studied, confirming its performance, efficiency, and compliance with the standard. The structure of the created application was considered and its comparative analysis with alternative technical solution NaviLens which uses special multi-colored pictures resembling QR codes instead of electronic beacons was carried out. It is justified the expansion of functional capabilities of the created audio navigation solutions based on the results of user evaluation and formed vectors for their further improvement

References

Vision Loss Expert Group of the Global Burden of Disease Study. (2020). Causes of blindness and vision impairment in 2020 and trends over 30 years: evaluating the prevalence of avoidable blindness in relation to “VISION 2020: the Right to Sight”. Lancet Global Health. DOI:10.1016/S2214-109X(20)30489-7

Slade J., Edwards R. (2015). MyVoice 2015: The view sandex periences of blindan dpartiall ysightedpeop leinthe UK. London.

Ultracane. Retrieved fromhttps://www. ultracane.com/

Hersh, M. A. Johnson, M. A. (2008). Assistive Technology. Retrieved from https://link. springer. com/book/10.1007/978-1-84628-867-8

Matveev V. (2016). Problem yadaptatsy y usovershen stvovany iazhyloisredydliaslepykh y slabovy diashchy khliudei [Problems of adaptation and improvement of the living environment for blind and partially sighted people]. Teorii ataprakty kadyzainu [Theory and practice of design], 10, 93–101. Kyiv: NAU [in Russian].

Amovil. Retrieved fromhttp://www. amovil.es/en

Riehle T. H., Lichter P., Giudice N. A. (2008). Anindoornavigationsystemtosupportthevisuallyimpaired. // Proceedingsofthe 2008 30th Annual nternational Conferenceofthe IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada. 4435–4438. DOI: 10.1109/IEMBS.2008.4650195

Ahmetovic D., Gleason С ., Ruan С ., Kitani К., Takagi H., Asakawa C. (2016). NavCog: A Navigational Cognitive Assistant for the Blind. 18th International Conferenceon Human-Computer Interaction with Mobile Devicesand Services Florence, Italy, 90–99.

Apostolopoulos I., Fallah N., Folmer E., Bekris, K. E. (2012). Integratedon linelocalization and navigation for people with visualimpairmentsusingsmartphones. // Proceeding sof the International Conferenceon Robotics and Automation, SaintPaul, MN, USA, 1322–1329. DOI: 10.1145/2499669

Abboud S., Hanassy S., Levy-Tzedek S., Maidenbaum S., Amedi A. (2014). EyeMusic: Introducing a “visual” colorful experience for the blindusin gauditory sensorysu bstitution. Restorative Neurology and Neuroscience, 247–257. DOI: 10.1016/j.neubiorev.2013.11.007

Microsoft. Seeing AI. Retrieved from https://www. microsoft.com/en-us/ai/seeing-ai

Cameo Chattin. (2018). A mobile application designedtoimproveclothingchoiceforvisuallyimpairedusers: anapplication of human-centereddesign. A the sissubmittedto the Graduate Council of Texas State University in partialfulfillmentoftherequirementsforthedegreeof Master of FineArtswith a Majorin Communication Design

Artamonov Ye. B., Dluzhevskyi A. O., Panforov O. V. (2016). Pidkhid do rozrobky kompiuternykhsystemnavchanniainvalidivzoru [Approach to the development of computer systems for the visual impairment]. Naukoiemnitekhnolohii, [Science-based technologies], 30, 156–161. (In Ukrainian)

Audio-based in doorandout doorne twor knavigationsystemforpersonswithvisionimpairment. Retrieved fromhttps://www.itu.int/rec/T-REC-F.921-201808-I/en

Real S., Araujo A. (2019). Navigation Systems for the Blind and Visually Impaired: Past Work, Challenges and Open Problems. Sensors. https://doi.org/10.3390/s19153404

NaviLens. Technology for the visually impaired. Retrieved from https://www.navilens.com/

NaviLens — the navigation and labelling app empowering people with sight loss. Retrieved fromhttps://www.rnib.org.uk/sight-loss-advice/technology-and-useful-products/technology-resource-hub-latest-facts-tips-and-guides/technology-guides-everyday-living/navilens

NaviLens — the next generation QR code for a smart and inclusive mobility. Retrieved fromhttps://tomorrow.city/a/navilens-navilens-the-next-generation-qr-code-for-a-smart-and-inclusive

Poliakov A. O., Radchenko K. M. (2017–2018). Aparatno-prohramnyi kompleks navihatsiidlialiudei z invalidnistiuzazorom. Nauko varobotadliauchasti u Vseukrain skomukonkursistudentskykhtanaukovykhrobit z pryrodnychykh, tekhnichnykh i human itarnykhnauk u haluzi «Elektronika» [Hardware and software navigation system for the visually impaired. Scientific work for participation in the All-Ukrainian competition of student and scientific works in natural, technical and human sciences in the field of “Electronics”] Retrieved fromhttp://inel.stu.cn.ua/konkurs/2018/Blind Navigation.pdf Kyiv: NAU (in Ukrainian)

ARCore. Retrieved fromhttps://developer. apple.com/augmented-reality/

ARKit. Retrieved from https://developer. apple.com/augmented-reality/

Indoor Live View. Retrieved fromhttps:// www.google.com/maps/about/partners/indoormaps/

T. V. Kholiavkina, Ya. O. Rezaiev, O. O. Khar¬chenko. (2020). Systema rozpiznavannia zobrazhen z neiromerezhe voiuarkhite kturo iunao snovitekhnolohiihlybynnohonavchannia [Image recognition system with neural network architecture based on deep learning techno¬logy]. Nauko iemni tekhnolohii [Science-based technologies], 50, 101–106. (in Ukrainian)

ArielWesler. (2019). Indoor GPS CouldHelp Visually Impaired Riders Navigate Union Station. Los Angeles. Retrieved fromhttps://spectrumnews1.com/ca/la-west/news/2019/05/08/indoor-gps-could-help-visually-impaired-riders-navigate-union-station

Open Standard forAudio-basedWayfinding. (2018). Retrieved from http://www.wayfindr. net/wp content/uploads/2018/07/Wayfindr-Open-Standard-Rec-2.0.pdf

Spatia Liteis a spatialextension to SQLite, providingvectorgeodatabasefunctionality. Retrieved fromhttps://live.osgeo.org/en/ overview/spatialite_overview.html

GeoJSONis a formatforencoding a varietyofgeographicdatastructures. Retrieved fromhttps://geojson.org/

Published

2021-12-31

Issue

Section

Information technology, cybersecurity