I am working on this topic and I would like to know whether other researchers performed the same experiments. Videos on past experiments (but not on object recognition) are available on http://www.youtube.com/guidobologna
Hi
Please see these links:
http://www.digitalamedier.bth.se/fou/cuppsats.nsf/all/4137063857095b80c12576d9002ebbbf/$file/A_Smart-Dashboard--Augmenting_safe_%26_smooth_driving__Muhammad_Akhlaq.pdf
The most advanced technology seems to be the system
of Amir Amedi and colleagues. With this device it is
possible for the blind to read.
http://www.newscientist.com/blogs/nstv/2012/11/seeing-with-sound.html
http://medicalxpress.com/news/2012-11-mind-eye-scientists.html
http://www.eurekalert.org/pub_releases/2012-11/cp-ttb110512.php
Older approaches:
http://ibnlive.in.com/news/indian-engineers-modify-microsofts-kinect-to-help-the-blind-walk-with-confidence/227623-11.html
http://phys.org/news/2011-11-football-video.html
http://phys.org/news/2011-03-kinect-augmented-reality.html
http://www.newscientist.com/article/mg20727731.500-sensory-hijack-rewiring-brains-to-see-with-sound.html
http://phys.org/news/2010-10-see-no-shape-touch-hear.html
http://www.news.cornell.edu/releases/Jan05/Wong.software.to.html
http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0020162
Regards,
Joachim
We have done several experiments on visual to auditory sensory substitution (several types of tasks including object recognition) but we have not yet incorporated any neural networks into the system. What do you have in mind? Do you intent to do some intermediate-level classification which the user can incorporate with lower level information to then infer the objects? Or are you thinking of doing high-level classification?
You could try the work by Phil Picton and Mike Capp, University of Northampton who looked at navigation for the blind.
The optophone: an electronic blind aid
M. Capp, P. Picton
Engineering Science and Education Journal 07/2000; DOI:10.1049/esej:20000306
Also Phil has a strong interest in Artificial Neural Networks
"Neural Networks" Phil Picton, Palgrave, ISBN-13: 9780333802878
Hello, thank you for your answers. In our team we are using machine learning models to perform object recognition. In practice, a camera captures images, then an object recognizer tells the user whether an object (cell phone, keys, etc ...) is in the central part of the image. Essentially, we are performing high level classification which is not perfect in accuracy, but seems to be useful to grasp objects lying on a desk. We performed experiments with blind people and the system is functional, but not completely efficient in terms of time to grasp an object.
You could also try the work: Bujacz M., Skulimowski P., Strumillo P., "Naviton — A Prototype Mobility Aid for Auditory Presentation of Three-Dimensional Scenes to the Visually Impaired", Journal of the Audio Engineering Society, vol. 60, no. 9, 2012 September, pp. 696-708. This team is working on analysis of the 3D image and transform it into sound.
Earlier works:
1) Strumillo P., Skulimowski P., Polańczyk M., "Programming Symbian Smartphones for the Blind and Visually Impaired", in E. Kącki, M. Rudnicki, J. Stempczyńska (Eds.): Computers in Medical Activity, Advances in Intelligent and Soft Computing, Springer 2009, pp. 129-136.
2) Strumillo P. "Electronic systems aiding spatial orientation and mobility of the visually impaired",In: Z.S. Hippe, J.L. Kulikowski, Y. Mroczek (Eds.) Human-Computer Systems Interaction. Backgrounds and Applications 2, Springer-Verlag Co., Advances in Soft Computing, 2011, pp. 373-386.
Thanks for your clarification Guido. That sounds very interesting. At the moment, we are concentrating mostly on providing low/intermediate level information. We are trying to maximize the amount of information converted whilst simultaneously maximizing interpretability. I have always assumed we would not be able to achieve high-level information with sufficient accuracy, speed and breadth. I'm glad to hear that your team is trying to address this gap.
- Badges
- Science topic