Mobile AI Audio Guide for Blind People Navigation

An AI-powered navigation app is transforming daily mobility for people who are visually impaired. By providing real-time audio descriptions of nearby shops, obstacles, traffic lights, vehicles, and pedestrians, the app offers a level of environmental awareness that traditional tools such as white canes, tactile paving, and audible signals cannot fully guarantee especially as quiet hybrid cars and reduced nighttime sound signals make navigation more challenging. Users report feeling safer, more independent, and more confident, even when traveling unfamiliar routes or returning home late at night.

The app was developed by a Japanese technology company that created an AI model trained to recognize key road features and guide users through voice instructions. Released in 2023 and downloaded tens of thousands of times, the app offers free core features such as route guidance and obstacle detection. Challenges remain such as difficulty detecting downward steps and GPS errors in dense urban environments, but the developers plan to continue improving accuracy and expanding functionality to support greater mobility and quality of life for visually impaired users.

More information:

https://www.asahi.com/ajw/articles/16120141

Mice's Motion Sensors Could Spy Users

A group of researchers from the University of California, Irvine, have developed a way to use the sensors in high-quality optical mice to capture subtle vibrations and convert them into audible data. The high polling rate and sensitivity of high-performance optical mice pick up acoustic vibrations from the surface where they sit.

By running the raw data through signal processing and machine learning techniques, the team could hear what the user was saying through their desk. Mouse sensors with a 20,000 DPI or higher are vulnerable to this attack. And with the best gaming mice becoming more affordable annually, even relatively affordable peripherals are at risk.

More information:

https://www.tomshardware.com/tech-industry/cyber-security/high-performance-mice-can-be-used-as-a-microphone-to-spy-on-users-thanks-to-ai-mic-e-mouse-technique-uses-mouse-sensors-to-convert-acoustic-vibrations-into-speech

Smartphone Audio Guide for Visual Impaired

Tactile paving for people with visual impairments in Japan has recently been enhanced with audio guidance, as the developers of the technology aim to improve the lives of people with partial sight and assist sighted tourists. The new braille blocks are marked with black stickers in special patterns. By scanning the coded blocks with a smartphone camera and app, users can listen to audio information about the location and its surroundings. The system was jointly developed by the laboratory of Kanazawa Institute of Technology and Tokyo-based W&M systems LLC.

Those behind the technology hope it can also be made available to tourists and foreigners as they walk the streets of Japan, whether they are sighted or not. The special braille blocks were first introduced in Kanazawa, central Japan, in 2019 and have since been installed in other areas, appearing at train stations, pedestrian streets and public offices in 10 prefectures, including Tokyo and Osaka, as of April. The developers plan to make the system available in multiple languages and are considering enabling it to answer questions by incorporating generative artificial intelligence capabilities.

More information:

https://japantoday.com/category/national/speaking-tactile-sidewalks-enrich-lives-of-visually-impaired

Best Song to Reduce Anxiety

Neuroscientists from the UK have specified which tunes give you the most bang for your musical buck. The study was conducted on participants who attempted to solve difficult puzzles as quickly as possible while connected to sensors. The puzzles induced a certain level of stress, and participants listened to different songs while researchers measured brain activity as well as physiological states that included heart rate, blood pressure, and rate of breathing.

The top song called "Weightless" produced a greater state of relaxation than any other music tested to date. It resulted in a 65% reduction in participants' overall anxiety, and a 35% reduction in their usual physiological resting rates. The group that created "Weightless", did so in collaboration with sound therapists. Its carefully arranged harmonies, rhythms, and bass lines help slow a listener's heart rate, reduce blood pressure, and lower levels of the stress hormone cortisol.

More information:

https://www.inc.com/melanie-curtin/neuroscience-says-listening-to-this-one-song-reduces-anxiety-by-up-to-65-percent.html

Optical Microphone Sees Sound Vibrations Reconstructing Music

A camera system developed by Carnegie Mellon University researchers can see sound vibrations with such precision and detail that it can reconstruct the music of a single instrument in a band or orchestra. Even the most high-powered and directed microphones can't eliminate nearby sounds, ambient noise and the effect of acoustics when they capture audio. The novel system developed in the School of Computer Science's Robotics Institute (RI) uses two cameras and a laser to sense high-speed, low-amplitude surface vibrations. These vibrations can be used to reconstruct sound, capturing isolated audio without inference or a microphone. The team completed several successful demos of their system's effectiveness and the quality of the sound reconstruction.

The CMU system dramatically improves upon past attempts to capture sound using computer vision. The team's work uses ordinary cameras that cost a fraction of the high-speed versions employed in past research while producing a higher quality recording. The dual-camera system can capture vibrations from objects in motion, such as the movements of a guitar while a musician plays it, and simultaneously sense individual sounds from multiple points. The system works by analyzing the differences in speckle patterns from images captured with a rolling shutter and a global shutter. An algorithm computes the difference in the speckle patterns from the two video streams and converts those differences into vibrations to reconstruct the sound.

More information:

https://techxplore.com/news/2022-06-newly-optical-microphone.html

Facebook Voice Commands for Oculus Quest 2

Facebook announced Voice Commands for the Oculus Quest last year. The original version, however, proved to be inconvenient. In order to access voice commands, you had to manually select the tool from the Oculus menu each and every time you wished to use it. This new update streamlines the process, allowing you to activate voice commands by saying the phrase ‘Hey Facebook’, followed by a specific command.

Facebook knows that users are going to have concerns, which is why ‘Hey Facebook’ is strictly an opt-in experience. You’ll still be able to use Voice Commands without having to say the wake word. To do that, you just use your controller or hand tracking to navigate to the home menu and then to the Experimental Features panel. From there you can then turn off the ‘Hey Facebook’ feature, giving you a little peace of mind.

More information:

https://vrscout.com/news/hey-facebook-voice-commands-oculus-quest/