Wearable Smart Camera Can Detect Silent Voice Commands

Cornell University researchers have developed a wearable infrared smart cam that can detect voice commands, even when the speaker isn’t making any sound. The camera measures the neck and face starting under the chin.

Silent Speech Detection: The Value of Silent Speech

Cheng Zhang, Cornell University assistant professor of information science, and Ruidong Zhang, Cornell University doctoral student, have created the wearable camera and given it the name “SpeeChin”. It can recognize 54 English and 44 Chinese silent voice commands.

Zhang says voice control is a good option if your hands are busy or you don’t want your smart devices to interact with you. Voice control is not socially acceptable or efficient if you’re in noisy places or in meetings. Silent speech is the solution.

IR Smart Camera for silent speech detection

SpeeChin uses an infrared camera mounted on the neck that captures the movement of the chin. This allows it to detect words even if there is no sound. It is much more discreet than forward-mounted cameras and virtually eliminates privacy concerns.

Low Environments, High Reliability

Gizmodo reported that SpeeChin was tested with 20 students. 10 of them spoke simple phrases, including numbers and common voice assistant commands. 10 also spoke simple words and phrases in Mandarin Chinese. After the logic and camera were trained, it was capable of recognizing commands in English with 90.5% accuracy, and Chinese with 91.6% accuracy.

IR Smart Camera for silent speech detection

However, these high marks could not be achieved if participants were seated stationary. Variations in gait and head movement caused the recognizability of the recognition to drop once they were asked to move. This severely reduces the range of places the SpeeChin device can be used.

This SpeeChin iteration may have a problem with a stationary wearer, but theoretically it is possible to solve this issue by either longer training with the logic, or an improved infrared cam. This early version of the SpeeChin is clearly not mature enough to see any changes in subsequent iterations.

Related Posts

New Crucial P5 Plus SSD is Geared for High Performance

Comments Off on New Crucial P5 Plus SSD is Geared for High Performance

The Best 4K Video Cameras

Comments Off on The Best 4K Video Cameras

Sony FX9 Camera: Hands-On Review

Comments Off on Sony FX9 Camera: Hands-On Review

Rotolight’s New Parabolic Softboxes are a Bit Confusing

Comments Off on Rotolight’s New Parabolic Softboxes are a Bit Confusing

Litepanels’ New LED is Super-Bright Yet Light Enough to Mount on a Drone

Comments Off on Litepanels’ New LED is Super-Bright Yet Light Enough to Mount on a Drone

This is How AP Journalists Sent Photos From the Field in the 1980s

Comments Off on This is How AP Journalists Sent Photos From the Field in the 1980s

StellaPro Reflex Versus Profoto A1X: They Aren’t Interchangeable

Comments Off on StellaPro Reflex Versus Profoto A1X: They Aren’t Interchangeable

DZOFILM Announces New Full-Frame Catta Cinema Zoom Lenses

Comments Off on DZOFILM Announces New Full-Frame Catta Cinema Zoom Lenses

Nikon COOLPIX 300 Retro Review: Perhaps the World Wasn’t Ready for It

Comments Off on Nikon COOLPIX 300 Retro Review: Perhaps the World Wasn’t Ready for It

First Look: Sony Unleashes Pair of Full-Frame Wide-Angle Zoom Lenses

Comments Off on First Look: Sony Unleashes Pair of Full-Frame Wide-Angle Zoom Lenses

Sony Unveils the Xperia Pro-I: First Smartphone with 1-Inch PDAF Sensor

Comments Off on Sony Unveils the Xperia Pro-I: First Smartphone with 1-Inch PDAF Sensor

5 Troubleshooting Tips For Fixing Your Own Computer

Comments Off on 5 Troubleshooting Tips For Fixing Your Own Computer

Create Account



Log In Your Account