Researchers from the University of Pittsburgh and Carnegie Mellon University have developed a novel fingertip sensor that enhances visual perception through vibration-based feedback. This technology allows operators to sense and interact with the visual environment by detecting edges using a video camera mounted on the finger. The sensor translates visual information into vibrations, providing a tactile sense of touching the visual environment. This innovative approach has potential applications in computer control and haptic feedback systems.
Description
This invention provides the user with the ability to sense visual input and control remote devices via the fingertip. A small image sensor (such as a video camera or a laser range finder) and haptic stimulator (such as a vibrator) mounted on a fingertip provides tactile sensations given certain input to the image sensor. For example, an edge in the visual environment could cause vibration to be felt in the finger when it was pointed at that edge with the proper orientation. This could be used by a visually impaired person to sense doors, tables, etc. An extension of this concept to control could involve special targets that would be recognized by a computer vision system connected to the fingertip camera, such that when the finger was pointed at the target, the control signals could be issued by specific motions of the finger. For example, the target could be a computer screen containing a dot that could be moved by the finger tip, using a control feedback loop to keep the dot in the center of the camera image. Many variations on this basic concept are possible. By providing visual input and sensation to individual fingers, a new intuitive way of sensing and controlling the environment will be possible.
Applications
• Computer control systems
• Haptic feedback devices
• Assistive technology for visually impaired individuals
• Enhanced user interfaces for virtual and augmented reality
Advantages
This technology provides a novel way to visualize and interact with digital environments through tactile feedback. It offers improved control and precision compared to existing finger sensors. The ability to apply the technology to multiple fingertips enhances the user's ability to manipulate and control digital interfaces. The incremental development based on the Sonic Flashlight technology suggests potential for further improvements and refinements.
Invention Readiness
The initial concept of edge detection using a video camera mounted on the finger has been disclosed. The extension of these ideas to control systems based on finger movement is still in development. Further research and development are needed to refine the technology and explore its full potential applications.
IP Status
https://patents.google.com/patent/WO2008112519A1
