Fingertip Sensor for Enhanced Visual Perception and Control
Researchers from the University of Pittsburgh and Carnegie Mellon University have developed a novel fingertip sensor that enhances visual perception through vibration-based feedback. This technology allows operators to sense and interact with the visual environment by detecting edges using a video camera mounted on the finger. The sensor translates visual information into vibrations, providing a tactile sense of touching the visual environment. This innovative approach has potential applications in computer control and haptic feedback systems.
Description
This invention provides the user with the ability to sense visual input and control remote devices via the fingertip. A small image sensor (such as a video camera or a laser range finder) and haptic stimulator (such as a vibrator) mounted on a fingertip provides tactile sensations given certain input to the image sensor. For example, an edge in the visual environment could cause vibration to be felt in the finger when it was pointed at that edge with the proper orientation. This could be used by a visually impaired person to sense doors, tables, etc. An extension of this concept to control could involve special targets that would be recognized by a computer vision system connected to the fingertip camera, such that when the finger was pointed at the target, the control signals could be issued by specific motions of the finger. For example, the target could be a computer screen containing a dot that could be moved by the finger tip, using a control feedback loop to keep the dot in the center of the camera image. Many variations on this basic concept are possible. By providing visual input and sensation to individual fingers, a new intuitive way of sensing and controlling the environment will be possible.Applications
• Computer control systems• Haptic feedback devices
• Assistive technology for visually impaired individuals
• Enhanced user interfaces for virtual and augmented reality