Touch Sense Projection Map: Human-Machine Interface

Connecting machine and human

Patent Number: 202111281937.7

To recreate the somatosensory function, I used what I learned from cognitive neuroscience about the visual cortex (V1) to build the touch sense projection map (TSPM), which can enable touch sense restoration and many other somatosensory functions. The principle of TSPM is relatively easy. The retina passes information through the lateral geniculate nucleus (LGN) to the V1. Each coordinate in the retina has its specific coordinate in V1. It is like a visual neuro map. This mapping also applies to somatic functions. If we flatten out skin, then put coordinates across the surface, we can pinpoint which location or sequence of locations is being touched in the artificial skin, which is a flexible touch screen. The coordinate change will be reflected as a voltage change. Then we can project those sequences of touch coordinates into a TSPM. The TSPM will stimulate human skin through electric shocks at different locations. We are transferring the tactile information from the missing part to other parts of the body with sensitive skin. TSPM can also be used for drone manipulation by directly transferring motion statuses, such as gravity, speed, and angles, directly to pilots' bodies. I gained support from NYU DURF to fund this project and filed for a patent. This patent of TSPM has passed preliminary review. Later, I improved the resolution of the TSPM and applied it to the prosthetics to develop the Bi-path neuroprosthetics.

Touch Sense Projection Map: Human-Machine Interface

  • Applied for a patent that aim to restore the sense of touch by projecting the voltage change on an artificial skin to the Touch Sense Projection Map, then to the human body

  • Developed for neuro-prosthetics, mainly EMG-based prosthetics where the sense of touch is crucial for force feedback

  • Connected the sense of touch from the virtual world to real life, such as VR (Virtual Reality)

  • Improved unmanned vehicle’s driving experience by allowing operators to feel the exact motion status of the

    unmanned vehicle in high velocity