A real-time multimodal tactile detection system applicable to robots and wearable devices


Dec 22, 2023 (Nanowerk News) A research team led by Research Director Hyuneui Lim of the Nano-Convergence Manufacturing Systems Research Division and Principle Researcher Youngdo Jung of the Department of Nature-Inspired System and Application of the Korea Institute of Machinery and Materials (KIMM), developed a real-time and multimodal tactile perception system capable of providing multi-tactile information in real time inspired by human tactile perception, and announced the outcome of the research in the journal Soft Robotics (“Human-Inspired Tactile Perception System for Real-Time and Multimodal Detection of Tactile Stimuli”). Schematics of the tactile systems. (A) Schematics of the human and artificial tactile systems. (B) Examples of the functions of tactile systems. Schematics of the tactile systems. (A) Schematics of the human and artificial tactile systems. (B) Examples of the functions of tactile systems. (Image: KIMM) The research team developed a real-time and multimodal tactile detection system, by mimicking the principle by which various types of tactile information is perceived by a variety of sensory receptors in the human skin and is transmitted to the brain in real time. This system consists of four three-dimensionally stacked tactile sensors, a signal processing/transmission module, and an analysis module. The system has successfully distinguished various types of tactile stimuli and surface textures and futhermore differenciated complex motion in real time. Four types of tactile sensors, each of which detects temperature, vibration, shear force, and vertical pressure, are laminated in a three-dimensional structure based on three-dimensional (3D) flexible electrode printing process technology. At the same time, these sensors are connected to the FPCB (Flexible Printed Circuit Board) of the electronic module for signal processing and transmission, thereby easily transmitting signal-processed tactile information through the corresponding FPCB connection terminal. Tactile sensors laminated in athree-dimensional structure, and real-time tactile detection system Cutaneous receptors-mimicking sensors. (A) Schematics of the cutaneous receptors and proposed multimodal sensors. (B) Photographs of the 3D integrated sensors connected to the flexible 3D interconnection system. (C) Photograph of the 3D integrated sensors mounted on a robotic finger. The scale bars show 1 cm. (Image: KIMM) In previous studies, complex external measuring devices and analysis equipment were needed in order to detect the signals generated from the corresponding device so that various forms of tactile stimuli could be detected. Therefore, it was difficult to apply these devices to wearable devices or robots in the form of a simple stand-alone system. On the other hand, in the newly developed multimodal tactile perception system, multiple types of tactile sensors are arranged vertically in a three-dimensional structure. Additionally, a module capable of converting, transmitting, and analyzing the signals has also been developed, which allows for the system to be implemented in a compact and simple form and makes it applicable to actual robots and wearable devices. Research Director Hyuneui Lim of the KIMM was quoted as saying, “By mimicking the sensory system of humans, the real-time multimodal tactile perception system is capable of perceiving multiple senses simultaneously. Moreover, it is a technology that has solved the problems that may be caused by complex and large signal processing and detection systems when using conventional sensors.” SHe added, “By applying this system to robots or wearable devices, we will be able to obtain a large volume of diverse and complex tactile signal information, which will hopefully contribute to the improvement of public welfare and security.”

Leave a Reply

Your email address will not be published. Required fields are marked *