Strain-Temperature Dual Sensor Based on Deep Learning Strategy for Human-Computer Interaction Systems

ACS Sens. 2024 Aug 23;9(8):4216-4226. doi: 10.1021/acssensors.4c01202. Epub 2024 Jul 28.

Abstract

Thermoelectric (TE) hydrogels, mimicking human skin, possessing temperature and strain sensing capabilities, are well-suited for human-machine interaction interfaces and wearable devices. In this study, a TE hydrogel with high toughness and temperature responsiveness was created using the Hofmeister effect and TE current effect, achieved through the cross-linking of PVA/PAA/carboxymethyl cellulose triple networks. The Hofmeister effect, facilitated by Na+ and SO42- ions coordination, notably increased the hydrogel's tensile strength (800 kPa). Introduction of Fe2+/Fe3+ as redox pairs conferred a high Seebeck coefficient (2.3 mV K-1), thereby enhancing temperature responsiveness. Using this dual-responsive sensor, successful demonstration of a feedback mechanism combining deep learning with a robotic hand was accomplished (with a recognition accuracy of 95.30%), alongside temperature warnings at various levels. It is expected to replace manual work through the control of the manipulator in some high-temperature and high-risk scenarios, thereby improving the safety factor, underscoring the vast potential of TE hydrogel sensors in motion monitoring and human-machine interaction applications.

Keywords: gesture recognition; human–computer interaction system; motion detection; strain-temperature dual sensor; the Hofmeister effect; thermoelectric hydrogels.

MeSH terms

  • Acrylic Resins / chemistry
  • Carboxymethylcellulose Sodium / chemistry
  • Deep Learning*
  • Humans
  • Hydrogels* / chemistry
  • Polyvinyl Alcohol / chemistry
  • Robotics
  • Temperature*
  • Tensile Strength
  • Wearable Electronic Devices*

Substances

  • Hydrogels
  • Acrylic Resins
  • Carboxymethylcellulose Sodium
  • Polyvinyl Alcohol
  • carbopol 940