Sensing a Physical Object Gripping using Haptic Technology and Machine Learning Algorithms

This study describes a new method for gripping and sensing a physical object (or material) with a prosthetic arm that uses haptic technologies, kinaesthetic communication, and machine learning. Haptic technology is a method of determining if an object is firm or soft as if it were gripped by a human and determining how much gripping force the object can withstand without crushing it. The bending moment and gripping force are measured using a flex sensor in human fingers and a pressure sensor applied by the tip of the human fingers. Three different types of objects (soft sponge, hard sponge, and plastic) are studied and tested in this work by pressing them with varying gripping pressures (soft, firm, and firmer). In addition, a model (Haptic Intelligence Recorder arm) is proposed that can anticipate the object type and gripping force based on the recorded intelligence data. The major goal is to educate our prosthetic hand to be able to grip various items with varying finger pressures, much like we can do naturally. Finally, a glove is created that is tailored to the intelligence arm’s ability to anticipate grabbing items.