Human-machine interfaces: Smart gloves
In my final two years of PhD, I managed multidisciplinary teams of engineers to spearheaded our laboratory's highly applied research thrust into the field of wearable electronics, cybernetics, and human-machine interfaces. This research started with the development of a smart glove to translate American Sign Language (ASL). I used the knowledge gained from the first project to design a fully integrated human-machine system comprising an instrumented smart glove filled with sensors and actuators and a 3D printed robotic hand/virtual reality uplink. I managed a team of five stellar electrical engineering seniors to help me take the project from concept to finished prototype in less than 10 weeks.
The Language of Glove: Sign language decoding "smart" glove
Using our stretchable strain sensors and open source electronics, we have designed a smart glove capable of gesture recognition and sign language translation. This glove combined stretchable electronics, nanomaterials, open source electronics, wireless communication, and custom printed circuit board. The prototype smart glove can translate the entire ASL alphabet and was then used to control a virtual hand. As always, cost was considered from the onset of the project and the prototype can be built for less than $100 of materials.
The Transmission of Touch: Touch emulator for robotics and virtual reality
Building upon the "Language of Glove" prototype, this smart glove emulates and transmits the sensations of touch and proprioception. The wearer of the glove can control the grip of a 3D printed robot hand. The palm of the hand is decorated with temperature and pressure sensors, which relay touch and temp information wirelessly back to the glove via low-energy bluetooth. Finally, the touch information is used to control actuators on the palm of the glove, sending the sensations of touch into the wearers hand. This project has applications in human-robotic interfaces and virtual reality. Perhaps one day we will feel virtual reality and be able to store our memories in sight, sound, and touch. This was my favorite non-solar project, where I managed a team of amazing electrical engineers to build the entire system in under 10 weeks. This project is currently under development and the details are not yet available.