Icon Legend

This session is not in your schedule.

This session is in your schedule. Click again to remove it.

Device Technologies and Biomedical Robotics

Device Technologies and Biomedical Robotics - Poster Session C

Poster I12 - Hidden, wearable, touch-sensing AACs - on-demand communication designed for social anxiety, ASD, selective mutism, and language learners

Friday, October 25, 2024

10:00 AM - 11:00 AM EST

Location: Exhibit Hall E, F & G

Primary Investigator(s)

Nicole H. Urban, PhD (she/her/hers)

Professor
Johnson & Wales University
Portsmouth, Rhode Island, United States

Co-Author(s)

RK

Rileigh Kearney

Undergraduate Student
Johnson & Wales University
Providence, Rhode Island, United States
HS

Hailey Soares

Undergraduate Student
Johnson & Wales University
Providence, Rhode Island, United States
BB

Brian Bleakney

Undergraduate Student
Johnson & Wales University
Providence, Rhode Island, United States
CD

Christopher Dimovski

Undergraduate Student
Johnson & Wales University
Providence, Rhode Island, United States

Presenting Author(s)

KM

Kristen Martinez

Undergraduate Student
Johnson & Wales University
Providence, Rhode Island, United States

Introduction: Augmented and alternative communication devices (AACs) are commonly associated with the hard of hearing or non-verbal individuals with autism spectrum disorder (ASD). This narrow view of the need for AACs, has focused innovation into three main areas: eye-tracking, tablet-style devices, and picture boards. Eye-tracking and tablet-style devices are complex and expensive, and lower cost picture boards are large and contain many individual pieces. Current innovative efforts are incredibly important, yet they leave out millions who need on-demand communication support, including English language learners, individuals experiencing social anxiety disorder or selective mutism, and individuals with ASD who experience challenges with verbal communication. Ten percent of U.S public school children are acquiring English, with thousands experiencing selective mutism during their language acquisition process. There is also a complex overlap in tactile sensing and communication symptoms for individuals experiencing social anxiety, selective mutism and other anxiety disorders. Our communication assistance technologies (CAT) device prototypes are inexpensive and use discrete touch-sensing panels to support users experiencing tactile sensing changes, that are common in anxiety and panic disorders, and small LCD screens integrated into common wearable apparel. The CAT necklace variant incorporates fingertip-sized capacitive touch pads hidden behind decorative elements like jewels or beads, and a screen hidden in a flexible locket. The CAT belt bag variant similarly has touch pads hidden in the bag extension strap for selective use. These technologies allow the user to selectively hide or display the screen and customize the device to their style preferences for discrete, on-demand communication support.

Materials and

Methods: Figures 1-2 show the necklace variation of the CAT AAC. Touch sensitive capacitive textile pads are placed opposite each jewel, and when the user touches the pad (Figure 1) the screen that displays what the individual is trying to communicate. Custom profiles are programmed for each user, Figure 2, with statements appropriate for settings such as the school or office, or for bilingual users. Touch pads are selectively covered with removable jewel designs or other ornamentation, and a locket mechanism made of flexible TPU (not shown) can be customized to the users style preferences and selectively hides or shows the screen. Figures 3-5 show the CAT belt bag variation. This ACC is contained within the belt bad extender, so that it can be completely removed from the bag by just clicking the attachment clasps, so the bag can be used without the device. Figure 3 shows a small LCD screen integrated into the outward facing strap of a belt bag extender that can selectively be hidden from view with a customizable textile cover. The touch pads attached to the interior strap of the belt bag extender, shown in Figure 4-5, are customized to the user’s hand dimensions (Figure 5) and hidden by the exterior belt strap. So, the user would slide their hand in between the straps to touch the pads to elicit their desired text or image on the LCD screen (Figure 4).

Results, Conclusions, and Discussions: Two communication assistance technologies (CAT) device variants are wearable AACs that incorporate hidden capacitive textile pads instead of buttons. Capacitive textile pads eliminate the need to apply pressure or receive haptic feedback from standard buttons, a strategy particularly effective for users with tactile mechanosensory dysfunction, such as users experiencing diabetic neuropathy, or with sensory processing disorders including ASD. Capacitive touch pad arrays are customized for right- and left-handed users, and conformed to hand dimensions regardless of physical deformity. CAT devices operate without sound to increase accessibility for hard-of-hearing or sound-averse users. Users select from multiple profiles, for on-demand communication in various settings. The CAT belt bag variant, built into a belt bag extender, allows selective use of the AAC with any coordinating belt bag, and the CAT necklace variant allows completely customization of the outward-facing portions of the device. These devices integrate into a user’s lifestyle and routine to provide inexpensive, portable, on-demand communication support, thereby filling the unmet communication needs for millions experiencing situational challenges in verbal communication.

Over 4 million individuals in the U.S cannot meet their daily communication needs verbally, and the prevalence of communication disorders increases with age. Additionally, 77% of people experience stress that affects their physical health, and those experiencing an anxiety attack, due to social anxiety disorder, generalized anxiety disorder, or other conditions, experience constriction of their peripheral vasculature and nerve function changes that alters tactile sensing. The AAC device variants described here incorporate capacitive textile pads that do not require pressure to elicit the desired statements to be displayed, and the textile is sensory friendly. The devices are discrete and integrated into common apparel to encourage use and are customizable to support the specific needs for each user.

Future work on the CAT family of AACs includes applying on-demand communication strategies to additional apparel items and developing a simple user interface for simpler programming. Future technical work will also include incorporating liquid resistant touch assemblies and electronics to support those wanting to use a communication support device while working out or commuting in increment weather.

Acknowledgements (Optional): Research reported in this abstract was supported in part by the Institutional Development Award (IDeA) Network for Biomedical Research Excellence from the National Institute of General Medical Sciences of the National Institutes of Health under grant number P20GM103430.