Cornell Researchers Develop AI-Powered Ring for Sign Language Translation

Innovative AI Ring Translates Sign Language Fingerspelling

Researchers at Cornell University have developed a groundbreaking device called SpellRing, an artificial intelligence-powered ring that can translate American Sign Language (ASL) fingerspelling into text in real-time. This innovative wearable technology combines deep learning AI with micro-sonar to track and interpret the intricate finger movements used in ASL fingerspelling 1

1

How SpellRing Works

The SpellRing is a compact, 3D-printed ring worn on the thumb. It contains a microphone and speaker that emit and receive inaudible sound waves to track hand and finger movements. A mini gyroscope is also incorporated to measure hand motions. The data collected is then processed by a proprietary deep-learning algorithm, which predicts ASL fingerspelled letters in real-time 2

2

Accuracy and Testing

The device was evaluated with the help of 20 experienced and novice ASL signers, who fingerspelled over 20,000 words of varying lengths. SpellRing demonstrated an impressive accuracy rate between 82% and 92%, depending on the difficulty of the words 3

3

Potential Impact on Communication

Currently, SpellRing can be used to input text into computers and smartphones via fingerspelling. This functionality is particularly useful for spelling out words without corresponding signs, such as proper nouns, names, and technical terms. The development of SpellRing addresses a significant need in the deaf and hard-of-hearing community, as existing technologies for recognizing fingerspelling have often been too bulky and impractical for everyday use 1

1

Related Stories

AI-Powered Real-Time American Sign Language Interpreter Breaks Communication Barriers

Google's Pixel 11 Introduces Sign Language to Text Translation for 70 Million Deaf Users

AI Breakthrough: New Method Enhances Sign Language Translation Accuracy

Nvidia Launches AI-Powered 'Signs' Platform to Teach American Sign Language

Limitations and Future Development

While SpellRing represents a significant advancement in accessibility technology, it is important to note that it is still in the research phase and not yet a consumer product. Additionally, fingerspelling is only one aspect of American Sign Language, which also incorporates facial expressions, upper body movements, and other physicalities 2

2

The research team, led by doctoral student Hyunchul Lim and assistant professor Cheng Zhang, acknowledges these limitations and plans to expand SpellRing's capabilities. Future work includes integrating the micro-sonar system into eyeglasses to capture upper body movements and facial expressions, aiming for a more comprehensive ASL translation system 3

3

Bridging the Gap Between Technology and Users

The development of SpellRing represents a significant step in bridging the gap between the technical community developing tools and the target community who will use them. By involving experienced and novice ASL signers in the evaluation process, the researchers have ensured that the technology is designed with its end-users in mind 2

2

As research continues and the technology evolves, SpellRing and similar innovations have the potential to revolutionize communication for the deaf and hard-of-hearing community, making interactions more seamless and accessible in various settings.