Skip navigation

IBM avatar turns words into sign language

Technology could be used in real life when interpreters aren't around

  Tech Holiday Gift Guide  
  More
Holiday Retail
When spouses collide: His and hers gadgets
Your tech dream may be your significant other's nightmare. Here are the items our married tech experts drool over (while belittling one another's choices).

  Real Women’s Guide to Technology

An MSN special that focuses on consumer technologies that can benefit women.

Tech and gadgets videos
Video games of December
"Avatar The Game", "Rogue Warrior", "The Devil's Tuning Fork", and "The Saboteur" you should look out for this December. Msnbc.com's video game reporter Todd Kenreck previews the games.

Video
Tech Watch
The latest in technology and entertainment news.
  Auto Tech

A better economy may lure buyers, but these trends could seal the deal.

Go to Auto Tech

By Brian Bergstein
updated 8:01 p.m. ET Sept. 12, 2007

Here's a productive twist on the animated characters known as avatars that carry out fantasies in virtual computer worlds. IBM Corp. researchers have developed an avatar that can translate spoken words into sign language.

The technology is meant for use in the real world and could be useful when human interpreters for the deaf are unavailable, or when a conversation is sensitive. Imagine sitting through a lecture and seeing a digital character projected on a screen behind the speaker, interpreting the speech in real time.

The IBM team and advocates for the deaf caution that the system is still a prototype. It also works only with British Sign Language for now because it was created at an IBM research center in Hursley, England.

Story continues below ↓
advertisement | your ad here

But the system, known as SiSi (for "Say It Sign It"), is expected to move out of the labs and into commercial products. It is designed to be baked into other vendors' deaf-accessibility products and expanded to include other countries' sign languages.

SiSi works by using speech recognition to convert a conversation into text. From there, SiSi translates the text into the gestures used in sign language and animates a customizable avatar that carries them out.

© 2009 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.

Resource guide