Google DeepMind Launches SL2T: Sign Language AI Comes to Pixel 11

Google DeepMind has introduced a new model for translating sign language into text, known as the multilingual sign-language-to-text (SL2T) system. This innovation integrates sign language AI into consumer applications such as Gboard and Live Transcribe on the Pixel 11, initially focusing on American Sign Language (ASL) to English. Deaf individuals can now communicate via sign language with their phones for tasks like web searches and messaging. The SL2T model was developed using over 100,000 hours of data from 50 different sign languages, interpreting sign language through pose landmarks while ensuring user privacy by omitting video. It achieves an impressive zero-shot BLEURT score of 70, exceeding previous records. The development process included insights from the Deaf community, facilitated by the AI Sign Language Advisory Committee (AISLAC). SL2T is offered on the Pixel 11 without additional charges, with future plans for more languages and devices.