YouTube could be getting a real-time translator in the future

Date:
Wed, 10 May 2023 19:34:24 +0000

Description:
An experimental AI dubbing service that translates speech in real-time is being rolled out to select few Google partners.

FULL STORY ======================================================================

Seamlessly integrating AI capabilities from PaLM 2 across the Google ecosystem, including Bard, has been a major theme at the Google I/O 2023 event. Although Google believes there are some features that shouldnt be released instantly.

During the Google I/O keynote, the companys senior vice president of technology and society, James Manyika, raised concerns about the potential tensions between misinformation and some AI capabilities, namely the technology thats behind deep fakes.

What hes referring to are the language models that deepfakes use to dub
voices in videos you know the ones, where a famous actors monologue from one of the best TV shows or best films is suddenly swapped for lip syncing.

As a result, Google is taking some steps to set up what it referred to as guardrails in order to prevent the misuse of some of these new features by leaving artefacts in photos and videos, such as watermarks and metadata. One new tool that will be massively useful and beneficial, but could easily be misused, is a prototype that Google is rolling out to a set number of partners, called "universal translator".

Googles universal translator is an experimental AI video dubbing service that translates speech in real-time, allowing you to instantly read what someone
is saying in another language while watching a video. The prototype was showcased during the event, revealing videos from a test that was part of an online college course created in partnership with Arizona State University.

The model works in four stages. In the first stage, the model matches lip movements in a video to words it recognises. The second step triggers an algorithm that provides instant speech generation. The third stage of the model uses intonation, which measures the rise and fall in the natural pace
of someone speaking, to aid the translation. Finally, once it has replicated the style and matched the tone from a speakers lip movements, it brings it
all together to generate the translation.

Google says that early results have been promising. With university students from the study showing a higher number of completions in course rates. While this feature isn't yet available outside of a small beta testing group, it might be that once Google does have its safeguards in place it will roll it out to services such as YouTube, for example.

Looking for more about the biggest news from Google I/O? Check our Google I/O 2023 live blog to get a play-by-play run down of what was announced at the event.



======================================================================
Link to news story: https://www.techradar.com/news/youtube-could-be-getting-a-real-time-translator -in-the-future


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)