Voice translation of live broadcasts has appeared in Yandex Browser

Yandex has added the technology of voice translation of live broadcasts on YouTube to its browser. It is currently in beta testing and works on a limited number of channels. English, Spanish, German, French and Italian languages ‚Äč‚Äčavailable.

The technology of automatic behind-the-scenes translation of streaming videos is complicated by the fact that it is necessary to take into account the context and the fact that the same word has different meanings in different situations. A neural network acts as a translator, which starts translating the broadcast sentences before they are finished. Testing of the new function is available to any Yandex Browser user on a computer.

As SEONews writes, in order for automatic voice-over translation to work properly, the architecture of the technology had to be completely rebuilt. The recorded clips are immediately translated by the neural network due to the fact that it receives the entire audio track, while having a complete context.

In the case of translation of live broadcasts, the work algorithm is based on a different principle. The first neural network provides audio recognition and its conversion to text. The second one recognizes the gender of the speaker by biometric parameters. The third places punctuation marks, selects meaningful fragments from the text and forms a complete thought. Another one, the fourth, synthesizes the translation into Russian.

Related Posts

Leave a Reply

Your email address will not be published. Required fields are marked *

© 2022 ZoNa365.ru - Theme by WPEnjoy · Powered by WordPress