Pushing the frontier of neural text to speech

Опубликовано 27 мая 2021, 20:38

In the popular field of text to speech, the goal is to transform the written or printed word into speech that is natural and intelligible. Today, the technology is being used in products and services to help people who are blind or have low vision consume digital content, power personal digital assistants that sound more realistic, and make it easier to do two things at once, such as listening to an article online while washing dishes, among other applications. Although the quality of synthesized speech has gotten better thanks to neural network-based end-to-end TTS, advancing neural TTS and allowing it to be more easily integrated into product development and deployment requires overcoming a variety of remaining challenges.

In this webinar, Senior Researcher Xu Tan will talk about these challenges, specifically the high computational cost and slow inference speed in online serving; word skipping and repeating issues, poor voice quality, and lack of voice controllability; the large amounts of training data needed for improved voice synthesis; and the practical challenges in TTS voice adaptation. He’ll introduce his team’s work addressing these challenges—including fast TTS, end-to-end TTS, low-resource TTS, and adaptive TTS—as well as discuss other critical questions and opportunities to pursue in the space.

Together, you'll explore:

■ An overview of text to speech, including its evolution
■ The important challenges in neural text to speech and how to address them with dedicated research
■ How to factor product development into your research

𝗥𝗲𝘀𝗼𝘂𝗿𝗰𝗲 𝗹𝗶𝘀𝘁:

■ Text to Speech (project page): microsoft.com/en-us/research/p...
■ Xu Tan (publications page): microsoft.com/en-us/research/p...
■ Speech Research Repository Master List (GitHub): speechresearch.github.io
■ FastSpeech: Fast, Robust and Controllable Text to Speech (GitHub): speechresearch.github.io/fasts...
■ FastSpeech 2: Fast and High-Quality End-to-End Text to Speech (GitHub): speechresearch.github.io/fasts...
■ AdaSpeech: Adaptive Text to Speech for Custom Voice (GitHub): speechresearch.github.io/adasp...
■ AdaSpeech 2: Adaptive Text to Speech with Untranscribed Data (GitHub): speechresearch.github.io/adasp...
■ LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search (GitHub): speechresearch.github.io/light...
■ LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition (Github): speechresearch.github.io/lrspe...
■ Neural Text-to-Speech previews five new languages with innovative models in the low-resource setting (blog): techcommunity.microsoft.com/t5...
■ Microsoft Azure Text to Speech: azure.microsoft.com/en-us/serv...
■ Microsoft Azure Custom Voice: speech.microsoft.com/customvoi...
■ Xu Tan (Researcher profile): microsoft.com/en-us/research/p...

*This on-demand webinar features a previously recorded Q&A session and open captioning.

This webinar originally aired on May 20, 2021

Explore more Microsoft Research webinars: aka.ms/msrwebinars