End-To-End Speech Synthesis Applied to Brazilian Portuguese

AI-generated keywords: Voice synthesis Brazilian Portuguese Deep Learning Dataset Vocoders

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Voice synthesis systems are popular in various applications
  • Voice technology provides a natural way for human-computer interaction
  • Not all languages have the same level of resources and systems available for voice synthesis
  • A team of researchers created publicly available resources for Brazilian Portuguese language in the form of a dataset and deep learning models for end-to-end voice synthesis
  • The dataset used in this study consists of 10.5 hours from a single speaker
  • The researchers investigated three different architectures to perform end-to-end speech synthesis: Tacotron 1, DCTTS and Mozilla TTS
  • They also analyzed the performance of models according to different vocoders (RTISI-LA, WaveRNN and Universal WaveRNN), phonetic transcriptions usage, transfer learning (from English) and denoising
  • In the proposed scenario, a model based on Mozilla TTS and RTISI-LA vocoder presented the best performance with a 4.03 MOS value.
  • Transfer learning from English data, phonetic transcriptions usage and denoising are useful techniques to train models over the presented dataset.
  • The obtained results are comparable to related works covering English even though they used a smaller dataset.
  • This research contributes significantly to improving voice technology's accessibility by providing publicly available resources for Brazilian Portuguese language that can be utilized in various applications such as personal assistants or accessibility tools.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Edresson Casanova, Arnaldo Candido Junior, Frederico Santos de Oliveira, Christopher Shulby, João Paulo Teixeira, Moacir Antonelli Ponti, Sandra Maria Aluisio

Abstract: Voice synthesis systems are popular in different applications, such as personal assistants, GPS applications, screen readers and accessibility tools. Voice provides an natural way for human-computer interaction. However, not all languages are in the same level when accounting resources and systems for voice synthesis. This work consists of the creation of publicly available resources for the Brazilian Portuguese language in the form of a dataset and deep learning models for end-to-end voice synthesis. The dataset has 10.5 hours from a single speaker. We investigated three different architectures to perform end-to-end speech synthesis: Tacotron 1, DCTTS and Mozilla TTS. We also analysed the performance of models according to different vocoders (RTISI-LA, WaveRNN and Universal WaveRNN), phonetic transcriptions usage, transfer learning (from English) and denoising. In the proposed scenario, a model based on Mozilla TTS and RTISI-LA vocoder presented the best performance, achieving a 4.03 MOS value. We also verified that transfer learning, phonetic transcriptions and denoising are useful to train the models over the presented dataset. The obtained results are comparable to related works covering English, even using a smaller dataset.

Submitted to arXiv on 11 May. 2020

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2005.05144v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

Voice synthesis systems have become increasingly popular in various applications, including personal assistants, GPS applications, screen readers and accessibility tools. Voice technology provides a natural way for human-computer interaction. However, not all languages have the same level of resources and systems available for voice synthesis. In this study, a team of researchers created publicly available resources for Brazilian Portuguese language in the form of a dataset and deep learning models for end-to-end voice synthesis. The dataset used in this study consists of 10.5 hours from a single speaker. The researchers investigated three different architectures to perform end-to-end speech synthesis: Tacotron 1, DCTTS and Mozilla TTS. They also analyzed the performance of models according to different vocoders (RTISI-LA, WaveRNN and Universal WaveRNN), phonetic transcriptions usage, transfer learning (from English) and denoising. In the proposed scenario, a model based on Mozilla TTS and RTISI-LA vocoder presented the best performance with a 4.03 MOS value. The researchers also found that transfer learning from English data, phonetic transcriptions usage and denoising are useful techniques to train models over the presented dataset. The obtained results are comparable to related works covering English even though they used a smaller dataset. This study's findings demonstrate that it is possible to create high-quality voice synthesis systems for Brazilian Portuguese using deep learning techniques with limited data availability. Overall, this research contributes significantly to improving voice technology's accessibility by providing publicly available resources for Brazilian Portuguese language that can be utilized in various applications such as personal assistants or accessibility tools.
Created on 03 May. 2023

Assess the quality of the AI-generated content by voting

Score: -1

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.