DurIAN-SC: Duration Informed Attention Network based Singing Voice Conversion System

Voice Conversion

Categories: Convolutional Neural Network | Deep Learning | Fourier Transform | Mean Opinion Score | Mel-spectrogram | Recurrent Neural Network | WaveRNN

Tags: 2020 | Chao Weng | Chengzhu Yu | Chunlei Zhang | Dong Yu | Heng Lu | Liqiang Zhang | Xiang Xie | Yusong Wu | Zijin Li

Singing voice conversion is converting the timbre in the source singing to the target speaker's voice while keeping singing content the same. However, singing data for target speaker is much more difficult to collect compared with normal speech data.In this paper, we introduce a singing voice conversion algorithm that is capable of generating high quality target speaker's singing using only his/her normal speech data. First, we manage to integrate the training and conversion process of speech and singing into one framework by unifying the features used in standard speech synthesis system and s...

PitchNet: Unsupervised Singing Voice Conversion with Pitch Adversarial Network

Voice Conversion

Categories: Adversarial Training | Convolutional Neural Network | Mean Opinion Score | Unsupervised Learning | WaveNet

Tags: 2020 | Chao Weng | Chengqi Deng | Chengzhu Yu | Dong Yu | Heng Lu

Singing voice conversion is to convert a singer's voice to another one's voice without changing singing content. Recent work shows that unsupervised singing voice conversion can be achieved with an autoencoder-based approach [1]. However, the converted singing voice can be easily out of key, showing that the existing approach cannot model the pitch information precisely. In this paper, we propose to advance the existing unsupervised singing voice conversion method proposed in [1] to achieve more accurate pitch translation and flexible pitch manipulation. Specifically, the proposed PitchNet add...