DurIAN-SC: Duration Informed Attention Network based Singing Voice Conversion System

Voice Conversion

Categories: Convolutional Neural Network | Deep Learning | Fourier Transform | Mean Opinion Score | Mel-spectrogram | Recurrent Neural Network | WaveRNN

Tags: 2020 | Chao Weng | Chengzhu Yu | Chunlei Zhang | Dong Yu | Heng Lu | Liqiang Zhang | Xiang Xie | Yusong Wu | Zijin Li

Singing voice conversion is converting the timbre in the source singing to the target speaker's voice while keeping singing content the same. However, singing data for target speaker is much more difficult to collect compared with normal speech data.In this paper, we introduce a singing voice conversion algorithm that is capable of generating high quality target speaker's singing using only his/her normal speech data. First, we manage to integrate the training and conversion process of speech and singing into one framework by unifying the features used in standard speech synthesis system and s...

Transferring Source Style in Non-Parallel Voice Conversion

Voice Conversion

Categories: Deep Learning | Fourier Transform | Gaussian Mixture Model | Mel-spectrogram | Recurrent Neural Network | WaveRNN

Tags: 2020 | Dan Su | Dong Yu | Helen Meng | Na Hu | Shiyin Kang | Songxiang Liu | Xunying Liu | Yuewen Cao

Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain the factors intentionally added by the speaker and should be retained during conversion. This study proposes a sequence-to-sequence based non-parallel VC approach, which has the capability of transferring the speaking style from the source speech to the converted speech by explicitly modeling. Objective evaluation and subjective listening tests show superior...

PitchNet: Unsupervised Singing Voice Conversion with Pitch Adversarial Network

Voice Conversion

Categories: Adversarial Training | Convolutional Neural Network | Mean Opinion Score | Unsupervised Learning | WaveNet

Tags: 2020 | Chao Weng | Chengqi Deng | Chengzhu Yu | Dong Yu | Heng Lu

Singing voice conversion is to convert a singer's voice to another one's voice without changing singing content. Recent work shows that unsupervised singing voice conversion can be achieved with an autoencoder-based approach [1]. However, the converted singing voice can be easily out of key, showing that the existing approach cannot model the pitch information precisely. In this paper, we propose to advance the existing unsupervised singing voice conversion method proposed in [1] to achieve more accurate pitch translation and flexible pitch manipulation. Specifically, the proposed PitchNet add...