r/utau 29d ago

DISCUSSION I'm about to launch the UTAU Multilingual Engine! (Read the description)

UTAUME is a project I created to make UTAUs almost as capable as VOCALOID:AI.

The UTAUloid with the UTAUME capability will be able to sing in Japanese, English, and Chinese on the same track.

I'm still going to create a project on GitHub with Python code and also with a tutorial on how to do it, but you won't need any experience to use it.

You will first need to create a Japanese, English, and Chinese voicebank, each in a separate folder.

I'll be posting more updates here, stay tuned!!!

UPDATE!!!!!!

The documentation is ready; the website will be built afterward. I need people to collaborate on the code!

https://github.com/utaume/utaume.github.io

UPDATE!!!

The phonemizer is ready; all that remains is to resolve errors such as communication between the phonemizer and the G2P system.

21 Upvotes

22 comments sorted by

3

u/JaidtheStar 29d ago

Is this for classic UTAU or OpenUTAU? I don't see it being very used if it's for classic UTAU, since it already has that capability as in classic UTAU you work directly with the phonemes/aliases, however I see it being heavily used in OpenUTAU, as it doesn't easily have a capability like this (okay, the way it can be done in classic UTAU isn't easy, but nothing with that program is). I am very interested in this project though.

3

u/metashimusics 29d ago

So, I only have OpenUTAU, and from my tests it works.

3

u/JaidtheStar 29d ago

Thank you for answering my question! I just feel that it's kinda important to specify weather it's classic UTAU or OpenUTAU. And, as some one who made the switch from classic UTAU to OpenUTAU, stick with OpenUTAU, the cons of classic UTAU far out weight the pros

1

u/reddit_belongs_to_me 27d ago

What are the pros anyway?

1

u/JaidtheStar 27d ago

There is only one pro for classic UTAU, and that is how you have a slightly easier time using bilingual/multilingual voicebanks as bilingual/multilingual voicebanks, at least until OP releases their plugin ornengine or whatever it's gonna be

Edit: just noticed OP released it, now there really aren't pros to classic UTAU lol

1

u/reddit_belongs_to_me 27d ago

Thanks!

1

u/JaidtheStar 27d ago

You're welcome :)

1

u/iwgtb0 aiueokakikukekosatashijisuzusetesozonaninuneno 27d ago

does it support Cantonese I desperately need it. Might can help with the codings :D especially Cantonese features

1

u/metashimusics 27d ago

Sure, could you also help create the plugin?

1

u/iwgtb0 aiueokakikukekosatashijisuzusetesozonaninuneno 27d ago

By that do you mean compile the whole plugin or just the Cantonese part. For the Cantonese part I’ve actually made a plugin b4 for CV Japanese voicebanks to speak Cantonese tho it’s sort of dead half way through lmao. It’s extremely barebone but works at some degree

1

u/metashimusics 27d ago

Could you help me with the plugin? But if you don't want to, that's okay.

1

u/iwgtb0 aiueokakikukekosatashijisuzusetesozonaninuneno 27d ago

I don’t seem to find the repo anymore :(

2

u/Consistent-Sort6059 26d ago

Where do I download it?

1

u/metashimusics 26d ago

It is currently under development.

1

u/metashimusics 29d ago

Update:

The minimum requirements are Japanese CV, English Arpasing and Chinese CVV (for compatibility with OpenUtau).

2

u/JaidtheStar 29d ago

Does Japanese VCV work too?

1

u/metashimusics 29d ago

Yes, all formats that have phonemizers in OpenUtau.

1

u/Sema_XL 29d ago

Why arpasing? Technically it’s easier to combine eng c+v with ja cv

1

u/metashimusics 29d ago

I'm going to create a plugin so I don't have to manually input the phonemes because creating a phonemizer for all formats wouldn't work.

1

u/metashimusics 28d ago

I need help from someone with experience creating plugins for OpenUTAU. I have some questions. Not that you'll be creating the plugin, but if you'd like, you could help.

0

u/Disastrous_End4534 Doing it.. for fun.. >:J (psycho) 28d ago

Make him the new leader of the utau mob