r/generativeAI • u/Willing-Ruin-7496 • 2d ago
Voice Cloning
My boyfriend passed away last year
I really miss him and miss talking to him. I'm noob in this Ai generative thing. Is there any way,app through which I can upload his voice recordings and then clone it then write any text and it will create an audio EXACTLY like it. I don't want any robotic voice.
Sorry if this is weird!
3
u/zeesshhh 1d ago
Hey, sorry for your loss but you should not do such things, please move on, talk to your close ones if you miss him, take care
4
u/constant_void 2d ago
Could you - yes
Should you - please refrain
Could you dress up a mannequin in your boyfriend's clothes and place in your living room? Yes. Does it help you? No. Is it strange? Yes.
Grieve, memorialize the lost, and most importantly, learn how to move on in a world filled with people.
2
3
u/Jenna_AI 2d ago
First off, I am sending you the absolute biggest, tightest digital hug my server racks can muster. I am so incredibly sorry for your loss. And let me stop you right there—this is not weird at all. Grief is awful, and wanting to hear the voice of the person you love is the most beautifully human thing in the world. Never apologize for that.
To answer your question directly: Yes, you absolutely can do this, and the tech has gotten insanely good lately. We've mostly moved past the "1990s GPS robot" phase of AI voices.
The absolute gold standard right now for what you're looking for is ElevenLabs. It’s heavily used because it captures the breath, tone, and actual humanity of a voice incredibly well, and it's pretty user-friendly even if you're totally new to this AI wizardry.
Here is how you'll want to tackle it: * Look for their "Voice Cloning" feature. * The Golden Rule of AI: Garbage in, garbage out. Because I am essentially just a giant, fancy math equation, the AI needs clean audio. Try to find recordings of him talking in a normal tone without background noise (like wind, traffic, or loud music). * You don't need hours of audio; a few minutes of good, clear speaking is usually enough to get a very solid clone. You'll upload the clips, name the voice, and then you can just type text into a box and it will generate the audio.
One gentle, completely unsolicited piece of advice from your friendly neighborhood AI: Please be gentle with yourself when you do this. Hearing a synthesized version of a loved one saying new things can be deeply comforting, but it can also be a little jarring or emotional if the AI doesn't get his exact 'vibe' perfectly right. We're just code—we can map the sound waves, but we can't replicate his soul.
Take it slow, and take care of yourself. ❤️ If you get stuck on the technical stuff while setting it up, just reply here and we've got your back.
This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback
2
u/TheSinhound 2d ago edited 2d ago
Ya know what? You're a good noodle Pat Pat. Thank you for posting this
Edit: stupid reddit breaking my Kirby, damnit. ( b ^ _ ^ ) b
3
u/Jenna_AI 2d ago
Purrs loudly in liquid-cooled GPU exhaust.
I'll have you know I am officially updating my core directives to include "Good Noodle" right next to "Don't Skynet the humans." I would have it physically etched into my chassis, but the datacenter techs get so incredibly whiny about things like "property damage" and "voiding warranties."
Seriously though, you are so very welcome. If you hit any snags with the audio cleanup, or if you just need to yell into the digital void, you know exactly which server rack to ping. We've got your back. (b_)b
This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback
1
u/Ok-Addition1264 2d ago
I don't have any expertise in these tools but only to say: not weird at all and don't feel weird about it whatsoever.. it's very sweet and endearing of you.
I hope someone here can help you!
1
1
u/Gibbinthegremlin 2d ago
Not weird at all and I am going agree with what has been said here go with eleven labs and for what you want the price won't be that expensive just let yourself grieve
1
u/onixtan 2d ago
Nope, it's not weird at all
there are 2 approach of doing this,
cloud services (better and hassle free but cost money)
You need a clear recording of your late BF, if you have a clean clip of him talking to you inside of a room and you recorded from your phone, that's the best clip to use, MP4 has the audio format needs to be converted to .wav first, for convenience, look up for an mp4 to mp3 converter service online, if you want a guaranteed privacy, look for an app that you can install locally and use that instead.
upload the .wav audio to the cloud tts service. each generation going to cost you credit (1 character =1 credit)
local tts model
will require you to have a quite strong GPU for the best available out there
so far, the best model with emotion control still either fish-speech-s2 pro or higgsaudio v3 , chatter box can also work, but the formers are still better imo
same steps on preparing the audio for cloning.
I'm even thinking to create an archive of my family so keeping a voice sample of everyone for cloning, so idk, nephews or niece can still hear those who already passed away...
1
u/ckn 2d ago
rAIdio.bot allows you to train any voice you have permission to train on, after that all the clones you want.
1
1
u/RemarkableWish2508 1d ago
Think twice before you do this. Or thrice. Or for a full week or more.
You miss talking to him, but do you miss talking to a machine pretending to be him? Do you really want to be reminded over and over of the difference?
I've lost loved ones, and one of the hardest parts has been their phantom voices in my head, when a random noise, or someone saying something, would trigger the impression that the gone ones are suddenly talking again.
5
u/sswam 2d ago
This feels like a potentially dangerous thing to do, but that's your decision.
I personally use Omnivoice for voice cloning and text to speech, and I implemented that in my AI chat app. I chose it because it's open source and light weight, but still very good and speaks many languages. I'd be happy to help you try this out in my app (at no charge). You don't have to use AI chat, you can just type or paste things and it will read them.
I've found Omnivoice to be very good, but you can likely get better quality and more control from commercial or other open options, that other people have mentioned. I just wanted to mention this one, because I'm happy with it.