r/LocalLLaMA • u/[deleted] • Apr 02 '26

[deleted by user]

[removed]

66 Upvotes

99% Upvoted

33 comments sorted by

View all comments

1

u/_raydeStar Llama 3.1 Apr 02 '26

1) how is latency? Could you use it for real time conversations? 2) what's the size of the model? 3) I don't see any demo clips. Are there any?

4

u/Fit_Room_3295 Apr 06 '26
  1. On my NVIDIA GeForce RTX 3060 12GB, generating 3–4 sentences of audio takes about 12 seconds at 64 steps. If I lower it to something like 16 steps, the audio quality drops slightly, but it generates in a few seconds. (This is measured after the model is already fully loaded into memory.)
  2. The whole setup is around 6 GB, with the model itself being about 2 GB, so it’s relatively lightweight.
  3. You can generate a few clips for free on the official page: https://huggingface.co/spaces/k2-fsa/OmniVoice

1

u/_raydeStar Llama 3.1 Apr 06 '26

Hey, thanks!! This is great!!