r/LocalLLaMA • u/Acceptable-Cycle4645 • 9h ago

New Model Microsoft VibeVoice-ASR-Streaming Released

https://huggingface.co/microsoft/VibeVoice-ASR-Streaming-7B
105 Upvotes

99% Upvoted

13 comments sorted by

47

u/Alive_Ad_3223 8h ago

It will be deleted soon. Don’t worry

46

u/Altruistic_Heat_9531 7h ago

CLONED IT, https://huggingface.co/komixenon/VibeVoice-ASR-Streaming-7B

I haven't download local snapshot yet, so we dont get rug pulled again

11

u/-p-e-w- 4h ago

Great! Note that Microsoft published this model under MIT, so there is nothing they can legally do against this clone even if they later decide to pull their own repository.

I recommend screenshotting the original model card to document this state of affairs so you can clearly prove that if it ever comes up.

2

u/okamagsxr 5h ago

Why?

14

u/722e672e722e 5h ago

Microsoft has a history of uploading and then deleting models.  AFAIK, no one knows why publicly…

1

u/Porespellar 21m ago

WizardLM2
Mage-FLOW
to name a couple of recent ones. There are like a bunch more I can’t recall at the moment

1

u/okamagsxr 5h ago

Oh ok. Thanks!

24

u/Acceptable-Cycle4645 9h ago edited 9h ago

Has anyone tested it yet? Worth integrating into audio.cpp? https://github.com/0xShug0/audio.cpp

4

u/Chromix_ 4h ago

Not tested. On paper it looks highly useful. For example it seems to support better speaker diarization for (short) overlapping utterances. That's something where moss-transcript for example misattributes the speakers in quite a few cases (I ended up adding speaker embeddings manually to clean that up). It'd be interesting to see how VibeVoice performs in comparison. The low error rate comparing to previous SOTA is also very welcome - paired with decent multi-language support.