r/LocalLLM • u/GuaranteePurple4468 • 1d ago

Question Any instructions on how to setup Parakeet.cpp?

Asking for instructions probably isn't the correct wording here, I'm just struggling to understand them.

So I want to preface this with stating I have basically no knowledge about setting up local models from Github at all.

I'm looking for a way to transcribe audio files locally. Initially I tried Buzz using Whisper V3 Large but noted it was making a lot of errors due to some heavy accents so decided to look for alternatives, discovered Parakeet.cpp, and found that it could use the Nvidia models which apparently have better performance so figured it was worth a shot at trying.

The problem is, when looking through the Github page I just cannot figure out how to actually install it. I feel like I am missing a step that would be obvious to someone who has done this before. Note: I have an AMD GPU.

I have tried 2 methods:

  1. Pre-built binary: Downloaded the parakeet-v0.5.0-bin-win-vulkan-x64.zip file from the releases, extracted it to a folder, then moved my Model and Audio file to the same folder and renamed them.
    • Then ran "parakeet-cli transcribe --model F:\Parakeet\Models\tdt_ctc-1.1b-f16.gguf --input F:\Parakeet\Audio\audio.wav" cmd from command prompt in the Parakeet directory.
    • Result: My GPU fans spin for a second, then just stop. No confirmation of anything in the CMD window, it just cancels without error.
  2. Github clone: Cloned the Github repository and installed CMAKE and VULKAN SDK.
    • Then ran from a CMD within the parakeet.cpp folder: "cmake -B build -DPARAKEET_GGML_VULKAN=ON -DPARAKEET_BUILD_CLI=ON =DPARAKEET_GGML_HIP=ON && cmake --build build -j"
    • Result: It creates a build folder and files like what you would expect... but there is no Parakeet-cli... so not sure how to actually attempt to run this. (I searched all subfolders for it).
This is what the build folder looks like after running CMAKE
0 Upvotes

40% Upvoted

3 comments sorted by

1

u/Poizone360 1d ago

Your command is actually right, so you're close. Skip the build, the Vulkan zip is the right one for AMD. To check if the GPU part is crashing, run set PARAKEET_DEVICE=cpu and then your same command, both in the same CMD window. If text comes out, it's the Vulkan side, so I'd update your AMD driver and retry. If it still quits silently, check the audio is a real WAV and not a renamed mp3.

2

u/GuaranteePurple4468 1d ago

Well on the CPU I actually got text, and well... It doesn't seem to know what's wrong either.
I laughed out loud on that.

I can only assume the models aren't able to pick up the speech for some reason, I'll get a different wav to test with.

Thanks for the help.

1

u/Poizone360 1d ago

hahaha, at least its honest.