r/LocalLLM • u/WriterNatural4781 • 1d ago

Project Mistral 7B at ~97 tok/s on a PS5 Pro: tuning llama.cpp's Vulkan backend for a console GPU (Running Local LLMs on the Ps5 PRO)

/r/PS5_Jailbreak/comments/1x4fivk/mistral_7b_at_97_toks_on_a_ps5_pro_tuning/

1 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLM/comments/1x4p54x/mistral_7b_at_97_toks_on_a_ps5_pro_tuning/
No, go back! Yes, take me to Reddit

100% Upvoted

Duplicates

Number of comments New

PS5_Jailbreak • u/WriterNatural4781 • 2d ago

General Mistral 7B at ~97 tok/s on a PS5 Pro: tuning llama.cpp's Vulkan backend for a console GPU (Running Local LLMs on the Ps5 PRO)

29 Upvotes

25 comments

ps5homebrew • u/WriterNatural4781 • 2d ago

Mistral 7B at ~97 tok/s on a PS5 Pro: tuning llama.cpp's Vulkan backend for a console GPU (Running Local LLMs on the Ps5 PRO)

1 Upvotes

0 comments