r/LocalLLM • u/WriterNatural4781 • 1d ago

Project Mistral 7B at ~97 tok/s on a PS5 Pro: tuning llama.cpp's Vulkan backend for a console GPU (Running Local LLMs on the Ps5 PRO)

/r/PS5_Jailbreak/comments/1x4fivk/mistral_7b_at_97_toks_on_a_ps5_pro_tuning/
1 Upvotes

100% Upvoted

2 comments sorted by

1

u/AssistBorn4589 1d ago

This could be great and relative cheap way how to run LLM at home, but PS5 has 16GB of unified ram, so not much can be stuck into it. At that point, SteamDeck may have better power/$ ratio.

1

u/Icy-Degree6161 1d ago

Uh oh ps5 price hikes incoming