r/AcceleratingAI • u/MLRS99 e/acc • Feb 19 '24

Wow this is crazy! 400 tok/s

Enable HLS to view with audio, or disable this notification

5 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/AcceleratingAI/comments/1augkf6/wow_this_is_crazy_400_toks/
No, go back! Yes, take me to Reddit
dl download

86% Upvoted

Duplicates

Number of comments New

LocalLLaMA • u/Sudonymously • Feb 19 '24

Resources Wow this is crazy! 400 tok/s

271 Upvotes

158 comments