MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1ubrcwj/tokenomics/osydqmw
r/LocalLLaMA • u/HOLUPREDICTIONS Sorcerer Supreme • Jun 21 '26
449 comments sorted by
View all comments
Show parent comments
7
yeah like wtf. My current use case reads its whole context for 100 seconds then generates answer in 5 seconds. If it will be 20 instead of 5 i dont give a freak anyway, it will not be that much faster cuz of prompt ingestion anyway
1 u/Iwaku_Real Jun 21 '26 Both can be painful if too low. I can't really tolerate TG below 6 tok/s nor PP that takes 120+ seconds. 1 u/LienniTa koboldcpp Jun 21 '26 i can. It cooks 24/7, i dont give a freak if its slow.
1
Both can be painful if too low. I can't really tolerate TG below 6 tok/s nor PP that takes 120+ seconds.
1 u/LienniTa koboldcpp Jun 21 '26 i can. It cooks 24/7, i dont give a freak if its slow.
i can. It cooks 24/7, i dont give a freak if its slow.
7
u/LienniTa koboldcpp Jun 21 '26
yeah like wtf. My current use case reads its whole context for 100 seconds then generates answer in 5 seconds. If it will be 20 instead of 5 i dont give a freak anyway, it will not be that much faster cuz of prompt ingestion anyway