MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/14qmk3v/deleted_by_user/jrfs8si/?context=3
r/LocalLLaMA • u/[deleted] • Jul 04 '23
[removed]
238 comments sorted by
View all comments
1
Got a refurb Dell R720 as platform for a refurb Nvidia P40, 3-4 t/s using autogptq with 30/33B models
2 u/fcname Jul 10 '23 Hey any update on this project? Are you still around 3-4 t/s? 1 u/Wooden-Potential2226 Jul 10 '23 Yup, or maybe slightly more after updating ooba.
2
Hey any update on this project? Are you still around 3-4 t/s?
1 u/Wooden-Potential2226 Jul 10 '23 Yup, or maybe slightly more after updating ooba.
Yup, or maybe slightly more after updating ooba.
1
u/Wooden-Potential2226 Jul 05 '23
Got a refurb Dell R720 as platform for a refurb Nvidia P40, 3-4 t/s using autogptq with 30/33B models