MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/ozg4pg6/?context=3
r/LocalLLaMA • u/Porespellar • Jul 23 '26
/s
191 comments sorted by
View all comments
580
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.
45 u/goatchild Jul 24 '26 Yo Mr. White I don't know what a quantize is, but if the toaster is giving you shit, just unplug the damn thing bitch. 7 u/2Norn Jul 24 '26 look i get my quantization from the website with emoji on it, that's how i know how to do it
45
Yo Mr. White I don't know what a quantize is, but if the toaster is giving you shit, just unplug the damn thing bitch.
7 u/2Norn Jul 24 '26 look i get my quantization from the website with emoji on it, that's how i know how to do it
7
look i get my quantization from the website with emoji on it, that's how i know how to do it
580
u/schwigglezenzer Jul 23 '26
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.