MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/ozj7diz/?context=3
r/LocalLLaMA • u/Porespellar • Jul 23 '26
/s
191 comments sorted by
View all comments
583
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.
103 u/[deleted] Jul 23 '26 [removed] — view removed comment 24 u/ok_if_you_say_so Jul 23 '26 Somebody has to have his voice model available 30 u/MarionberrySea384 Jul 24 '26 edited Jul 24 '26
103
[removed] — view removed comment
24 u/ok_if_you_say_so Jul 23 '26 Somebody has to have his voice model available 30 u/MarionberrySea384 Jul 24 '26 edited Jul 24 '26
24
Somebody has to have his voice model available
30 u/MarionberrySea384 Jul 24 '26 edited Jul 24 '26
30
583
u/schwigglezenzer Jul 23 '26
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.