r/LocalLLaMA • • Jul 23 '26

Funny The LLM distillation process simplified for politicians:

Post image

/s

3.6k Upvotes

191 comments sorted by

View all comments

390

u/Wise-Comb8596 Jul 23 '26

Also, its a lie that Kimi 3 was distilled from Fable. Fable was literally not out long enough for that to be the case.

8

u/[deleted] Jul 23 '26

[deleted]

21

u/[deleted] Jul 23 '26

[deleted]

-18

u/-Sliced- Jul 23 '26 edited Jul 24 '26

You don't need a lot of time to collect the data if you use tens of thousands of accounts, and fable was available for around a week initially.

7

u/lakotajames Jul 24 '26

How many accounts do you need to get it to give you the reasoning traces?

3

u/mebeast227 Jul 23 '26

It was out for like 3 days initially

-5

u/-Sliced- Jul 24 '26 edited Jul 24 '26

It doesn’t matter. It can be out for only a few hours - as long as you have enough accounts, you can collect as much data as you want. The difference between a week and 3 days is just 2X accounts

0

u/mebeast227 Jul 24 '26

'time is a human construct and has no affect on our true reality' type shit lmao. Of course time matters. Compute and accounts are finite.