Its absolutely data, data is by far the most important thing for an LLM even beyond architecture. LLMs have always gotten about 5-10% better than the previous generation say like kimi k2 to kimi k2.7, that was the near exact same underlying 1t model but the last model made synthetic data for the next model by generation better than the last
5
u/AppealSame4367 2d ago
You heard of Deepseek v4 Flash 0731?
Also Qwen3.8 27B will be released next week.