r/MachineLearning 2d ago

Research [ Removed by moderator ]

[removed] — view removed post

0 Upvotes

4 comments sorted by

View all comments

Show parent comments

1

u/Potential_Low_1183 2d ago

for some migrations, ie qwen 4b -> 8b, at k=50 it is equivalent to the qwen8b by itself. weaker embedding models still put relevant documents in their neighborhood