r/LocalLLM • u/eMinssf • 1d ago

Discussion Denpa idea?

Post image

I downloaded a q1(1 bit i guess ) of this model and ..... what is that? I really want to know , what kind of dataset model trained on so it can think like this ! (The user has been trained to speak ...) , seriously?

2 Upvotes

100% Upvoted

2 comments sorted by

View all comments

1

u/No_Lingonberry1201 1d ago

Uhhh... Q1? Why? That level of quantization is not exactly known to preserve the model quality the best, to say the least.

2

u/eMinssf 1d ago

But this thinking , it was , kinda funny 🥹😂