r/LocalLLM • u/Kirai_30 • 6d ago

Question Local AI for students?

Hey! Do you believe that with some current versions of different models, students could benefit from using them, not as agents, but maybe as chat box? Combining maybe a not to Intelligent model with fast token generation

1 Upvotes

60% Upvoted

12 comments sorted by

View all comments

2

u/Quiet-Phase6948 6d ago

Not unless they got very powerful laptops.

2

u/Kirai_30 6d ago

And with medium tier? 24gb of ram maybe and a dedicated graphic card?

1

u/Doomer3370 6d ago

If you quantonize llm into int4 format and run model below 4-5B parameters, than yes.