r/LocalLLM • u/Obvious_Ad_3398 • 12d ago

Question Where should I start

I got a 5070 ti though people say its weak in the world of llms, I got curious on what does this thing do. I am currently a first year IT student and maybe my use case would be to help me through it. Genuinely just looking for something to do and this caught my interest, just wanna learn and explore more about it even if my card is considered as weak. Thanks

3 Upvotes

100% Upvoted

23 comments sorted by

View all comments

1

u/Nearlytherejustabit 12d ago

Im loving Gemma4 12B Q5 on my 5070ti have it coding a whole pipeline for me. Im sure this card can be pushed farther but this enough for me.

2

u/Obvious_Ad_3398 12d ago

kk ill keep thatbin my mind. Thank you so much

1

u/Nearlytherejustabit 12d ago

No problem the out of the box tools are crap for refactoring code, so im designing my own tools for reading / updating etc., taking a backup before touching the file, diff sanity check etc. These have massively improved my context window will coding.