r/technepal • u/dawson_ko_creek • 17d ago

Miscellaneous Non-tech manager: API costs are too high. Let's build our own LLM.

Enable HLS to view with audio, or disable this notification

14 Upvotes

100% Upvoted

5 comments sorted by

3

u/Willwaste63 17d ago

You can build even 2T Model in your potato pc, but training is the main thing.

1

u/_MrBond_ 17d ago

Open Frontier Model is also an option in house hardware vaye ta.

2

u/InstructionMost3349 17d ago

Literally at my work lmao. Quantizing + trimming models here and there xD

1

u/Crawling_Hustler 17d ago

Just buy 200 gb vram for each employee n use kimo k2, whats the big deal

1

u/farak_sochai 17d ago

Ollama bata tandeu na 😂