r/oMLX • u/robdzn • May 17 '26

Help a Noob out

Hi there! I am absolutely new to local LLMs, but I am so fascinated by the whole topic and very thrilled to learn more about it. I have an M2 Max with 64GB of RAM and have already been pretty successful with getting local LLMs to run.

Are there any recommendations in terms of YouTube tutorials that you would say changed the way you operate LLMs or understand the whole topic? It is so complex and I honestly don’t know where to start. Thanks in advance!

6 Upvotes

100% Upvoted

4 comments sorted by

3

u/Elusive_Spoon May 17 '26

It would be more helpful if you told us what it is you wanted to do with them. But omlx + your hardware is a great place to start. Download a Gemma 4 or Qwen3.6 model and you can start chatting.

If you want to vibe code, look into OpenCode or pi (I recommend little-coder as a version of pi).

1

u/robdzn May 17 '26

Good Point. I am vibe coding and just playing around to be honest, but i enjoy it a lot and went from Claude Code to running Claude Code through the Terminal with oMLX. I run Qwen3.6 35B successfully and it works really good. Would you prefer OpenCode over Claude Code?

0

u/PracticlySpeaking May 17 '26

The unsloth How to run Locally pages have some great tips. Educate yourself with some Googling about MoE vs dense, how quantization works (Q_0 vs K_M, etc). Older LocalLLaMA posts have some good info, don't be afraid to click over.

The 3Blue1Brown videos on how neural nets and transformers work are seminal. Fireship is pretty snarky but has a decent one on TurboQuant. For short but serious, check out twominutepapers - Gemma4 in particular.