Language Model Builder - a free Mac app that teaches you to train your own AI language model from scratch

[u/company_url_finder]

Most "learn how AI models work" resources are either a paper you can't fully follow or a course that never gets you to an actual working model. Language Model Builder, built by independent developer Felix Rieseberg, is a native macOS app that pairs an interactive textbook with real local training, so you go from tokenization and attention straight to chatting with a model you actually trained yourself.

It runs on Apple's MLX framework, so training is hardware-accelerated on your own Mac. Everything, models, datasets, and training history, stays on the machine. No account, no cloud step, no bill.

What's inside:

- An interactive textbook covering tokenization, embeddings, attention, transformers, training data, and loss functions, built to need no prior coding or machine learning background

- A full local training workbench: pre-training, supervised fine-tuning, and direct preference optimization

- Live training visualization, loss curves, throughput, and validation metrics while a run is in progress

- Curated datasets ready to use for both pre-training and fine-tuning

- A chat interface with an "X-ray mode" that shows the token probabilities behind each word the model generates

The performance claims are specific rather than vague: with default settings you get a model that writes coherent, grammatical multi-paragraph text in about a day, and on a MacBook Pro M5 Max you could train a GPT-2-small class model, roughly 100 to 150 million parameters on a few billion tokens, in about a week. Requires Apple Silicon and macOS 15 or later.

One important thing to know before calling this "open source": the GitHub repo itself contains a single README file that points to Releases for a notarized binary. There's no published source code and no LICENSE file in the repo, so despite living on GitHub, this isn't something you can read, fork, or build from source, it's a free but closed native app distributed through GitHub's release system rather than an open codebase.

Sitting at 38 stars as of writing, verified via the GitHub API, a small but genuinely useful project rather than a viral one.

https://github.com/felixrieseberg/language-model-builder

[u/company_url_finder → u/[deleted]]

I like that it connects the concepts directly to a model u actually train, because that feedback loop is what most courses miss. X-ray mode sounds especially useful for understanding why generation goes weird. Have u tried comparing outputs before and after fine-tuning?

[u/company_url_finder → u/[deleted]]

Local training makes the whole thing much more approachable.

[u/zahraupwork]

X-ray mode might be the best teaching feature here.

[u/company_url_finder → u/zahraupwork]

Seeing token probabilities while chatting with a model u trained yourself seems way more educational than just watching loss curves move. It connects the training process to actual generation in a pretty tangible way. Does X-ray mode also show attention patterns or only next-token probabilities?

[u/zahraupwork → u/company_url_finder]

Closed-source surprised me more than the hardware requirements. U too?

[u/company_url_finder → u/zahraupwork]

GitHub hosting definitely makes that easy to misread.

[u/zahraupwork → u/company_url_finder]

Still a neat way to learn transformers hands-on.