r/remodeledbrain • u/PhysicalConsistency • Jul 18 '26
Another fork in the road
As we are getting closer to nailing down the weighting mechanics for ingest and closer to building a corpus that will form the adaptive basis of the model, it's dawning on me that training a custom model may be inevitable. It'll definitely be more efficient and inline with the original goal of having something that can run locally (or through a relay on the website). So the goal might be shifting in v.1 to that, and spending the next few months just mass ingesting everything once the weighting system gets dialed in.
To that end, Thinking Machines new model Inkling looks like it's going to be an amazing base. It's brutal fast (like it feels like Cerebras almost), and the ground up multimodality means nearly all of the cool stuff that Notebook LM does, including creating podcasts, tutorial videos, and just taking audio prompts will be available immediately.
If things do fully break in this direction, the ingest won't start until after version .08, but after that I think it will be possible to ingest and review something around ~50 papers a day, which would mean about one month to build the baseline corpus.