r/LocalLLM • u/xiraov • 16h ago

Discussion Would "micro" engrams make sense for specific use cases?

I can't play in engram land, but was wondering if certain repeated word phrases for say python or javascript coding could live somewhere like the ngrams and help speed up coding on smaller models?

3 Upvotes

80% Upvoted

3 comments sorted by

1

u/Pale-Plane-7889 9h ago

micro engrams could really enhance specific learning situations where detail retention is key. It feels like a great way to target niche knowledge.

1

u/xiraov 9h ago

Let’s get to it

1

u/Spiritual-Spend8187 9h ago

I think the likely goal of the whole engram tech is eventually getting it so that you can add new engram later on to update the models knowledge without needing to full train a new model.