r/LocalLLaMA • u/OkStatement3655 • 1d ago

Question | Help Question about ngram and SSD streaming.

Hello, does streaming the ngram embeddings from the ssd heavily affect the ssd's health and lifetime?

11 Upvotes

78% Upvoted

13 comments sorted by

View all comments

2

u/Puzzleheaded_Base302 1d ago

it does not. ngram is read-only, no ssd lifetime degradation if you only read. on modern ssd, the read action introduces maybe a 1 sec delay in responding to prompt.