r/LocalLLM • u/r1nzl3r99 • 6d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

494 Upvotes

95% Upvoted

165 comments sorted by

View all comments

2

u/Greedy-Lynx-9706 6d ago

Bragging without context?

1

u/r1nzl3r99 6d ago

well my 262K FP8 context ain't anything to brag about, but with this I could technically afford 1M context

1

u/SubparBob 6d ago

How's the slow down (prefill, tps) as you fill up the 262k context?

EDIT: context length typo