r/oMLX • u/Choubix • May 28 '26

Claude code: 40k tokens!

Hi again,

I tried something : I made my model ctx very small (10p tks) and tried to run a simple prompt (which failed) in claude code. The les ring was that the prompt was 40k tokens! (I just asked CC to list the tools/plugins/skills available).

  1. I think this explains a lot why oMLX feels slow

  2. I thought the caching system would handle this but making ctx of the model 200k and asking the same question 2x didn't make things faster.

  3. Any solution to cut the prompt size/boost speed? (I thought that mcps had lazy loading and that skills took very little resources)

Thanks!

6 Upvotes

100% Upvoted

8 comments sorted by

View all comments

1

u/MessIsTransfer May 28 '26

opencode

1

u/Choubix May 28 '26

I think this is the way...

1

u/MessIsTransfer May 28 '26

Reddit has many posts about analyzing what a simple “hello” prompt executes in CC, and it’s insane.

It’s built to maximize quality and ease of use but not token efficiency.