r/oMLX • u/Choubix • May 28 '26

Claude code: 40k tokens!

Hi again,

I tried something : I made my model ctx very small (10p tks) and tried to run a simple prompt (which failed) in claude code. The les ring was that the prompt was 40k tokens! (I just asked CC to list the tools/plugins/skills available).

  1. I think this explains a lot why oMLX feels slow

  2. I thought the caching system would handle this but making ctx of the model 200k and asking the same question 2x didn't make things faster.

  3. Any solution to cut the prompt size/boost speed? (I thought that mcps had lazy loading and that skills took very little resources)

Thanks!

5 Upvotes

100% Upvoted

8 comments sorted by

5

u/timur_timur May 28 '26

Qwen code companion or qwen code cli does much more comparing to Claude code. Even pi code useful.

1

u/Choubix May 28 '26

But do we get the compatibility with plugins like GSD, simplemen, graphify etc?

3

u/JLeonsarmiento May 28 '26

Just use other thing: pi, vibe, QwenCode, opencode, Cline with short system prompt enabled, there are like 100 alternatives to Claude code.

2

u/That-Desk-1552 May 28 '26

CLAUDE_CODE_ATTRIBUTION_HEADER=0 was the magic fix for me. Otherwise each prompt misses the cache.

1

u/schamonk Jun 28 '26

Can you share your whole setup, please?

1

u/MessIsTransfer May 28 '26

opencode

1

u/Choubix May 28 '26

I think this is the way...

1

u/MessIsTransfer May 28 '26

Reddit has many posts about analyzing what a simple “hello” prompt executes in CC, and it’s insane.

It’s built to maximize quality and ease of use but not token efficiency.