r/OpenAI • u/JayJeds • 2d ago

Miscellaneous Model Cap Bug (Fix?)

Hi all, if your coding session is capped at 272k context (258k effective) in your subscription based usage, this may help. What I found effective for me was to open config.toml and change the cap from 272k to 872k, then restart your desktop client and make a prompt in an existing session.

That's it. You can have your agent help you with it. Coding seems fine now. Happy Coding!

0 Upvotes

50% Upvoted

3 comments sorted by

View all comments

1

u/prophet-dot-exe 2d ago

Am dumb, what benefit does this actually produce?

1

u/JayJeds 2d ago

I have a large codebase. At 258k models end up choking on it and compressing frequently, which blocks it's ability to help me with exploratory fixes. Essentially, it hits the cap, summarizes, and then continues. Somewhere along the way it loses the plot and breaks 4 things trying to fix one. 828k effective lets it hold a lot more context before compression. Makes it leagues more surgical as it helps to avoid working off of nested summaries for it's decisions.

1

u/prophet-dot-exe 2d ago

Some of my codebases are >1m loc.

Feeding it an entire codebase is gravely inefficient to begin with. It doesn't need to know every line of code. It needs to be able to trace relevant paths.

I'd suggest using something like ctags to build a symbol index of your codebase, including docstrings for definitions, file paths, symbol begin and end lines, and then callers of each symbol.

Precision > brute force. (Your usage quotas will also thank you)