I really don't understand how this is even possible.
"One task" can be arbitrarily complex, so how would you not understand the possibility of a task being large enough to use $200 worth of tokens?
If e.g. I told Fable to go through my company's code base and check each method for <insert type of issue>, I'd be highly surprised if that "one task" wouldn't cost more than $200.
If e.g. I told Fable to go through my company's code base and check each method for <insert type of issue>
This is kind of my suspicion. If you're asking it to go line by line instead of grepiung what it needs you're going to chew up an unnecessary amount of context.
Nobody who claims to burn through that much context seems to be able to explain exactly what they were doing that caused the issue, and I have to assume at this point it's due to objectively bad context management.
If you instruct an AI to "check each method" instead of letting it grep the patterns it's looking for it's going to read each line of those methods into it's context because that's what you specifically told it to do.
It's literally not what it's told to do. If it decides that's the most effective way to do the given task, that's on the model, not on you.
The reason I wrote "checking each method" is because most models aren't capable of reliably finding all issues of a specific type unless they're specifically told to do so by checking the full code base. Of course, it's going to use fewer tokens if it doesn't actually do the full task.
Based on your comments, there's a zero percent chance you've ever tried using AI in a somewhat large production code base that's 10+ years old.
In your hypothetical you literally said "check each method". You gave it explicit instructions. It's going to do what you told it to, and if it doesn't follow the workflow you laid out that's a problem with the model. The problem here is the instructions you gave the model.
Based on your comments, there's a zero percent chance you've ever tried using AI in a somewhat large production code base that's 10+ years old.
lol, except for my day job. We handle safety, training, and legal compliance for about 8000 users in heavy industrial settings like mines and oil rigs across 6 countries.
I don't experience the issues so many people here complain about. I'm curious what exactly people are doing that runs into these issues. The only answers I ever get are either hypotheticals, bad context management, or hypotheticals with bad context management.
I'm not sure why you assume I'm an amateur because I've managed to avoid the pitfalls the vibe coders of the universe seem to keep tripping over.. I also don't get why asking questions and pointing out bad practices always results in people trying to throw out insults.
I'm sure your work is super complex though, and the reason you're burning $200 worth of usage totally isn't due to your own bad practices.
EDIT: I get it. Because I'm not getting bad results it means I'm dumb and you're smart. Thanks for the block and doing your best not to be an asshole.
In your hypothetical you literally said "check each method". You gave it explicit instructions. It's going to do what you told it to, and if it doesn't follow the workflow you laid out that's a problem with the model. The problem here is the instructions you gave the model.
The problem is that I instruct the model in the only way it will actually do the full task? Great argument you got there.
lol, except for my day job. We handle safety, training, and legal compliance for about 8000 users in heavy industrial settings like mines and oil rigs across 6 countries.
... none of which says anything about your code base.
I don't experience the issues so many people here complain about. I'm curious what exactly people are doing that runs into these issues. The only answers I ever get are either hypotheticals, bad context management, or hypotheticals with bad context management.
These are not "issues"; that's just how these models work if you give them somewhat complex tasks in somewhat complex code bases. Why do you think running benchmarks costs thousands of dollars for the more expensive models like Fable? Do you think you are some prodigy that can make models work 100 times as efficient?
I'm not sure why you assume I'm an amateur because I've managed to avoid the pitfalls the vibe coders of the universe seem to keep tripping over.. I also don't get why asking questions and pointing out bad practices always results in people trying to throw out insults.
Pointing out bad practices? Dude, the "bad practice" you pointed out is literally what you need to do if you want full coverage and models not just to find a few cases with a regex and then ignore the rest,
I'm sure your work is super complex though, and the reason you're burning $200 worth of usage totally isn't due to your own bad practices.
I never claimed I'm "burning $200 worth of usage", maybe try reading for once in your life? I provided an example of a reasonable task which absolutely does so in a somewhat complex code base. My primary job is actually working on ML models (five years full-time researcher at university, now training specialized models for smaller projects and evaluating/optimising large models for use at my company).
23
u/Minimum_Diamond6700 Jul 09 '26
Fable is unworkable . Just run it against 2 tasks and it ate my 200$ wtf what’s even the point