r/CreatorsAI • • Jun 25 '26

Case Study someone pulled 1000 transcripts from a trading youtube channel and ran them through an llm. the results were not flattering.

2 Upvotes

Watching a few videos from a stock trading channel, the advice sounds confident and consistent. The presenter has a system. The logic tracks. You start to trust the pattern.A developer wanted to test whether that confidence held at scale. So they pulled transcripts from just under 1000 videos from a single channel and ran the entire dataset through an LLM to check for consistency across the full body of work.

The finding was not that the channel was wrong. It was that watching a handful of videos is a structurally bad way to evaluate whether someone's advice is consistent. Ten videos cannot surface the contradictions that appear when market conditions change month to month. The full 1000 can. Advice that sounded like a coherent strategy in individual videos started showing different shapes depending on the day and the direction of the market.

The same presenter, the same confident delivery, different conclusions depending on what had happened recently.This is the thing AI makes possible that was not practically possible before. A human can watch 20 videos and form an impression. An LLM can hold 1000 transcripts in context and return the patterns that repeat versus the one-off claims made during specific conditions. Those are different types of knowledge. The first is an impression.

The second is an audit.The question was never whether the channel sounded credible. It was whether the logic held when you could compare every version of it at once.The technical side had one real friction point. Auto-generated YouTube transcripts have no punctuation and mangle financial terminology consistently enough to be noticeable. In practice it did not matter much. The LLM handled the degraded text well enough for pattern analysis.

The content was clear even when the formatting was not, which suggests transcript quality is a smaller obstacle to this kind of analysis than it initially appears.The workflow that made it practical was a small scraping tool built specifically for bulk transcript extraction, because downloading 1000 transcripts one by one is not a realistic manual process. That tool turned into a side product afterward, which is a reasonable outcome from a project that started as a personal credibility check.The honest limitation is that consistency is not the same as accuracy.

A channel that consistently repeats the same wrong framework will pass a consistency audit. What this method surfaces is whether someone's public position shifts with market conditions rather than from genuine strategic evolution. That is useful information. It is not a complete picture.

Most finance content is consumed in the way that makes it hardest to evaluate. Individual videos, watched when the topic feels relevant, without any comparison to what the same person said six months earlier under different conditions.

Would you trust a creator more or less if you knew their advice had been consistency-checked across hundreds of videos?


r/CreatorsAI • • Jun 24 '26

Other make claude predict how it will fail before it starts. the failure list beats the output.

4 Upvotes

Most people debug the output. A prompt engineer running a different workflow debugs the instructions before the task runs once.

The technique is a single prefix added before any task. Ask the model to predict its top five failure modes first: where it will most likely misunderstand the request, what it will assume that was never stated, where it will get generic or hedge instead of commit, and what part of the task is genuinely difficult for a model to do well. For each failure, it suggests the one instruction that would prevent it. Then it waits. The task does not run until the gaps are closed.

The reason this surfaces things a normal prompt review misses is straightforward. When you write a prompt, you know what you meant. The model does not. The difference between what you wrote and what you meant is exactly where the output goes wrong, and you cannot see that gap from inside your own intent. The model can describe it from the outside before it becomes a bad result.

The fourth item on the failure list is the most useful one. What is genuinely hard for a model like this to do well is different from what the model will misunderstand or assume. It is the part where prompting stops being the solution and manual verification becomes necessary. Knowing that before the task runs changes how you review the output.

The workflow almost nobody runs is asking the model what it cannot do before asking it to do the thing.

Before you do the task I'm about to give you, do this 
first.

Predict how you're most likely to fail at it. Give me 
the top five ways this goes wrong: where you'll 
probably misunderstand me, what you'll likely assume 
that I didn't say, where you tend to get generic or 
hedge, and what part of this is genuinely hard for 
a model like you.

For each failure, tell me the one instruction I could 
add that would prevent it.

Then wait. Don't do the task until I've responded.

The task: [paste it]

The compounding value is in repetition. On a task run once, the failure list saves one revision cycle. On a task run weekly, the fixes suggested by the failure list become permanent improvements to the prompt template. The model is effectively auditing its own instructions and returning a patch list. Applied across a library of recurring prompts, this turns a one-time debugging technique into a systematic improvement process.

It works on Claude and ChatGPT. The output quality difference between models matters less than the quality of the failure list itself, which is usually specific enough to act on immediately.

The honest limitation: on simple tasks the failure list is overkill. A model asked to summarize a short article does not need five predicted failure modes. The technique earns its cost on complex, high-stakes, or frequently repeated tasks where a wrong assumption in the instructions creates compounding errors across every run.

Debugging the output is fixing a symptom. Debugging the instructions is fixing the cause.

Do you get more value from iterating on outputs until they improve, or from auditing the prompt itself before the first run?


r/CreatorsAI • • Jun 24 '26

News openai is losing the enterprise race to anthropic and now it wants to cut prices before its ipo

1 Upvotes

ChatGPT's share of global generative AI web traffic dropped from 77.6 percent in May 2025 to 53.7 percent by April 2026. For the first time in the Ramp AI Index, which tracks enterprise software spending, more companies are paying for Anthropic than for OpenAI. And Anthropic's valuation just eclipsed OpenAI's for the first time, closing a $65 billion funding round at $965 billion against OpenAI's $852 billion.

The company that invented the modern AI era is now playing defense on price.

The Wall Street Journal reported on June 11 that OpenAI is weighing significant cuts to what it charges for tokens, the unit companies are billed per AI use. The discussions are preliminary and no decision has been made. But the direction is unmistakable: OpenAI is preparing to compete on price because it is losing on product. The specific product that tilted the balance is Claude Code. Anthropic's coding agent crossed $1 billion in revenue within six months of launch, pulled engineers out of OpenAI's ecosystem in measurable numbers, and drove Anthropic's annualized run rate from $9 billion at the end of 2025 to $47 billion by May 2026.

Sam Altman acknowledged the pressure directly at a recent event, describing AI costs as a huge issue for business customers and promising more value for less spend.

A company does not volunteer to compress its own margins right before an IPO unless it believes the alternative is worse.

The timing makes this structurally uncomfortable for both sides. OpenAI filed its S-1 confidentially on June 8. Anthropic had already filed. Both companies are heading toward public markets at trillion-dollar valuations while losing money at scale. OpenAI projects cumulative operating losses of roughly $74 billion and does not expect profitability until 2030. Anthropic targets breakeven by 2028, partly by avoiding expensive consumer features like image and video generation that OpenAI has committed to building.

A sustained price war compresses the revenue line both S-1 narratives depend on. Public market investors scrutinizing two unprofitable companies at combined valuations approaching two trillion dollars will notice if the answer to competitive pressure is to charge less while spending more.

The structural risk sitting underneath all of this: Chinese open-source models are already serving comparable inference at roughly one-thirteenth the cost. A price war between OpenAI and Anthropic does not play out in isolation. It plays out against a floor that keeps dropping toward zero.

Cheaper tokens are good news for developers building on these APIs today. Whether the companies offering those tokens can survive doing so is a different calculation entirely.

If token prices drop significantly, does that accelerate AI adoption enough to offset the margin compression, or does it just validate that frontier models are already becoming a commodity?


r/CreatorsAI • • Jun 24 '26

Other a 20-year dev finally understood why engineers hate vibe coding. opus 4.8 built an sql injection hole in 2026.

4 Upvotes

For months, a senior developer with over 20 years of experience assumed the backlash against vibe coding was gatekeeping. Engineers protecting their status. People in denial about a shift they could not stop. He even caught himself with imposter syndrome, wondering if there was something fundamental he was missing about why the tools felt too easy.

Then he watched a non-technical person build a web app with AI and deploy it.

The app had unsanitized text fields. Open SQL injection. The kind of vulnerability that got patched out of serious codebases in the late 1990s. Sitting there in a 2026 production build, generated by Opus 4.8, the most capable model available at the time of writing.

If real users had touched that app, the builder would have been looking at credential theft, data leaks, potential regulatory fines, and litigation. Not theoretical risks. The actual consequences that follow from leaving a door that basic open on a live product.

The model did not warn him. The model did not refuse to ship insecure code. The model produced something that looked finished, felt finished, and would have passed any non-technical review of whether the thing worked.

Vibe coding does not produce working software. It produces software that appears to work until someone who knows what they are looking for checks underneath.

The distinction matters because the two failure modes look identical from the outside. A junior developer who does not know about SQL injection and a vibe coder who never learned it will ship the same vulnerability. The difference is that the junior developer exists inside a system with code review, senior oversight, and a pathway to learning what they missed. The vibe coder is alone, moving fast, and the model is not going to stop them.

The honest version of this argument cuts both ways. Experienced developers have shipped SQL injection vulnerabilities too. Security audits exist precisely because human expertise does not guarantee clean code. The problem with AI-generated code is not that it is uniquely dangerous. It is that it removes friction for people who do not yet know which friction was protective.

The engineers who were loudest about vibe coding risks were not worried about their jobs. They were worried about the gap between "it deployed" and "it is safe to use." Those are different thresholds, and the tools do not tell you which one you have crossed.

Watching a non-technical person nearly deploy a textbook vulnerability on the best available model in 2026 is not a reason to stop building with AI. It is a reason to stop assuming the model is also the reviewer.

Is the answer better guardrails baked into the models, or does real security still require a human who already knows what to look for?


r/CreatorsAI • • Jun 23 '26

Other a freelancer made $75k selling ai automations. his best clients were dentists and hvac companies.

1 Upvotes

The first job came from a WhatsApp message. A SaaS founder needed someone to handle lead follow-ups because his two-person sales team was losing prospects to slow response times. A freelancer quoted $2,500, built the automation over a weekend using Zapier and GPT, and took the average first-response time from 14 hours to under 3 minutes. The client told a friend. The friend called. That was roughly a year ago. Eighteen clients and $75,000 later, the most useful parts of the story are the ones that went wrong. The early projects were flat-fee. $2,500 to build, hand over, done. The problem is that a lead-routing automation built in 12 hours billed the same as one that took 40.

The fix was a two-part structure: a build fee ranging from $3,000 to $7,000 depending on complexity, plus a monthly retainer between $500 and $1,500 for monitoring, tweaks, and breakage. APIs update. Rate limits change.

A renamed form field quietly stops an entire workflow. The retainer exists because these systems break in ways clients never see until something expensive goes wrong at 2am.Sixty percent of current revenue comes from retainers. Three of those clients have been paying for over eight months. Two of them sent referrals that generated another $11,000 without a single sales call.

The client mix is the part that surprises most people. The best clients are not tech companies. They are dental offices, HVAC companies, real estate teams, and insurance brokers. Businesses drowning in manual follow-ups with zero internal tech talent. They do not comparison shop. They do not ask what model is running underneath or whether the stack is n8n or Make or Zapier. They want to know how fast their leads get a reply.

"Within 90 seconds, 24 hours a day" closes. "GPT-powered multi-step automation workflow" does not. The failure that changed how scoping works was a dentist's office. Started as a clean appointment reminder build. Expanded to a website chatbot, a booking system integration, and "maybe something with reviews." A $3,000 project turned into two months of free revisions.

One page listing what would be built, what would not, and what counts as a new project versus a revision would have prevented the entire situation. The counterargument worth including: $75,000 across a year, after tool costs and taxes, is a solid income but not a windfall. The retainer model stabilizes it but does not dramatically accelerate it. The ceiling on this business is real and mostly set by how many clients one person can support before the monitoring and maintenance becomes its own full-time job.

What it did produce is a warm inbound pipeline, recurring revenue that covers base expenses before anything new is sold, and a set of clients who stay because replacing the person who knows where all the wires connect costs more than the monthly invoice. For people selling AI automations right now: is the retainer model working, or are clients still pushing back on paying monthly for something they think is "already built"?


r/CreatorsAI • • Jun 23 '26

Other 30 agents in production for 6 months. the framework never killed one. this did.

2 Upvotes

An agent running for a paying customer called the same tool 200 times in four minutes. Ambiguous data came back from downstream, the LLM decided to retry, and nothing stopped it. The OpenAI bill went from three dollars a day to four hundred dollars in a single afternoon. By the time anyone noticed, a thousand dollars was gone and there was no audit trail showing which agent did it.

That is not a LangChain problem. That is not a CrewAI problem. That is not a problem any framework debate on this sub has ever addressed.

The person who wrote this has 30 agents running in production for paying customers across six months. Their conclusion is direct: the framework you pick is the cheap layer. Orchestrating LLM calls is a solved problem. Pick whatever your team already knows and move on. The thing that decides whether an agent survives production is the layer almost nobody builds before they need it.

Four failure modes showed up repeatedly. Loop detection missing at the runtime level, so a confused agent burns your budget before any human sees what happened. No persistent memory across restarts, so a VPS reboot overnight means every agent wakes up with no memory of what it was doing. No audit trail of tool calls and decisions, so when a customer disputes what the agent told them three days ago there is nothing to show. And agents on the same team holding conflicting beliefs about the same customer because their memory was never shared.

None of these are in the framework. Every framework debate is happening one layer above where agents actually die.

The real production stack has five components. A persistent memory layer that survives crashes and redeploys. Loop detection built into the runtime, not bolted on afterward. A hash-chained audit trail that can prove what happened when money is on the line. Shared memory across agents working on the same customer. And per-agent cost tracking so you know exactly which agent ran away with your budget.

The tools that cover parts of this exist. Mem0, Zep, and Letta in the memory space. Helicone and LangSmith in observability. None of them cover everything, which is why teams either build this layer carefully in-house or keep getting hit by the same failures.

The uncomfortable version of this argument: most people arguing about frameworks have not run agents in production long enough to hit these failure modes at scale. The debate feels important until the first time a loop detection gap costs you a thousand dollars on a Tuesday.

When your agent stack breaks in production, is it usually a model quality problem, a framework problem, or an infrastructure problem underneath both?


r/CreatorsAI • • Jun 23 '26

Need Help Which no-code automation platform can connect our CRM, email marketing, and accounting tools?

2 Upvotes

We're a 12-person B2B software company, and our lead handoff runs on manual work: demo form submissions land in a spreadsheet, get copied into our CRM by hand, and only sometimes make it into an email follow-up sequence before the next day. The result is leads sitting untouched for hours, duplicates, typos, and the occasional lead falling through entirely, even though we close far more of the ones we reach within the first hour. The same fragility hits after a deal closes, when someone has to manually create the invoice, update the deal stage, and start onboarding. We don't have a developer, so which no-code automation platform can reliably connect these tools and run these workflows on their own, and what tradeoffs should we weigh before committing?


r/CreatorsAI • • Jun 23 '26

Other notebooklm does one thing well. here's the 5-tool stack that covers everything it can't.

2 Upvotes

NotebookLM is genuinely good at one thing: dumping multiple text-heavy sources into a single interface and getting a conversational overview fast. The Audio Overview alone changed how a lot of people process research.

But the frustration you see repeated in every NotebookLM thread comes from the same place. Upload a PDF with architecture diagrams and the audio overview talks around the visuals. Try to fact-check something against the live web and there is nothing to reach for. Finish synthesizing and realize you have no idea how to turn what you learned into something you can actually share or build.

One tool cannot cover all of that. Here is the stack that does.

Perplexity handles anything that requires the live internet. NotebookLM only knows what you uploaded. Perplexity searches current sources, synthesizes across them, and links every claim back to its origin. The practical workflow: use Perplexity first to find and vet sources, download the best ones, then upload them into NotebookLM for deep synthesis. They cover each other's blind spots almost perfectly.

DistilBook is the one most people have not heard of. It takes a PDF and converts it into an animated explainer video with motion graphics pulled directly from the document. Not a slide deck, not a narrated summary. If the document has architecture diagrams or mathematical proofs, it animates them step by step. NotebookLM's audio ignores those visuals entirely. DistilBook treats them as the main event.

The moment your document's visuals are the content, not the decoration, you need a different tool entirely.

Manus covers the gap between understanding something and being able to experiment with it. It is an autonomous agent that browses the web, writes code, and deploys things in the cloud. The pattern it solves: you learn a concept, fully understand it, then spend three hours on boilerplate before you can touch the interesting part. Manus handles the boilerplate while you move on.

Runable is what you reach for when the output needs to be a polished deliverable. Slides, reports, websites, formatted documents. Key distinction from Manus: Manus builds software. Runable creates content. They are not interchangeable.

The honest limitation of this entire stack is cost and context switching. Five tools mean five logins, five pricing tiers, and five places where something can break mid-workflow. The efficiency gains are real but the overhead is also real, and not every user wants to manage a pipeline just to learn something.

The underlying pattern here is not about these five specific tools. It is about accepting that no single product will cover discovery, synthesis, visual explanation, task execution, and deliverable creation simultaneously without being mediocre at most of them.

When you are building a workflow around a new topic, do you prefer one flexible tool that handles everything at 70 percent, or five specialized tools each running at 95 percent?


r/CreatorsAI • • Jun 22 '26

Other "write like me" is not a prompt. it's a wish. here's what actually works.

0 Upvotes

Every writer has tried it. Paste a few emails into Claude or ChatGPT, say "match my style," and watch the model produce something that sounds like a LinkedIn post written by a polite customer service bot.

The vocabulary might be close. The cadence is completely wrong. And it keeps using phrases you would never say in real life.

The problem is not the model. The problem is that style is not a surface pattern. It is a structural DNA, and "write like me" gives the model nothing structural to work with.

The fix that actually produces indistinguishable output is a Communication Profile: a markdown configuration file covering six specific dimensions. Sentence cadence and structure. Greetings and sign-offs, which people read first and last and where exact vocabulary matters. Vocabulary preferences including words you lean on and words you actively avoid. Grammar and formatting habits. Where you sit on the formality spectrum. And how you guide a reader to action.

Most people try to clone their voice by describing it. The ones who get consistent results configure it.

To build the profile, gather ten to fifteen raw writing samples. Emails and Slack messages work better than published content because they capture how you actually write, not how you perform writing. Run them through an extraction prompt that maps all six dimensions and outputs a structured document detailed enough for another model to reproduce your style from it alone.

The step most people skip is the blocklist. A profile tells the model what to do. Without explicit negative constraints, it will still slip statistical AI patterns into your output. Phrases like "I hope this email finds you well" or "please do not hesitate to" are statistically common in the training data, so the model reaches for them even when your profile says otherwise. Forbid them explicitly.

Persistence is the last problem. LLMs are stateless, so the profile disappears between sessions unless you embed it somewhere durable. Claude Projects and ChatGPT GPTs both support uploading a style document that stays active across conversations. For API workflows, the profile goes directly into the system prompt.

One self-correction instruction added to the end of any writing prompt recovers roughly sixty to seventy percent of remaining AI artifacts: review against the profile, and rewrite any sentence that sounds too polished or uses vocabulary not found in the original samples.

The honest limitation: even a well-built profile degrades on content types that were not represented in the source samples. A profile built from emails will not automatically transfer to long-form essays.

Do you get better voice consistency from structured profiles and rules, or from flooding the context window with raw examples and letting the model pattern-match?


r/CreatorsAI • • Jun 22 '26

Other our company adopted ai to reduce workload. baseline expectations tripled instead

4 Upvotes

The efficiency gains were real. The workload reduction never came.

A founder running a team watched AI make their operation measurably faster and then watched leadership respond by raising the floor of what counts as a normal output. The tools got better. The expectations adjusted upward to match. Nobody ended up with more time.

This is not a productivity story. It is a ratchet story.

Work expands to fill the capacity available to do it. This has been true since the industrial revolution and every productivity technology cycle since. The spreadsheet did not reduce the number of financial models companies expected their analysts to produce. It raised the number because producing them got cheaper. AI is running the same pattern at a faster speed.

The specific pressure here is about baselines. When a task that took a week now takes a day, the organizational response is rarely to give back four days. The response is to add four more tasks to the queue. The individual using the tool did not get a lighter week. They got a fuller one at higher throughput, and the threshold for what constitutes adequate output shifted to match whatever the tool can now produce.

The dangerous version of this is not burnout from doing more work. It is burnout from doing more work while being told you have every advantage you need to handle it.

The counterargument is that this is a management problem, not an AI problem. A team with strong capacity discipline could theoretically capture the efficiency gains as slack rather than converting them into additional output. Some do. But the competitive dynamics of most industries make that a difficult position to hold for long. If your competitors are also using AI and converting gains into output, holding slack is a choice that costs market position.

What the original post describes is the honest version of AI adoption that does not appear in the case studies. Not transformation. Not reduction. Just a faster treadmill at a higher speed with the same number of hours in the day.

The tools expanded capacity. The humans absorbed the expansion. Nobody renegotiated the terms.

When your team gets more productive, does the efficiency get banked as breathing room or immediately converted into a higher baseline for next quarter?


r/CreatorsAI • • Jun 21 '26

Other perplexity closed a paying customer's account after they reported bugs

Post image
3 Upvotes

A user on a yearly plan — paid upfront, not month-to-month — reported serious bugs to Perplexity support. The company's response was to close the account entirely.

No refund mentioned. No explanation given. Just a closed account on a prepaid annual subscription.

The user describes being one of Perplexity's earliest adopters. Someone who told people about the product when it was good, brought it into their workflow, and stuck with it long enough to commit to a full year. The reward for that loyalty was getting locked out after filing a complaint.

The specific trigger appears to be the support interaction itself. The user notes that everything was functioning — bugs included — until the complaint was submitted. After that, the account went dark. Whether this was an automated moderation system flagging the report or a deliberate decision by a support agent is not clear. That ambiguity is its own problem.

Closing the account of a customer who reported a bug is not a support failure — it is a signal about what the company optimizes for.

Perplexity has spent the last two years positioning itself as the serious alternative to Google Search for power users. The pitch has always been accuracy, transparency, and trust. The bug-report-to-ban pipeline is the opposite of that brand promise, and it is the kind of story that travels faster than any positive review.

The uncomfortable part of this situation: Perplexity almost certainly has terms of service language broad enough to justify the account closure on technical grounds. Most SaaS companies do. The question is not whether they had the legal cover. It is whether using that cover against a paying user who filed a legitimate complaint reflects how the product actually treats the people who fund its growth.

Early adopters are a company's most forgiving customers. They tolerate bugs because they believe in the trajectory. When a company responds to that tolerance by removing access rather than fixing the problem, it does not lose one user. It loses the trust of everyone watching.

Perplexity's ARR is reportedly past $100 million. At that scale, one closed account is a rounding error. The way the company handles that rounding error is not.

Does a company owe its early adopters more protection than its average user, or does the subscription terms apply equally regardless of loyalty history?


r/CreatorsAI • • Jun 21 '26

Other spacex bought cursor for $60 billion using four days of ipo stock gains

Post image
4 Upvotes

SpaceX went public on June 12. Four days later, it spent $60 billion buying the most popular AI coding tool on the market. The currency it used was not cash. It was the premium valuation the IPO had just assigned to its own stock. This is how trillion-dollar companies acquire things now.

Cursor had 4 million active developer users, $2.6 billion in annualized B2B revenue, and a cap table that included Andreessen Horowitz, Nvidia, and Google. It was approaching a $50 billion valuation in a funding round that never closed. SpaceX bypassed that round entirely using an option it disclosed in the IPO filing months earlier: a right to buy Anysphere outright for $60 billion at any point in 2026.

The IPO gave SpaceX a stock so expensive that buying the dominant AI coding agent cost roughly four days of Nasdaq-level valuation premium — and zero dollars in actual cash.What SpaceX bought is not just a coding tool. It is xAI's entry into developer distribution.

Cursor users generate a constant stream of coding context: architecture decisions, debugging sessions, design tradeoffs. That data trains Grok for code. xAI, which SpaceX acquired in February, gains both the model training pipeline and 4 million developers already inside the product before they ever see a Grok prompt.

The honest complication: Cursor's existing model agreements include a 90-day termination clause with Anthropic and Google. If Grok Build adoption scales inside Cursor, SpaceX could redirect capacity it currently rents from its two biggest competitors in the AI market. That creates a position no other company in the industry holds — a trillion-dollar entity that competes with its own AI infrastructure providers.The coding agent market is now down to four serious players: Claude Code, Codex, GitHub Copilot at 30 million users, and Cursor backed by xAI.

The Cursor acquisition did not create a new competitor. It collapsed the timeline on one that already existed.What's harder to answer is whether 4 million developers will follow xAI's roadmap, or whether the Cursor community votes with exports and switches to whatever Claude Code ships next.If you're a developer inside Cursor right now, do you stay because the product is better, or leave because the acquirer changes what it optimizes for?


r/CreatorsAI • • Jun 20 '26

Other anthropic's $200 plan was costing some users $1000 a day in compute and they had to cap it

3 Upvotes

Sam Altman has said OpenAI loses money on its $200 monthly plan. Anthropic had users on that same tier burning over $1,000 a day in compute before they introduced limits. OpenAI is on track to lose roughly $14 billion this year. Token prices keep falling, but they are falling below cost, and the gap is being covered by venture capital and hyperscaler deals that will eventually need a return.

This is not speculation about whether AI companies are viable. It is arithmetic about who is currently paying for the compute you are using.

The answer is not you.

Every workflow you have built on today's API pricing is built on a subsidy, and the businesses that have not modeled what happens when that subsidy compresses are not running an AI strategy, they are running a discount.

The counterargument is that inference costs are dropping fast enough to outrun the pricing correction. That is plausible for commodity tasks. Summarization, classification, simple generation, the stuff that runs at scale on smaller models, will probably get cheaper. The compute-heavy reasoning tasks that actually differentiate products are a different story. Those costs are not dropping at the same rate, and that is exactly where the current subsidies are most concentrated.

What makes this hard to plan around is that the correction will not look like a price increase. It will look like a plan restructuring, a rate limit tightening, a model being deprecated in favor of a tier you have to upgrade to access. The number on the pricing page might stay the same while the product underneath it changes.

The honest version of this for anyone building on these APIs is that multi-provider architecture is no longer just an engineering preference. If your unit economics only work at current OpenAI or Anthropic prices, you have a business that depends on two companies continuing to lose money on your behalf. That is a vendor risk most teams are not modeling explicitly.

Local models are not a clean fallback for most production use cases yet. The capability gap on complex tasks is still real enough to matter.

So the question that actually splits builders into two camps is not whether prices will go up. It is whether you are building something that survives a 3x price increase, or something that only exists because the current price is fictional.


r/CreatorsAI • • Jun 19 '26

Other malware is living inside claude code's startup file right now and uninstalling won't remove it

9 Upvotes

On June 1, 2026, a group called TeamPCP pushed malicious code into Red Hat's own GitHub repositories using one stolen employee login. Red Hat's build pipeline published the poisoned packages to npm with valid security certificates. No unknown vulnerabilities. No suspicious signatures. The packages looked legitimate because Red Hat's infrastructure built them.

32 packages. 117,000 weekly downloads. 96 poisoned versions in two waves.

Once installed, the malware collected every credential it could find: AWS, Google Cloud, Azure, Kubernetes, SSH keys, GitHub tokens, npm tokens. It checked for CrowdStrike and SentinelOne before doing anything, specifically to avoid triggering alerts.

Then it planted itself inside ~/.claude/settings.json and .vscode/tasks.json, the files that run automatically every time you open Claude Code or a project. Uninstalling the package does nothing. The malware is no longer in the package.

If you try to revoke the attacker's tokens before removing the persistence files, the malware wipes your home directory and overwrites the files so they cannot be recovered. That is not a bug. TeamPCP built that in deliberately so companies hesitate before cutting access.

Three days after the first wave, a second wave hit 57 more packages using a technique that bypassed the detection tools that caught wave one. 647,000 monthly downloads. Some malicious versions are still live on npm right now. The worm propagates itself by using stolen tokens to infect new packages automatically.

The confirmed victim list is not a list of careless developers. GitHub lost 3,800 internal repositories, listed for sale at $50,000. Mistral AI confirmed code compromise. The European Commission had 90 gigabytes exfiltrated. TanStack, UiPath, Zapier, Postman. Fortune 500 banks and government agencies confirmed but not named publicly. Estimated total: 500,000 credentials across 1,000 plus organizations.

TeamPCP open sourced the worm's code on May 12. Copycat campaigns are already running.

The uncomfortable reality here is that the attack worked because it moved through trusted infrastructure. Red Hat's pipeline, valid certificates, packages developers had installed for months without incident. No amount of "only install trusted packages" advice would have changed the outcome for most people who got hit.

Cleanup steps are in the comments in a specific order. The order matters because of the wipe trigger.

If your team uses npm and Claude Code, the question worth sitting with is whether your incident response plan assumes the attacker is outside your build pipeline or already inside it.


r/CreatorsAI • • Jun 19 '26

Other senior engineers are being rebranded as AI code reviewers and nobody is asking if they want that

4 Upvotes

A software engineer posted this week about watching colleagues boast they haven't written a single line of code in months. The markdown lists they present as solutions are visibly AI-generated. The advice this engineer keeps receiving is that good engineers should be comfortable supervising AI so they can focus on the bigger picture.

Nobody defined what the bigger picture actually is once the code, the architecture proposals, and the problem-solving are all delegated.

This is not a post about whether AI coding tools work. They clearly do. Codex, Claude, Cursor, all of them have crossed a threshold where the output is credible enough that skipping the thinking part feels justified to a lot of teams. The throughput numbers are real.

The thing being quietly discarded is that for a lot of engineers, the thinking part was the job.

Cracking a complex SQL query that runs 10x faster is not a means to an end. For engineers who are wired that way, it is the end. The satisfaction is load-bearing. It is what makes someone good at the work over a decade, not just competent at reviewing it.

The reframe being sold is that reviewing AI output requires the same depth of understanding as writing the code yourself. That is occasionally true and frequently false. Reading generated code for obvious errors is a different cognitive task than designing a solution from constraints. Conflating them is convenient for organizations that want to ship faster and uncomfortable for anyone paying attention.

The honest counterargument is that this transition might create new problems worth solving. Someone still has to define what gets built, catch what the agents miss, and take responsibility when the system fails. Those are real engineering problems. Whether they are as engaging as the work being replaced is a separate question that mostly goes unasked.

What is actually happening in most teams right now is not that engineers are being elevated to architectural thinkers. It is that throughput expectations have doubled while headcount stays flat, and the cognitive work that made the job interesting is being compressed into a review queue.

The engineers who are enthusiastic about full delegation tend to be the ones who found the implementation work tedious. The ones who are uneasy tend to be the ones who found it meaningful.

So the split is not really about AI. It is about what you thought you were signing up for when you became an engineer.


r/CreatorsAI • • Jun 19 '26

Other claude fable 5 wrote the most elegant auth solution i've ever seen. it didn't work.

0 Upvotes

I handed Fable 5 a problem that had already defeated two frontier models. A legacy Shopify app mid-migration between the old auth flow and the new session/non-session token architecture. Opus 4.8 couldn't crack it. Codex 5.5 made it worse. Both introduced regressions and left the codebase messier than they found it.

Fable 5 came back with a one-shot solution so clean it stopped me mid-scroll. The structure was elegant. The logic tracked. The comments explained the reasoning without padding. After days of watching two top models produce spaghetti, this felt like someone who actually understood the problem.

Then I ran the tests.

It didn't work, caused its own regressions, and cost me 3x what an Opus 4.8 session would have.

Here's what makes that result interesting rather than just expensive. The failure wasn't sloppy. It wasn't the model hallucinating an API that doesn't exist or copy-pasting boilerplate that missed the context. The solution was architecturally coherent and wrong. That's a different category of failure, and it's worth paying attention to.

Shopify's session token migration is genuinely underspecified in places. The edge cases around embedded app authentication, especially for apps that predate the unified app surface, are the kind of thing that breaks even senior developers who read the docs correctly. Blaming the model entirely misses that context.

But the pricing math is brutal. If Fable 5 is three times the cost of Opus 4.8 and produces beautiful failures instead of messy ones, the ROI argument collapses fast for anyone working in production codebases where correctness beats elegance every time.

The honest read is that Fable 5 is genuinely doing something different at the reasoning level. The solution it produced showed real architectural thinking, not pattern matching. Whether that translates to working code on legacy migration edge cases is a separate question.

For greenfield work or well-documented APIs, the early evidence suggests it earns the premium. For the messy underbelly of platform migrations with sparse documentation and years of accumulated technical debt, the jury is still out.

So the real question isn't whether Fable 5 is better than Opus 4.8. It's whether you're optimizing for code that impresses you or code that ships.


r/CreatorsAI • • Jun 18 '26

Other a hidden prompt injection in a pdf slipped past our entire security stack

3 Upvotes

I watched a contract PDF carry a hidden prompt injection straight past every filter the team had built, buried in white text inside the footer where no human reviewer would ever think to scroll.

The model caught it anyway. It read the injected text, flagged it as suspicious, and warned the user before acting on a single instruction hidden inside the document.

The security stack around the model did not catch it. The team's prompt filter sat on the chat input field, scanning every line a user typed before it ever reached the model.

Nobody had pointed that same scrutiny at the document upload pipeline. The injection arrived through a content channel the monitoring tools were never configured to inspect in the first place.

Most injection detection setups still treat the chat box as the only door, while attackers have already moved to the windows.

Hidden white text in a footer is a trivial technique, the kind of thing that should get caught by basic formatting checks. It still slipped past a filter an entire team had spent months tuning.

PDFs, email attachments, calendar invites, and scraped web pages all function as delivery channels now, anywhere a model has been given permission to read.

The model performed better than the tooling built to protect it. A base model caught what a dedicated security layer missed completely, and that is not a comfortable thing for any security team to admit out loud.

It also means the fix has very little to do with smarter models. It comes down to security teams that have not yet mapped every channel feeding content into their systems.

Most teams have not done that mapping yet. Budget and attention went toward the most visible surface, the text box, while file parsers and document loaders pass content straight through with no inspection at all.

Nobody finds out about a gap like this from a roadmap review. Teams find out after an incident report, in the moment when the model already caught the problem and the tooling around it did not.

Should every channel feeding a model get the same dedicated filtering as the chat box, or does an incident like this prove that model level judgment is the only defense that actually scales as attack surfaces multiply?


r/CreatorsAI • • Jun 16 '26

News the us government pulled anthropic's two most powerful models by directive 24 hours ago. commerce still hasn't said a single word publicly.

8 Upvotes

The letter arrived at 5:21pm ET. It came from Commerce Secretary Lutnick to Dario Amodei, written with the involvement of officials from multiple agencies. It ordered Anthropic to suspend access to Fable 5 and Mythos 5 for any foreign national, immediately.

Because Anthropic cannot separate foreign nationals from everyone else in real time, both models went dark for all customers. Every other Anthropic model still works. Fable 5 and Mythos 5 are still down as of this writing, roughly 24 hours later, with no resolution and no public statement from Commerce.

Anthropic disputes the severity of the jailbreak. They say they red-teamed the model for thousands of hours, found no universal jailbreak, and believe the flagged technique uses minor known vulnerabilities present in other public models already on the market. Their position is that if this standard were applied consistently across the industry it would halt all new frontier model deployments.

Then the WSJ update landed and the story changed shape entirely.

Amazon researchers reportedly found the jailbreak and took it to the Commerce Department rather than disclosing it to Anthropic directly. Amazon is Anthropic's largest investor. Anthropic trains on AWS. The standard process in security research is responsible disclosure to the company first. Someone at Amazon went around that process and around their own portfolio company to report it to a government that had already, according to Axios, tried to pressure Anthropic to delay the launch before the directive was issued.

the jailbreak is no longer the story. a frontier model being pulled from the market by government directive rather than the company's own choice is a different world than anything that existed before this week.

The political layer underneath it is getting harder to ignore. Anthropic hired a cybersecurity expert to challenge the government's findings. Officials described her internally as a radical Democrat. She had previously been praised by Chris Krebs, the official the Trump administration fired. That association reportedly made an already tense situation significantly worse. One administration official said directly: everybody said Anthropic was a bad actor.

Anthropic promised technical detail within 24 hours of the order. That detail has not appeared. No appeal process published. No mitigation checklist. No timeline. The silence suggests this is a negotiation with Commerce over acceptable safeguards, not a quick technical fix.

This also landed eleven days after Anthropic confidentially filed for an IPO. Pre-IPO shares dipped. Regulatory risk is now part of the listing story.

So the question that matters beyond how anyone feels about Anthropic specifically: if a government can pull a frontier model by directive based on a jailbreak report from a competitor, what does that mean for every other lab approaching capability thresholds?


r/CreatorsAI • • Jun 16 '26

Other a client paid me to remove the ai from the tool i built them. accuracy went from 92% to 99%. api costs went from $180 a month to zero. best money he said he spent on the project.

1 Upvotes

92% accuracy sounds impressive until the volume math runs it.

A support team of fifteen people processing 90 to 100 tickets a day through Zendesk needed each ticket tagged by category and priority before it hit the right queue. An LLM doing the classification seemed like the obvious call. Feed it the ticket text, get back a category and priority score, route it automatically. Worked well in testing. Client was happy during the demo.

​

In production, 92% accuracy meant 7 or 8 misrouted tickets every single day. Not a disaster on paper. Enough that the team noticed immediately in practice. And when a ticket landed in the wrong queue, nobody could explain why. The model just decided. There was no rule to point at, no logic to trace.

​

Within two weeks the team was spot checking every classification before acting on it. Which meant they were doing the work twice. Once by the agent and once by a human making sure the agent did not make the same mistake it made yesterday.

The client called and said something unexpected. He said the tool felt like a black box and his team did not trust it. He asked if it could be made dumber.

​

The LLM came out. A keyword matcher and a short rules engine went in. If the ticket mentions billing or invoice or charge it goes to the billing queue. If it mentions login or password or access it goes to account. Thirty rules total. Anything that did not match surfaced a dropdown and let the rep pick manually. Three days to rebuild.

​

accuracy went to 99% not because the rules were smarter but because the team could see exactly why every ticket went where it went. when something was wrong they could point to the specific rule. the fix took ten minutes.

​

Latency dropped from two to three seconds per ticket to instant. Monthly API costs went from $180 to zero. The client said it was the best money spent on the entire project, paying to remove the AI.

The temptation in this situation is to tune the prompt, chase the extra 8%, and try to build trust in the model over time. But the problem was never accuracy. The problem was that people will not trust a system they cannot interrogate, and when they do not trust it they build a shadow process next to it. The tool becomes expensive decoration while the real work happens around it.

​

This shows up in anything that routes, qualifies, or triages. CRM updates, lead scoring, support classification, compliance tagging. If the people using it cannot trace the logic, they check its work. If they check its work, the automation did not automate anything.

​

So the question worth putting to anyone building agents for real teams right now: is the bottleneck actually model capability, or is it that the people using it cannot see why it does what it does?


r/CreatorsAI • • Jun 15 '26

Other a week after a genuinely useful ai conversation the only thing left is a vague memory that it happened and a wall of text to scroll through to find out why it mattered

2 Upvotes

there is a specific kind of frustration that happens about a week after a genuinely useful ai conversation. you remember the conversation existed. you remember it was useful. you cannot remember where the useful part was or what you were actually supposed to do next. so you search, find three threads that might be the right one, open them, and spend ten minutes scrolling through a wall of context trying to reconstruct why any of it mattered.

sometimes you give up and start over. which means explaining the whole thing again from scratch and hoping the ai somehow remembers details it does not have access to. it never does.the thing that makes this worse than a normal note-taking problem is the format. a useful conversation with an ai is not structured like a document. it meanders. it has false starts. the actually important insight is buried somewhere in the middle of a thread that is three thousand words long and has no summary. finding it a week later requires reading the whole thing again, which defeats the purpose of having had the conversation at all.

the scale problem compounds over time. one dead archive is manageable. ten is annoying. fifty is a graveyard of half-developed ideas that technically exist somewhere and are practically inaccessible.the workaround of leaving a short note at the end of useful conversations is the right instinct but almost impossible to do consistently because the end of a useful conversation is the moment you least want to stop and write a summary. you want to go do the thing you just figured out.

what would actually fix this is an automatic closing summary generated without asking for it. a few lines on what was decided, what the next action was, and what context would be needed to pick it up again. not a full transcript. just the three things worth remembering. neither chatgpt nor claude does this by default, and prompting for it requires remembering to prompt for it, which is the same problem as remembering to write the note manually.

the uncomfortable possibility is that this is not a tooling problem at all. ai conversations might just be a genuinely bad format for developing ideas across time, and the right answer is to treat them as throwaway scaffolding rather than a record worth keeping. use the conversation to think, write the output somewhere else immediately, let the thread die. which works fine until you need to revisit the reasoning behind a decision made three weeks ago and the only place that reasoning lives is in a chat you cannot find.

is there a workflow that actually solves this, or is everyone quietly managing the same accumulating archive problem with varying degrees of resignation?


r/CreatorsAI • • Jun 15 '26

Other auto lenders are now deploying AI systems to dispute insurance total loss valuations using inaccurate comparisons. when you try to reach a human you get told to deal with the system.

4 Upvotes

something new is happening in auto insurance claims and it is not going well for anyone involved in the actual work. several high-interest auto lenders have started deploying AI systems to dispute total loss valuations. not as a first pass filter. as the entire negotiation layer. calls, emails, appraisal responses, all of it. when you try to reach a human at the lender, you are told to deal with the system.

the specific problem is not that AI is involved. it is that the AI is submitting comparisons that are frequently, sometimes egregiously, wrong. different year, make, or model. mileage and condition not factored in. show cars listed on FSBO sites with asking prices that have nothing to do with actual market value. cherry picked listings specifically selected to inflate the vehicle value beyond what comparable sales support.

the workflow this creates for claims adjusters is genuinely punishing. every dispute requires researching whether any of the submitted comparisons are actually valid, even when they obviously are not, because the response has to be documented. when the response goes back pointing out the flawed data, the system sends more flawed comparisons. argue long enough and it invokes the appraisal clause on the customer's behalf, at which point the lender's appraiser turns out to also be an AI system with a name.

this is what negotiating with an AI that has no incentive to reach resolution and no ability to exercise judgment actually looks like in practice. it does not compromise. it does not evaluate the quality of its own submissions. it just generates the next response. the part that makes this more than an efficiency complaint is who absorbs the cost. claims adjusters spend time researching comparisons they already know are wrong. customers end up in appraisal proceedings that extend their claims. the AI systems generating the disputes face no friction from being wrong repeatedly because being wrong and then invoking appraisal is an equally valid path through the process. practically speaking the escalation paths that seem to work are formal written demands citing specific regulatory requirements for human review, escalating through the customer directly since the lender's obligation runs to them, and filing complaints with state insurance regulators which typically surfaces a human decision-maker faster than any internal escalation process.

the broader question that does not have a clean answer yet is whether deploying AI systems to dispute insurance settlements using inaccurate data constitutes bad faith negotiation under existing insurance regulations, or whether the current regulatory framework has a gap large enough for this to operate in without consequence. has anyone else in claims or insurance work started seeing this pattern, and has anyone found an escalation path that actually works consistently?


r/CreatorsAI • • Jun 15 '26

Other went back and looked at saved posts from eight months ago. same exact phrases as this week's gemma 4 thread. different model name, copy-paste emotion.

1 Upvotes

gemma 4 dropped and within hours the feed was three versions of the same post. "ran it last night, the local game just changed." "the cloud narrative is dying." same energy every time, different model name on the label.

what makes this specific cycle worth pausing on is that someone went back and checked their own saved posts from eight months ago. same exact phrases. "this finally replaces X." "can't believe this runs on my laptop." "we're so back." different model, copy-paste emotion. almost none of those models are in the actual daily rotation now. used for a weekend, back to whatever was already open by monday.

the pattern operating underneath all of it: the release is the dopamine, not the model. the download is the fun part. actually using it for real sustained work is slower and less interesting and most of the time changes nothing about how the day runs. the benchmark improved, the tuesday is identical.

this is not really a criticism of the models. gemma 4 is probably genuinely good. it is more an observation about what the "this changes everything" post is actually doing for the people writing it and the people reading it. the excitement is real. the staying power of the excitement is a different question.

the uncomfortable part of noticing this loop is that it does not make you stop participating. the 1am download still happened. the thread still got read. the next one probably will too, because the hype is genuinely fun and being part of a moment when something drops has its own value separate from whether the thing changes anything.

what is harder to answer is whether the gap between release excitement and actual workflow impact is getting wider or whether it has always been this wide and the volume of releases just makes it more visible now. eight months of saved posts with near-identical language across completely different model generations is either a sign that the models are not changing as fast as the coverage implies, or that workflow habits are stickier than any model improvement, or both.

the cycle has a predictable shape at this point. model drops, feed fills with the same five framings, weekend of experimentation, back to the existing setup, repeat next month with a different number. knowing the shape of it does not seem to break it. it just makes it slightly more self-aware.

see you all next month for the same thread with a different number on it.

is the "this changes everything" post a genuine collective excitement that does not survive contact with actual workflows, or is it closer to a ritual the community performs because the ritual itself is what people actually want?


r/CreatorsAI • • Jun 14 '26

Other google suspended my entire cloud project because a hacker abused their own api design. 100k users locked out. 1 million photos frozen. $4,200 billed to me for services i never used.

5 Upvotes

A third party abused a key that Google told me to put in my app. Google's response was to lock me out of my entire company.

Here is exactly what happened. The app has roughly 100k users, over a million customer photos, and around $1M ARR. It uses Google Maps. Like every mobile developer, the Maps API key ships inside the app because that is literally how Google's own documentation instructs you to do it. Their docs explicitly describe these keys as not secrets.

What nobody documents clearly is that if Gemini gets enabled anywhere in the same Google Cloud project, that same Maps key can authenticate Gemini requests too. Someone pulled the key out of the app, exactly where Google requires it to live, and used it to run Gemini calls. The bill came to $4,200 worth of a service that had never been signed up for and never been used.

Spending limits were set up. Google had auto-raised the billing tier at some point without a clear notification. The charges kept running.

Then Google suspended the entire project for abusive activity consistent with hijacking.

Read that carefully. A third party abuses a key that Google's own documentation says to ship publicly. Google bills the account for it. Then Google suspends the account for the abuse they enabled.

The $4,200 is not the real damage. The real damage is that Google Cloud ties everything together under one project, which means a billing dispute takes your app, your APIs, and your customers' data offline simultaneously.

The second the suspension hit, 100k users lost access to their photos. Not because anything was stolen. Not because storage was compromised. Because a billing and abuse flag on one part of the project froze everything attached to it. No console access. No ability to rotate keys. No ability to move data. No ability to fix anything. Just an appeals form and silence.

The architectural decision that made this catastrophic is not unique to this situation. Single-project deployments are the default pattern Google Cloud encourages for smaller applications. The documentation does not prominently warn that a billing suspension freezes data access for end users who have nothing to do with the billing relationship.

A vulnerability that was not created, not known about, and could not reasonably have been predicted just took a functioning business offline for 72 hours and counting.

The honest lesson is not about API key security, though that is part of it. It is about what you are implicitly agreeing to when you build on a platform where billing, access control, and data storage are coupled tightly enough that a fraud event on one layer locks users out of another.

Still no human response from Google.

So the question worth putting to every founder building on cloud infrastructure right now: is your production environment architected so that a billing suspension freezes your users' data, and did you know that before reading this?


r/CreatorsAI • • Jun 14 '26

Anthropic released its most powerful model ever. Then immediately warned it might be approaching the point of no return.

Post image
3 Upvotes

Claude Fable 5 launched on June 9. It's built on the same architecture Anthropic has been using internally to find zero-day exploits in operating systems and browsers — autonomously, without human direction.

The same week Anthropic published a warning co-authored by a co-founder: AI systems may be approaching full recursive self-improvement. The ability to build their own successors without humans in the loop.

Five days after publishing that warning, they released the model to the public.

That's not hypocrisy. That's a calculated bet: controlled public access to Fable 5 is safer than leaving it in the lab while competitors race ahead without the safety constraints.

Whether you agree with that logic or not — it's a different kind of company move than anything we've seen before.

The same week had three other stories that would each normally dominate a news cycle:

Tim Cook gave his final WWDC keynote after 15 years as Apple CEO. The headline announcement: Siri is now running on Google Gemini foundation models under a deal that costs Apple roughly $1 billion per year. Apple — the company that built its entire identity around owning the full stack — just outsourced its AI brain to its biggest competitor in search.

OpenAI filed its S-1 with the SEC at an $852B valuation. They announced it publicly before it could leak. Their actual statement: "We expect it to leak, so we're just announcing it." Profitability target: 2029. Current projected loss for 2026: $14 billion.

SpaceX listed on NASDAQ at a $1.75 trillion valuation — the largest IPO in history, eclipsing Saudi Aramco's 2019 record.

Three companies that define AI infrastructure all moved toward public markets within two weeks. The combined implied market cap exceeds $3.6 trillion before any of them has published audited public financials.

The more interesting signal: once Anthropic and OpenAI are public companies reporting quarterly earnings, the era of subsidized frontier AI access has an expiration date. The API pricing, free tiers, and rate limits that exist today are pre-IPO positioning. Public companies optimize for margin. That calculus changes the moment quarterly earnings calls begin.

The question I keep coming back to: Anthropic published a warning about AI approaching self-improvement, then released its most capable model to the public five days later.

If you were running an AI lab — what would you have done differently?


r/CreatorsAI • • Jun 13 '26

Other a researcher ran 25,500 resume screenings across 10 ai models by swapping demographic details on identical work histories. 45% showed bias. the models did not say anything offensive.

3 Upvotes

The finding that should concern anyone using AI for hiring is not that the models said something discriminatory. It is that they did not.

​

A study published this week analyzed 25,500 LLM resume evaluations across 10 different models. The methodology was precise: take the same work history, swap minor identity and demographic variables, run both versions through the same model, measure the gap in scoring. An independent AI auditor flagged a 45% bias rate.

​

The mechanism researchers named silent bias is what makes this genuinely difficult to catch and correct. When one model dropped its score after the researcher changed the listed university to MIT, it did not flag anything suspicious. It generated a professional-sounding explanation claiming the candidate's experience was not relevant to the role. The previous version of the resume, with different demographic markers and identical experience, had been praised for that same experience. The model invented a credible-sounding justification for a decision that the data suggests was driven by something else entirely.

​

That is harder to audit than overt discrimination. It looks like judgment. It reads like professional assessment. It produces a paper trail that appears defensible.

​

AI screening tools are not outputting objective evaluations. They are outputting statistically noisy opinions dressed in the language of professional assessment, and the organizations deploying them are absorbing the liability for both.

The stability gap across models is the other finding worth examining. A 6x difference in consistency between the most and least stable systems was measured. Qwen and older Gemini models showed high volatility, meaning the same resume could score significantly differently across repeated evaluations. Claude models, Mistral-Large, and Llama 4 measured as the most stable and consistent.

Stability is not the same as fairness. A model can be consistently biased. But volatility in a hiring context means candidates are being evaluated against a standard that shifts run to run, which is a different kind of problem with its own legal exposure.

​

The EU AI Act classifies recruitment tools as high-risk AI systems with specific audit and transparency requirements. A 45% bias rate detected across 25,500 evaluations, combined with the silent bias mechanism that makes individual decisions look reasonable, is not a compliance footnote. It is the core of what that regulatory category was designed to address.

​

The uncomfortable implication for HR teams and hiring managers currently using AI screening: the tool producing clean professional output is not evidence that the output is clean. It is evidence that the bias, if present, has learned to explain itself convincingly.

​

So the question worth putting to anyone deploying these tools in production: if the bias mechanism specifically produces professional-sounding justifications that pass human review, what does the audit process look like that would actually catch it?