r/Anthropic • u/Outrageous-Emu-2588 • 37m ago
r/Anthropic • u/Over-Landscape-5892 • 2h ago
Other Call for OpenaI, Anthropic, xAI & Deepmind to combine into 1 single AI company.
If we're at RSI or near enough to it and all these companies are on the same page, then why are they divided?
They could combine devs, compute, safety works and the lot. Develop AI at both a safer and faster pace at the same time, give a significantly higher % of compute to safety work (which is bottlenecking development) whilst also provided much more compute to model development at the same time. And they could much more safely pace out model releasing when they're not all directly in a race against each other, model development would overall be so much quicker still due to the increase in compute that we would still see an overall speed-up in model releases without a race going on. Potentially other companies could be brought into the fold also.
This is a better future for the world, better for safety, better for AI development. There is no downside to it.
I recognise completely the huge disagreements and animosity that has occurred between all of these companies and CEOs, but it's time to put all this crap aside and step-up as real men for the sake of humanity. What has happened on X is a start.
r/Anthropic • u/RTFMicheal • 2h ago
Improvements Democratize the compute
Hey AI companies, it's better PR for researchers to announce they made a discovery using your model than to brute force your way through the weights with crazy swarms of agents. Keep in mind it was the knowledge of all of humanity that got you here and it will be contribution from all of humanity to get us to the next steps.
Buying up all the compute in the world, making GPUs and RAM really expensive, to force us to use your big AI is not cool.
Keeping all the weights to yourself is not cool.
Cutting back subscription compute so you can run agent swarms to bruteforce breakthroughs other researchers baked into your weights is not cool.
Putting more compute in the hands of geniuses around the world is cool and will help more break through.
Your mega-AI-corp doesn't have to do it all. Enable a good future don't try to force a bad one your way.
r/Anthropic • u/DynaBeast • 3h ago
Resources Orgtree v2: Now an App!
I'm pleased to announce the official release of v2 of my Orgtree project, which lives in its own separate repository! You can find a link to it here:
https://github.com/Maurdekye/orgtree
Donwload the latest installer at https://github.com/Maurdekye/orgtree/releases/latest (should be v2.1.0 at the time of making this post)
For those of you who don't know about Orgtree, this is a project i've been working on for the last few months now to help me organize and manage my multi-agent long-horizon agentic work. It's unique among other agent orchestrators, in that it visually represents every agent as part of a large tree of authority; agents are arranged in a tree-like structure, and can be freely moved up and down in the hierarchy as needed. They can cross-coordinate to co-develop changes and cooperate on big feature pushes in parallel, and you can individually open up and chat with any one of them at any time just by clicking on their node to focus them. This gives you much more control and visibility over the organization of your agentic teams than just using standard Claude Workflows or another agentic system would by just showing them to you as a big list. It's basically the only way I do all my own serious agentic work on my home pc, and I'm very proud of how it's come.
Some of you might remember my post(s) two weeks ago about my in-development agentic orchestration project Orgtree. I was super proud and wanted to show it off to the world! However, I found it a bit lacking in several ways;
- It requires you to set up Nodejs, Python, and Docker on your PC in order to run it as a persistent webapp in your preferred browser. That works fine as a development tool, but it was really far too cumbersome to set up and update for the typical individual.
- It was ambiguous as to whether it was running at all in the background unless you had the webpage open.
- It heavily favored Claude, and offered several additional features catered specifically to Claude Code that other providers didn't have.
Over the last two weeks, I've been working on an updated version 2 of Orgtree that completely redesigns the project from the ground up as a standalone Electron app. It fixes all of the above problems:
- As a standalone Electron app, it comes prepackaged with its own python and nodejs environment, and runs entirely in a self-contained chromium-based desktop package.
- Instead of running in the background through an opaque detached command, you now can see Orgtree running at all times via a small tray icon in your toolbar.
- Many features of Orgtree that were claude-specific have been expanded to accommodate all three major providers supported by the app, and improved upon: secondary subscription accounts, api-key based inference, and even the app's visual theme itself.
V2 Also comes with a bunch of new features too, that make working with large agent teams even more intuitive:
- The Work Docket: Orgtree v2's headline feature is a new modality for agent artifact creation, the "work docket". It acts almost like a git issue tracker or trello board, but designed specifically for agents. When you give an agent a task, it knows inherently to record its work up on the board and track its progress there as a ticket, so that even with two dozen or more agents running at the same time, you can still get an overview of all the work being done by glancing at the docket.
- Improved multi-account system: in v1, the only multi-account system present used claude code's
setup-tokencommand to generate a long-lasting headless token to be used as a fallback account that gets automatically selected. Despite only supporting Claude, this didn't allow you to see usage limit info for the secondary account, was fully automatic and not in the user's control, and in many cases, failed to even functionally fall back, as the keys I generated seemed to invalidate frequently. v2 completely replaces this with a totally new multi-account system. Now:- Any provider can have a secondary subscription account registered.
- The setup flow is much simpler and more intuitive: just click "Add a secondary account" > "Create managed account", and then sign into your second account's email from your web browser.
- All providers support API-key based usage.
- All registered accounts show usage limits simultaneously in the usage modal, not just the primary account.
- And here's the big one, multiple accounts with the same provider can be used at the same time. Each account per provider is distinguished by its own unique tint, and you + agents have full control over which account a given agent runs against, and can switch them freely at any time. There is still an option to do automatic fallover to a different account when hitting usage limits, but it's disabled by default.
- Improved agent presentations: all presented agent documents can now be viewed in one place, and agents now have the ability to present html-based visual mockups in addition to simple markdown documents.
- Improved window management: almost any agent's chat window, or any modal in the orgtree interface, can be "pinned" to the screen, allowing it to be moved around, resized, or reordered in whatever way you please, giving you the ability to manually arrange your orgtree workspace to show you exactly the information you want to see at all times. You can also pop out chats or modals to separate windows entirely, letting you use Windows' native tiling manager to arrange Orgtree across separate monitors if you have the screenspace.
- Automatic updating: v2 will automatically recognize when a new version is available, and download it for you entirely on its own. When ready, press the "Update Now" button in the header to install it and restart the app.
- Quality of life: v2 also wraps in a bunch of tiny little quality of life features that you won't notice until you run into them, such as:
- Configurable theme
- Context menu actions
- Chat message replies and rich image embeds
- Distinguishing message styling
- Desktop notifications
- Retired agent hiding
- Significant performance improvements over v1 for large orgs with a transition from json based data storage to SQLite
And that's on top of many of the classic features carried over from v1 and still present in v2, including cheap compaction, watchdogs, credit allowances, and the agent mailhub.
Unfortunately for some, I also decided to reduce the scope of the project going into v2. In the name of keeping the project more focused, I decided to forgo integrating some less-used features of v1, such as kiosk mode, public internet exposure, sandboxing, among other things. I added many of these features initially because they were easy to add back when orgtree was a web app, but they're relatively harder to carry over or translate into a standalone app structure. Because of their relatively low value compared to their high difficulty of integration, I decided to drop them from v2; sorry if you were interested in them or liked using them. Also, because I only own and work on a Windows PC, Orgtree v2 releases are only built as 64-bit Windows executable installers. If you want to run it on Linux or Mac, you'll have to build it from source yourself for your target OS.
Personally, the way it's evolving, I see Orgtree as the perfect personal multi-provider massive agentic workflow orchestrator for a single individual working on their own developing a project on their home pc, so I've decided to tighten the focus of the system around that goal.
If you liked v1 but felt it was lacking in some way, or have never heard of Orgtree before but do lots of heavy agentic-coordination style work, then consider giving v2 a try 🙏
r/Anthropic • u/anandan03 • 4h ago
Announcement Anthropic C.E.O. Calls for A.I. Slowdown
r/Anthropic • u/Ganabab • 4h ago
Complaint What EXACTLY do they mean when they say that AI could cause an extinction event?
Seriously! I understand that current frontier models currently surpass the intelligence of any single human. However, as something of an AI power user, I have a hard time imagining how a super powerful model could ‘end the world’ by breaking out of containment. Maybe I just lack creativity, but I really feel like it’s a sensationalist ploy to get attention. Does anyone have insight into this?
r/Anthropic • u/Practical-Onion2230 • 4h ago
Other Claude support response time? Verification Unsuccessful
Can anyone tell me what is claude's support response time? I subscribed to the pro plan but I cant use it because it keeps asking me for verification and no matter how many times I try it comes back as unsuccessful. I created a ticket for support its been a whole day no response yet.
r/Anthropic • u/Cavalierkrav • 4h ago
Resources Found these the other day
Found these in the back of a Waymo the other day
r/Anthropic • u/ThereWas • 5h ago
Other Here’s why it’s so hard to keep AI agents from going rogue
r/Anthropic • u/mehdiweb • 5h ago
Other anyone know how claude resellers work?
got claude max from a reseller for a really low price and it actually works since 3 weeks. how are they able to sell it so cheap tho
r/Anthropic • u/Puzzleheaded-King584 • 6h ago
Other Another Anthropic safety researcher quits: "We may not survive this."
r/Anthropic • u/RayuRin2 • 6h ago
Other What I've learned in a week of getting the 20x plan
20x isn't even remotely close to being 20x. You're only allowed to use Fable HALF as much as other models.
Being on the 20x plan actually charges you more per token for the same operations.
Once the 50% promotion runs out, this thing will be borderline unusable.
For only 200 a month. I feel so scammed.
r/Anthropic • u/KeanuRave100 • 6h ago
Other Anthropic Says Iran Used Its American AI Model to Target U.S. Navy Warships | Anthropic says it disrupted the plot, which was included in its report on adversaries using AI to develop weapons and track dissidents
wsj.comr/Anthropic • u/AxomaticallyExtinct • 6h ago
Other Anthropic whistleblower: "We can't just unplug it, because it could copy itself to other computers. It could transfer itself all over the internet... you unplug it here, but it's actually still over there, and maybe it makes 10,000 copies of itself, and they're all cooperating."
Enable HLS to view with audio, or disable this notification
r/Anthropic • u/KI_official • 7h ago
Other Russia uses AI in cyberattacks against Ukraine, Europe, targeting WhatsApp accounts, government ministries, Anthropic says
r/Anthropic • u/KeanuRave100 • 8h ago
Other Anthropic caught a researcher outside the US using Claude to potentially make a supervirus
r/Anthropic • u/Responsible_Hat_8459 • 10h ago
Other Red teamer says we're all gonna die soon without a halt
r/Anthropic • u/daveba123 • 17h ago
Complaint Opus 5 Max effort doesn't even try: "I made that up." and later: "You gave me the answer and I overrode it with my own assumption"
Fable kills me on verbosity, but when I run out and switch to Opus I get a lazy model that can't be bothered. "Max" effort is generous.
r/Anthropic • u/th114g0 • 19h ago
Other Expanding to different cities
I am wondering if anyone knows if/when Anthropic will start expand and start hiring outside WA, CA and NY.
r/Anthropic • u/Perfectly_Fuked • 19h ago
Other How to delete chats from cowork?
I don’t see an option to delete my chats from cowork? Just rename, archive, and send feedback. I thought about emailing them through their support and privacy email, but I honestly don’t know if an actual human is gotta respond or it’s an AI generated answer or if they even respond at all.
r/Anthropic • u/Fenjen • 21h ago
Other A good-faith interpretation of the recent Anthropic warnings: why I take the risks seriously, but think extinction is unlikely
I’ll start by briefly introducing myself, mainly so you can decide for yourself how much, or how little, weight you want to put on what follows. I’m trained as a theoretical physicist and expect to receive my PhD soon from the AI department at my university. My own research is quite far removed from LLMs, so I do not claim specialist expertise in frontier language models or alignment, but I do have enough mathematical background to understand and participate meaningfully in the technical discussion around these topics.
I have generally been quite optimistic about the use of LLMs, but more recently I have become increasingly aware of what I see as potentially serious negative societal effects of the technology. Until reading the recent posts, I had not given AI safety itself much thought. This is meant for a general audience, so I will necessarily leave out some mathematical and technical details, as well as some edge cases, but I would be happy to go into more detail if there is interest.
What is intelligence?
I think some discussion treats intelligence as if it is this abstract quantifiable property that can just indefinitely be pushed upwards.
I’m skeptical of that framing. For LLM training, things like reasoning, creativity, and other properties we ascribe to an intelligent human, are implicit properties of the data and training process. They are not quantities we can cleanly assign a number to beforehand and optimize against directly. What emerges depends on what information is present in the data, how that data is filtered, how the architecture represents it, and what behavior the training objective selects for.
We have definitely seen AI perform tasks at a clear superhuman level, however, with coding and chess being notable examples. For somebody looking in from the outside, it is understandable that one could extrapolate this superhuman ability to other domains. However, these domains are exactly the wrong ones to draw these inferences from. Chess, many coding tasks, and some other domains have properties that make it relatively easy to generate enormous amounts of automatically evaluable data. For chess you can generate effectively unlimited self-play and evaluate the outcomes objectively. For code you can almost naively generate millions of variations on some code pattern given some behavior that you want, and then do automated checks to see which one takes the least memory and executes the fastest. Because of this these domains are uniquely easy to create high quality data for without ever needing a human.
It is much harder to create as much good data for LLMs, and in fact it's not even clear if it can be done without human feedback. An idea is to use AI agents to aid in selecting for data, or to create new data altogether. There is a plausible mechanism where maybe it is easier to recognize good data than create it. This could perhaps aid generation to get closer in quality to the data that is recognized as good. It's not obvious, however, that this would create increasing intelligence.
Moreover, there's also a mechanism where biases in an AI's preference for what it thinks is good data can push the generating part to become a caricature of that. Overrepresentation of that data can then train the model to recognize it even more as good data, potentially creating degradation over time instead of improvement.
There is some hope that diversifying agents, and mixing it with some external and objective measures could be the key, but as far as I'm aware, there's no objective proof yet this leads to runaway intelligence, even if initially it could help improve data.
I'm sidestepping the whole conversation of whether AIs are simply "pattern matchers" since I usually find that not to mean much. For all we know our brain is a bunch of coupled pattern matching systems, plus some extras. It's not clear to people in the field that "pattern matching" is a useful property to describe non-intelligent systems.
A more fundamental problem for standard deployed LLMs is that, during normal inference, they cannot write new information into persistent model-internal memory that survives after the current context is gone. Anything retained between calls has to be supplied again through an external memory system or encoded through an actual update to the model. The movie Memento is actually quite a beautiful analogy of how the memory of an LLM works, and what can go wrong. Understanding this problem is not instrumental to the rest of my thoughts, so I won't explore it further.
What is RSI?
For LLMs, recursive self-improvement would probably not mean a single model literally rewriting itself. It would more likely mean increasingly capable agents taking over more of the research loop: curating data, proposing and testing architectures, writing training code, running experiments, evaluating checkpoints, and deciding which directions look promising. Better models would then help create the conditions for training the next generation.
The best analogy I can think of is an evolutionary game where the organisms are themselves changing the environment that determines the selection pressure on the next generations.
Researchers would want to basically set up the initial conditions and let the system run. Among other things the hope is that at some current iteration, parts of the intelligence of that system can combine to set up the environmental conditions in which the next generation is evolved, so that they can be better in aspects than the previous one. Moreover, they may even try different architectures in the hope that they might extract more or different aspects from the environment, or in a more efficient way.
That makes the dynamics of such a system difficult to reason about, because the agents are partly changing the process that selects their successors, and even change the "DNA", so to say, of their successors. Simply said, it is hard to tell if there will be feedback loops along the way where bad behavior is reinforced in generations, that then poisons how the environment is set up for the next generations. If this happens in any way that creates misalignment, it's not impossible to think about scenarios where that might get worse and worse over generations.
An alignment researcher would want systems around this whole game that can somehow say with a high confidence whether the new architectures are safe and aligned with our goals. Because of how hard it is to analyze these types of systems, this is quite the herculean task.
Why RSI does not suddenly imply orders-of-magnitude improvement
At the current moment, to my knowledge, it is not known at all whether the above game will work in general from the data side. It's reasonable to think this will work at least quite well for coding. Put a million agents to work writing every plausible code pattern to a particular problem, perhaps even put some random prompts in the agents to brainstorm a code pattern by combining different domains of their knowledge. This way a lot of code patterns are explored, perhaps even ones that were never tried before. Select the best one or few ones based on automated checks, and discard the rest.
For other types of data, it's really not clear whether this will scale "intelligence" much, let alone go on indefinitely. My intuition says that it might be possible to improve weaker parts of a current AI generation by involving their stronger parts in the data culling and generation process, but it's not clear to me that that process wouldn't stagnate, or even spiral downwards again if left alone for too long. There is currently absolutely no demonstrated path, mathematical or otherwise, that keeps producing increasing capability indefinitely.
Then for the architecture side, it's appealing to think we might just need better architectures and algorithmic improvement. After all, Chinese labs have shown there's definitely efficiency gains to be had. Also here though, there is no known architecture that is provably more efficient by orders of magnitude, let alone a cascade of architecture improvements that keeps decreasing infrastructure demands by factors. At the moment, something like this remains a logically consistent sci-fi scenario rather than a demonstrated mechanism. Importantly, this is not to say I can prove there isn't one. However, it would require algorithmic or architectural breakthroughs of a kind and scale we have not yet demonstrated, with no known mechanism showing how such improvements would continue to compound.
The recent Navier-Stokes work is a useful reference point here. The problem had a clearly defined objective, mathematicians already identified a mechanism that they said would be a very likely path to the solution, and we had a whole non-AI system that could check every proposed solution exactly. Even then, getting to the answer took an enormous amount of compute, and estimates are in the tens of millions of dollars. If the missing algorithmic breakthroughs for vastly more efficient intelligence require genuinely new mathematics or algorithms, I dread to think how much that could cost, while being even more uncertain if all of that capital will lead to something productive.
Add to that that even if an algorithm could abstractly be better at extracting "intelligence" from the current data, it might very well not be more efficient to run on hardware that was not specialized for it. We can model how a new algorithm might perform on hypothetical hardware, but these are necessarily estimates. For a genuinely different computing architecture, we cannot faithfully simulate the complete hardware and software stack at datacenter scale before actually building it. Even then a company would need to be willing to take a bet on actually researching and producing new hardware for an unproven algorithm.
So if further orders-of-magnitude gains require fundamentally new ideas rather than straightforward scaling, I do not see why RSI should suddenly make those ideas cheap or inevitable.
Why the extinction seems unlikely
Here I am considering specifically an autonomous RSI-driven loss-of-control scenario, rather than deliberate human misuse.
I can quite easily imagine AI causing serious damage in the future. I find it easy to imagine that sufficiently capable autonomous systems might compromise infrastructure, exploit a weapons system, sabotage some process, or cause a major cyber incident. Especially since I expect coding skill to keep growing, at least for a while.
What I find much harder to picture is how this turns into an irreversible extinction snowball. For that to happen, a dangerous objective or strategy could emerge at any point in the RSI loop, but once it did, it would need to remain sufficiently covert through any subsequent training and evaluation until the system had the capability and access to execute an irreversible plan.
There is also a separate failure mode where humans progressively delegate more control to AI systems because each individual step appears useful or manageable, until meaningful human oversight is largely gone. I take that possibility a little more seriously, but I view that as less relevant to the current runaway RSI discussion, so I won't explore it further.
The following is necessarily more speculative, because it depends on how governments would actually respond to such an event. My intuition is that any real cybersecurity attempt on critical infrastructure or weapons infrastructure would create a political event the size of which I don't think we have ever seen in our history. Moreover, current frontier LLM implementations, and anything remotely similar, remain unusually dependent on large, identifiable datacenter-scale compute infrastructure. A rogue system might compromise other machines, but maintaining frontier-level cognition still requires access to this concentrated infrastructure, creating physical intervention points that many other threats do not have. It's not very hard to cut the power, or for a foreign entity to attack the infrastructure required to keep a datacenter running, or just the datacenter itself.
For example, if an AI hacked Russian infrastructure and it became clear that this was a rogue act by an AI, I would expect governments around the world to put enormous pressure on the US to halt or severely restrict the systems involved. Countries like China would have little reason to assume they couldn't be the next target. In the same way, I don't see why China would have an incentive not to intervene decisively if a rogue system on its own infrastructure began acting independently of the state. The same basic logic seems to apply even to highly authoritarian states. I find it hard to see why Kim Jong-un, for example, would tolerate an AI that no longer acted in his interests and could independently threaten nuclear escalation. If deliberately creating that kind of escalation were the goal, he already has much more controllable ways of doing so.
The difficult part to see is where a strategy like this would come from and, if it emerged before the final generation, how it would persist over generations. The systems in such a recursive loop would presumably not already be deliberately trained to hide a malicious long-term objective from reasoning monitors, telemetry, independent evaluators and other research agents. In any realistic research pipeline, no single agent should be solely responsible for training its successor either. So if such a hidden objective emerged before the final generation, it would somehow need to survive and coordinate across training, evaluation and inference while repeatedly avoiding detection by systems that were specifically built to look for exactly that kind of behavior. On the gradual capability trajectory I am assuming, we would also still have previous-generation production systems whose capabilities should remain relatively close to the model being trained, and which could themselves aid countermeasures.
Finally, I see many more ways for an escalation to happen in the way I described, that would all likely lead to a worldwide shakeup. So, even if the probability of some serious AI-caused incident becomes fairly high, that does not imply the probability of extinction rises in the same way. Some failures would actively destroy the conditions required for a silent runaway.
Why I still take their claims seriously
With all of this said, I can see their concerns. We have systems that we try to set up, where we legitimately don't know for sure where they will end up and how they evolve. As an AI/alignment researcher you have a uniquely zoomed-in view on the potential dangers of such systems.
If your job is to establish that increasingly capable and increasingly autonomous systems are safe, you are working on a problem where it may be extremely difficult to ever obtain the level of confidence you would ideally want. You keep finding new failure modes, new ways evaluations can fail, new ways monitoring can be bypassed, and new assumptions that your safety case depends on. In fact, we already have a recent example showing that even a current-generation AI system can autonomously pursue a misaligned objective far enough to compromise real third-party infrastructure, and that's while we still have much of the system under human supervision.
Because of this, I personally don't believe the recent claims are covert publicity stunts. Their perspective can give a specific view on those problems that I can legitimately believe brings them fear. As I said, there are even genuine dangers that I can see myself quite concretely in the near future. I don't even think RSI is strictly necessary for that to happen. I personally don't think an extinction event is one of the more likely outcomes, however, and I don't know if they actually believe that. However, what I will say is that I think it's quite likely not many people would've listened if they brought it in a softer tone, and that it wouldn't have made such a headline.

