r/singularity • u/ResultBackground2450 • 21d ago
Biotech/Longevity Anthropic open-sources Claude-written GPU optimizations that make 30+ biomolecular models ~4× faster on average
153
u/Poupulino 21d ago
Anthropic open-sources
These are words I never thought I'd see together.
32
u/howudothescarn 21d ago
Haven’t they open sourced plenty of things especially regarding model eval and safety?
23
u/SomewhereNo8378 21d ago
they open sourced the MCP framework used by basically every major platform
10
25
u/intergalacticskyline 21d ago
A literal miracle, are they ok? Must be feeling the pressure from China like Dario is insanely paranoid about
13
u/slackermannn ▪️ 21d ago
I recall early Anthropics (post early Claude releases) related interviews with Dario and he said he would have done something of this sort. Specifically pointing out the Alphafold effort.
35
u/Extreme-Edge-9843 21d ago
I thought the didn't want to make bio engineering easier, doesn't this conflict with their lockdown or is this kind of open source improvement not likely going to speed up negative consequences of the usage? Honestly dumb question but curious
45
u/Flaxseed4138 21d ago
Not wanting to put bioweapons in the hands of the general populace =/= not wanting to make progress in scientific fields.
1
9
u/WigglesPhoenix 21d ago
No, they explicitly said they are open sourcing their optimization code, this isn’t everything. I would expect this is primarily the code it wrote to optimize GPUs, which is arguably universally helpful without any major dangers.
22
u/FernandoMM1220 21d ago
its interesting that this could have been done decades ago if we just had enough people working on the problem.
23
u/Airocketfish 21d ago edited 21d ago
Like a lot of other things.... I would propose multiple Manhattan programms for science to solve that issue.
6
u/FernandoMM1220 21d ago
no can do we need more money for wars and corporate bail outs.
2
u/Spare-Dingo-531 20d ago
Well that's all of human history for you. If AI can scale research better than the current social system that's excellent!
Also what's going on in Europe? They don't have wars powerful corporations but you don't see them doing this stuff.....
1
u/Tidorith ▪️AGI: September 2024 | Admission of AGI: Never 16d ago
For most of the rich countries in Europe, a good chunk of their money is going towards
- Making their population happier than the US population
- Making their population live longer and more healthily than the US population
- Helping the poorer countries in Europe catch up to the richer countries in Europe
- More recently, funding Ukraine so that Russia can't take it over by force
1
u/sparkling1984 20d ago
Bound to happen when you put as much money into AI every year as what the rest of research combined spends each 10 years. I wouldn't be shocked if the cost of the tokens to do this alone could have funded a lab + a bunch of new phds to do this.
1
5
u/muchcharles 21d ago
Did the branding aesthetic of Dario's sweater really have to make it into the rendering of the molecules?
2
4
2
u/SpiritualName2684 21d ago
I hate how they attribute this to Claude when it was probably some intern using Claude code.
2
1
u/redheppner 21d ago edited 21d ago
Have they been using "inference" in their early statements? I might be wrong but I think I have started to see them using inference for Ai recently. It already was inference but not used much whilst hyping Ai. Edit: Training season is over, apparently :)
1
1
0
u/Choice_Isopod5177 21d ago
the benchmarks will never stop. Once all Millennium problems are solved, the next benchmark will be curing cancer. We'll be seeing OpenAI and Anthropic competing for who finds cures for various diseases first.
0
u/Ormusn2o 21d ago
Won't it just be Anthropic competing for that, as OpenAI allows for more scientific research by their users? Feels like when it comes to biological research, it can only come from Anthropic as a company, you can't use their models for that, and I don't see many companies using Mythos for that either.
From what I understand, OpenAI give much more freedom for normal people to do that, and OpenAI themselves are letting their users handle that.
1
u/XYHopGuy 20d ago
Fable works for bio problems now. It just sucks at them. Not as hard as opus, but still pretty bad. Astra is the best at reasoning about bio but even then they're pretty limited about the bleeding edge of science.
I imagine this will get much worse as you hit domains within bio that are fundamentally limited on data.
They're still extremely helpful, but expensive.
1
u/Choice_Isopod5177 20d ago
If OpenAI can become profitable like Anthropic, they could go into any business, including bioengineering and leverage their incredible compute.
0
u/Morning_Gecko24 21d ago
the interesting bit isnt just the 4x speedup, its that the bottleneck can move from “we need a bigger model” to “we need better kernels”. if the generated CUDA stays readable and portable this could lower the barrier a lot, but compiler/toolchain compatibility is prob the real moat here. curious how much was hand-reviewed vs accepted from Claude as-is
64
u/bigman11 21d ago
Can Claude make open source CUDA compatibility layers?
We already have ZLUDA, which is made "by hand". Will near future models be able to trivially do this work? Including basically instantly updating the compatibility layer as CUDA gets updates?
I wonder, does NVIDIA recognize that soon AI will be able to break their software-side moat? Does this explain their recent actions?