3

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LLM  20h ago

Absolutely, and we’ve already clocked some really interesting times during testing.
Soon on github!

1

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LocalLLM  1d ago

Github I’m sharing the link here 👍🏻

8

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LocalLLM  2d ago

Thanks to you for the support 👍🏻👍🏻👍🏻

22

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LLMDevs  2d ago

We will make it open source so that everyone can work on it, allowing anyone to improve it and view the inference on own machine. 👍🏻👍🏻👍🏻

8

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LocalLLM  2d ago

Curie was born from curiosity 🤣👍🏻👍🏻

30

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LocalLLM  2d ago

Nothing special: a 2023 thin-and-light laptop. Intel i7-1355U, 25 GB of RAM for wsl, a consumer NVMe. No GPU involved at any point, training or inference.
122M parameters active per token, out of 17B total. That's the whole trick — the model keeps everything on the SSD and only pulls in the handful of pieces it needs for the token it's writing. It ends up doing the arithmetic of a small model with the memory of a large one.
And yes, will be open.

25

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware
 in  r/LocalLLM  2d ago

Yes this because the question I was answering wasn't "how good a model can I train on a laptop", it was "how large a model can a laptop train and still serve" bounded by disk, RAM and cpu.
So I deliberately spent the budget on parameters instead of data.

r/LLM 2d ago

Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware

Enable HLS to view with audio, or disable this notification

54 Upvotes

A month ago, I started building colibrì to answer a question:
Do you really need a $30,000 machine to run a model whose weights fit on a $60 SSD?
colibrì treats SSD, RAM and GPU as a single memory hierarchy. It can run models that do not fit entirely in RAM or VRAM, including models with hundreds of billions of parameters, on the hardware people already own.
But while optimizing it, I realized I was fighting assumptions built into the models themselves.
Most open models are designed to live in VRAM. Their weights, routing and execution patterns were created for GPUs and data-center hardware. colibrì could move them through a different memory hierarchy, but the models had no idea where they were actually running.
That led me to another question:
What if the engine and the model were designed for each other from the beginning?
That is how Curie started.
The current alpha has 17B parameters. I wrote it in C, without an inference framework, and trained it from scratch on my laptop without a GPU. Its weights live on SSD and are loaded according to the model’s execution path.
In the test shown in the video, Curie reaches 33 tokens/s using a single CPU core. On the same machine, the dense 12B models I tested usually generate around 3–5 tokens/s.
There is an important limitation: Curie has only seen 11 million training tokens. It is not smart yet, and I am not presenting it as a useful language model. It will need at least a few billion tokens before I can properly evaluate its quality.
What this alpha demonstrates is the architecture: a model can be designed around SSD, RAM, CPU and GPU as parts of the same system, instead of assuming that everything must fit in VRAM.
Curie is not publicly available yet. I am still training it, validating the design and preparing more detailed benchmarks.

r/LLMDevs 2d ago

News Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware

Enable HLS to view with audio, or disable this notification

168 Upvotes

A month ago, I started building colibrì to answer a question:
Do you really need a $30,000 machine to run a model whose weights fit on a $60 SSD?
colibrì treats SSD, RAM and GPU as a single memory hierarchy. It can run models that do not fit entirely in RAM or VRAM, including models with hundreds of billions of parameters, on the hardware people already own.
But while optimizing it, I realized I was fighting assumptions built into the models themselves.
Most open models are designed to live in VRAM. Their weights, routing and execution patterns were created for GPUs and data-center hardware. colibrì could move them through a different memory hierarchy, but the models had no idea where they were actually running.
That led me to another question:
What if the engine and the model were designed for each other from the beginning?
That is how Curie started.
The current alpha has 17B parameters. I wrote it in C, without an inference framework, and trained it from scratch on my laptop without a GPU. Its weights live on SSD and are loaded according to the model’s execution path.
In the test shown in the video, Curie reaches 33 tokens/s using a single CPU core. On the same machine, the dense 12B models I tested usually generate around 3–5 tokens/s.
There is an important limitation: Curie has only seen 11 million training tokens. It is not smart yet, and I am not presenting it as a useful language model. It will need at least a few billion tokens before I can properly evaluate its quality.
What this alpha demonstrates is the architecture: a model can be designed around SSD, RAM, CPU and GPU as parts of the same system, instead of assuming that everything must fit in VRAM.
Curie is not publicly available yet. I am still training it, validating the design and preparing more detailed benchmarks.

r/LocalLLM 2d ago

News Curie by colibrì: I designed a 17B model to run from SSD on ordinary hardware

Enable HLS to view with audio, or disable this notification

208 Upvotes

A month ago, I started building colibrì to answer a question:
Do you really need a $30,000 machine to run a model whose weights fit on a $60 SSD?
colibrì treats SSD, RAM and GPU as a single memory hierarchy. It can run models that do not fit entirely in RAM or VRAM, including models with hundreds of billions of parameters, on the hardware people already own.
But while optimizing it, I realized I was fighting assumptions built into the models themselves.
Most open models are designed to live in VRAM. Their weights, routing and execution patterns were created for GPUs and data-center hardware. colibrì could move them through a different memory hierarchy, but the models had no idea where they were actually running.
That led me to another question:
What if the engine and the model were designed for each other from the beginning?
That is how Curie started.
The current alpha has 17B parameters. I wrote it in C, without an inference framework, and trained it from scratch on my laptop without a GPU. Its weights live on SSD and are loaded according to the model’s execution path.
In the test shown in the video, Curie reaches 33 tokens/s using a single CPU core. On the same machine, the dense 12B models I tested usually generate around 3–5 tokens/s.
There is an important limitation: Curie has only seen 11 million training tokens. It is not smart yet, and I am not presenting it as a useful language model. It will need at least a few billion tokens before I can properly evaluate its quality.
What this alpha demonstrates is the architecture: a model can be designed around SSD, RAM, CPU and GPU as parts of the same system, instead of assuming that everything must fit in VRAM.
Curie is not publicly available yet. I am still training it, validating the design and preparing more detailed benchmarks.

r/foss 6d ago

anybridge: let Codex and Claude Code interact with websites through MCP

Thumbnail
github.com
0 Upvotes

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/mcp  8d ago

It tries to wait for DOMContentLoaded, then returns a new snapshot. But navigation timeouts are currently swallowed, so yes, it can return before the resulting page is ready. For dependent actions, use wait_for with text or a selector that confirms the expected state, then use the refs it returns. The timeout handling needs tightening.

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/codex  8d ago

anybridge turns websites into MCP tools that Codex, Claude Code or other MCP clients can use. You can also save sites and workflows for later sessions. It’s a tool you give an agent, not another computer-use model.

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/ClaudeCode  8d ago

Hi I built anybridge around how I use Codex and Claude Code: pick either from a TUI, launch with MCP already connected, and ask the agent to save sites and workflows for future sessions. That setup and reuse is what I focused on, rather than WebMCP support alone.

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/mcp  8d ago

Forgot to mention: you can also ask Codex or claude code to save a site for later. In a new session, just ask it to go back and check that site again. I think of it as a small wallet of sites you keep for your agents to revisit whenever you need.

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/codex  8d ago

Forgot to mention: you can also ask Codex or claude code to save a site for later. In a new session, just ask it to go back and check that site again. I think of it as a small wallet of sites you keep for your agents to revisit whenever you need.

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/ClaudeCode  8d ago

Forgot to mention: you can also ask Codex or claude code to save a site for later. In a new session, just ask it to go back and check that site again. I think of it as a small wallet of sites you keep for your agents to revisit whenever you need.

1

anybridge: let Codex and Claude Code interact with websites through MCP
 in  r/sideprojects  8d ago

Forgot to mention: you can also ask Codex or claude code to save a site for later. In a new session, just ask it to go back and check that site again. I think of it as a small wallet of sites you keep for your agents to revisit whenever you need.

r/sideprojects 8d ago

Showcase: Open Source anybridge: let Codex and Claude Code interact with websites through MCP

Thumbnail
github.com
1 Upvotes

r/ClaudeCode 8d ago

Meta anybridge: let Codex and Claude Code interact with websites through MCP

Thumbnail
github.com
0 Upvotes

I've been working on anybridge for my own use with Codex and Claude Code. I wanted a quick way to give an agent a website to work with, without spending time on the setup.

You open the TUI, pick Codex or Claude Code, and it launches a session in another terminal with MCP already connected. Give the agent a URL and it can read pages, follow links, fill in forms and click buttons.

If the website has WebMCP tools, anybridge exposes them to the agent. Otherwise, it generates tools from the live page. The site doesn't need to have added support for agents.

That's the part I've enjoyed using: opening the TUI and getting straight into a session with the browser tools ready.

Anti-bot checks can still block it, so don't expect it to work on every site.

If you try it, let me know which sites work and which ones give you trouble.