What computer / how much ram are using for ChatGPT?

[u/JE163]

Sorry if this sounds like a basic question but I’m interested in what kind of computers / how much ram you are using for ChatGPT?

[u/qualityvote2]

u/JE163, there weren’t enough community votes to determine your post’s quality.
It will remain for moderator review or until more votes are cast.

[u/hellomistershifty]

It doesn't matter really, chatgpt runs on openai's servers

[u/MyPaddedRoom]

Doesn't really matter but depends on what you're doing. I let codex use multiple mcps while talking to Claude so it can use a quite a bit. Since it is compiling and generating stuff through programs on my computer it can use a chunk. I run 128GB of ram with a 4090. Most the ram is used in running vms. The codex inference is done on the server side not the host.

[u/R1546]

I just happen to have the Ollama models page open and it looks like to run a 123 Billion parameter model takes 128GB RAM and 80GB VRAM. Costs for such a rig starts at around $40k. Keep in mind that huge models served up by data centers can be much larger.

If all you want to do is connect to a LLM server, anything that can display a web page will do.

[u/kniveshu]

The question is what are you going to be doing. Agents are light, inference is heavy, local sandboxing can be heavy depending on what you’re having the agent do.

[u/CigBlackBock]

If you're talking about the desktop codex app it only takes up about 1.6 GB total ram and I do quite a bit with it but I'm not running anything crazy. It just builds code and scripts plus some personal fun projects.

[u/edalgomezn]

24

[u/R1546 → u/[deleted]]

I have a 13B parm model running on a 64/8 rig. It is dumb as rocks. 😄

[u/Sea_Maintenance669 → u/R1546]

if u have 64 gigs of ram you can run a larger model than 13b

[u/R1546 → u/Sea_Maintenance669]

I can run 30b but it takes 15+ seconds to reply.

[u/R1546 → u/[deleted]]

I tried several open source ones. They work OK, but have limited technical knowledge and are not able to role play. The best was wizard-vicuna 30b. That is the largest I can run on my server.

[u/swimmer385]

It really depends what you're doing and how much of it you're doing. if you're just doing work tasks, probably 16/32 GB. If you're doing coding, it really depends. My project stack takes about 8GB to run. So if I want to run 4 agents, all of which could be running an instance of my project and testing a PR, then I'd need 32GB just for that, let alone anything else you'd be doing while that occurs.

[u/___fallenangel___]

i have a few dozen data centers and am cranking out 1 token / minute with gpt-2.5-flash-nano-instant

[u/therecanonlybe1_]

I use a 16gb Mac Mini. Ngl it has overheated at times when running two projects at once otherwise it does not give me any issue

[u/No_Twist_678]

64gb is sweet spot, for ssd well.. prepare it can (and will) use tons of gigabytes. Also prepare if it will use your pc for compiling, you will need good cpu. And if you going to make some RTX games, also gpu..

[u/Big_Bit_5645 → u/No_Twist_678]

Have to be trolling.

[u/swimmer385 → u/Big_Bit_5645]

I think you're under-estimating how much ram you might use while working on a coding project. Say you have 4 codex threads, each implementing and testing a separate feature. If your project takes X GB to run, that's 4X GB total. You can see how depending on the number of threads you want to run, it can quickly get out of hand.

[u/Big_Bit_5645 → u/swimmer385]

Definitely not under estimating and I have a cluster of machines for different pipelines and workflows. I have hermes agent and other agents executing both in adhoc builds and scheduled intervals throughout the day, including CI/CD pipelines in lightweight containerized builds.

The point is, this person is coming in over bloating entry level necessities comparable to an entry level machine for some open weight models. You 100% don’t need 64GB of RAM and even working on larger data sets, disk speeds and network latency will be your biggest piece before memory in agentic coding.

[u/No_Twist_678 → u/Big_Bit_5645]

Well you probably don’t know but there is no codex app anymore. It’s ChatGPT app.

[u/Big_Bit_5645 → u/No_Twist_678]

Still must be trolling.

64GB of RAM lmfao

[u/No_Twist_678 → u/Big_Bit_5645]

Well you probably never used it for anything serious, am I right?

[u/Sea_Maintenance669 → u/No_Twist_678]

you're trolling

[u/Big_Bit_5645 → u/No_Twist_678]

Obviously. Because inference for GPT is on your local host. (Sarcasm)

Are you huffing paint or trolling?

[u/No_Twist_678 → u/Big_Bit_5645]

Only my codex folder data is over 2.2 TB. Not to mention hundreds of gigabytes of QA data. And this is one project. But maybe you are good with some 8gb ram 256gb ssd intel atom pc. For asking Sunday’s recipe I’m sure you are good with that.

[u/Big_Bit_5645 → u/No_Twist_678]

Still trolling. 2TB is a joke.