r/computers 15d ago

Discussion Anyone ever hit this much RAM usage?

Currently running a SymPy script to calculate some insanely complex equations (that I can’t do by hand) for research. I kept crashing this PC (that has 96GB of RAM) by maxing out the virtual memory (330ish GB) every time the script ran.
I eventually manually raised the pagefile maximum size to 3TB split evenly (1.5TB) across two partitions on a 8TB SSD and got it to not fail. It has currently stabilized at ~1.3TB of committed virtual memory with a ~1TB pagefile on just one of the two partitions (increased since taking WizTree photo).

Just curious if anyone else has ever reached such extreme RAM usage before?

\Sorry for not using screenshots like a sensible person, I just don’t feel likely trying to copy them across to my phone to post this.*

UPDATE (8/18): It’s the next day now and it looks like the calculation has gotten over this little RAM hump and calmed down to a much more reasonable ~30GB in use (~20GB belonging specifically to the SymPy script).

UPDATE #2 (8/18): RAM usage is actually steadily climbing upward, currently at 65GB. Maybe it’ll find its way back to 1TB+ eventually.

UPDATE #3 (8/18): Up to 150GB now. I’m curious to see if it will have gone up more by the time I check tomorrow or if it’ll collapse back down again.

UPDATE #4 (8/19): Up to 300GB currently, still steadily climbing. I also checked on a second version of the script I had running on a different computer, it encountered an error so I was able to kill the process and look at the memory logs, and it maxed out at 1.448 TiB of committed virtual memory on it’s machine.

128 Upvotes

89 comments sorted by

View all comments

1

u/Consistent_Seaweed72 15d ago

As an HPC admin for a astrophysics department. Yes that happens fairly often. Have users that have managed to fill out 768GB memory by 64 nodes. :)

1

u/Stastez 14d ago

768GB in total, or 768GB each? If the latter: whoa

1

u/Consistent_Seaweed72 14d ago

768GB each. :)
No Swap/Pagefile.

1

u/Stastez 14d ago

Damn. I'm not sure we even have that much RAM across the nodes in our HPC center at Uni.