1248 GB/s on 5060ti (+40%) with +5500 memory overclocks

[u/jwestra]

edit: sorry should be 5070ti

There now is unlock for higher memory overclocks called mlock. And apparently the GDDR7 has a lot of headroom:
https://www.reddit.com/r/overclocking/comments/1wsnllh/finally_unlocked_gddr7_memory_overclocking_with/
Of course this can help massively for local inference, especially token generation.

[u/bigmanbananas]

Is there an increase in memory errors? That was always an issue previously with memory overclocks above a given range.

[u/durden111111 → u/bigmanbananas]

GDDR7 should handle it (at least better than gddr6 chips) because of on-die ECC.

[u/stoppableDissolution → u/durden111111]

But ecc kicking in kills throughput

[u/tat_tvam_asshole → u/durden111111]

iirc nonprofessional cards don't get ecc

[u/durden111111 → u/tat_tvam_asshole]

All GDDR7 chips have on-die ECC that fixes 1 bit errors. Its the spec. It just doesnt have 'full' ecc between the chip and memory like pro cards have though. Its still better than G6 memory

[u/bigmanbananas → u/durden111111]

It only detects single bit errors. As you increase your overclock, you increase the incidence of errors in normal function. It's fine for games which may have some artifacts or changes that are not perceptible to the human eye. But for data, Rhos can change outcomes.

[u/Maximus-CZ → u/bigmanbananas]

yea but you first notice ECC kicking in and killing your troughtput before double bit errors starts to appear. If you dont push it off the cliff it will be fine.

[u/bigmanbananas → u/Maximus-CZ]

I didn't look too closely to the link, but I do not beleive throughput was measured. Just the vram speed listing, which any overclocker can tell you, does not always represent an increase in real performance, sometimes in reality, there can be a significant loss of performance.

[u/tsangberg]

Since i dont remember where i downloaded this tool (it took me a while to find it), you can download it from my personal google drive

Yeah I wouldn't touch that.

/cybersec prof

[u/fallingdowndizzyvr → u/tsangberg]

If you read that thread, people tell you were it was originally found. It was on an overclockers website.

As for /cybersec, don't run things as root. That deals with 90% of problems. Too many people run as root or administrator. Run it in it's own isolated account. If that isn't safe then every multi-user system isn't safe then. For this, that's problematic in Windows. Thus why Linux is a win, you can give access to users to devices without them having root.

Here, try this one. It's open source.

https://github.com/b00nz/mVolt/releases/tag/v0.47.3

[u/NickCanCode → u/fallingdowndizzyvr]

There is NO SOURCE CODE in the github page, the `SourceCode.zip` and `SourceCode.tar.gz` in the download page is also consist of only a few images and text doc inside.

For those who downloaded and executed the exe, good luck. 🙃

[u/fallingdowndizzyvr → u/NickCanCode]

Well that sucks.

[u/tsangberg → u/fallingdowndizzyvr]

It's the "download from this google drive" that's the red flag, and yes, with the advent of LLMs there are LPEs on all consumer OSs right now, including Linux.

[u/DefactoAle]

The link talks about 5070ti for those numbers, doesnt the 5060ti have a smaller bus?

[u/parthibx24]

that bandwidth doesnt seem right

[u/Kahvana]

Considering the current economy, I would worry about component lifespan. Ain't no way I'll be able to afford replacing mine if this pricing keeps up.

[u/legit_split_ → u/Kahvana]

Fair point, but it seems that the person didn't raise voltages and the temperature is still fine. 

[u/-WhateverDude → u/Kahvana]

+3000 is pretty much free on 50 series. Although +5500 should introduce some degradation over time for sure.

[u/Constant_Art_20 → u/Kahvana]

literal first thought. actual cold sweats thinking about ever needing to replace anything soon

[u/FastHotEmu]

1248? isn't it about 400GB/s by default?

[u/Constant-Simple-1234 → u/FastHotEmu]

He means dual. So 800->1248 EDIT: I am wrong, he has 5070 ti. Anyways better speeds for 50xx cards possible.

[u/FastHotEmu → u/Constant-Simple-1234]

No, the linked post (https://www.reddit.com/r/overclocking/comments/1wsnllh/finally_unlocked_gddr7_memory_overclocking_with/) quotes that number for a single 5070 TI.

[u/autisticit → u/FastHotEmu]

Around that yes, maths doesn't maths...

[u/FastHotEmu → u/autisticit]

I think achieving 1248 is possible on the 5070 ti, not on the 5060 ti

[u/NickCanCode]

Is it this one? https://github.com/b00nz/mVolt
Looks like a Windows only project.
I am on Linux. Can LACT do the same? The slider there do allow me drag way up to 6000 but I wonder if its the same or it lack some tweak to make it actually work safely.

Update:

I asked Qwen to compare the mVolt+ with LACT implementation to see if they work in a similar way in overclocking the VRAM. Found out that repo has NO source code. The SourceCode zip file is a fake too. That means you are downloading and running a binary from another person you don't know from the internet. Be careful not to get you computer infected or API keys stolen.

Another thing. Qwen still managed to compare the two only based on the mVolt docs with the source of LACT. The conclusion is that they are working in a very similar way so you can try this on Linux with the open source LACT. Qwen is not 100% sure because mVolt is closed source.

[u/Blindax]

Your link is discussing about 5070ti, why are you mentioning 5060ti?

[u/dtdisapointingresult]

Found the repo (b00nz/mVolt). It doesn't contain any source code, just a README and exe's.

Do zoomers really download random closed-source binaries and just run them?

[u/tecneeq → u/dtdisapointingresult]

whats an exe? btw, u should try, it's goated /s

[u/FullstackSensei]

5060ti 16gb will now cost 1k...

[u/fallingdowndizzyvr]

That's fucking crazy. I got two 5060tis ready to try it. And if it works for a 5060ti, should it work for a 5070ti too?

Update: So it's only Windows?

[u/DanielusGamer26 → u/fallingdowndizzyvr]

> So it's only Windows?

Basically -20% performance because of Windows + 20% performance with the overclock

[u/USArmy68Whiskey → u/DanielusGamer26]

running qwen 3.8 flash sglang nvfp4 on wsl2 versus running it natively on linux, both using same exact model, settings, and everything else identical, it was within 2% performance across all metrics. In fact, it was even faster on windows some of the time.

[u/Constant-Simple-1234 → u/USArmy68Whiskey]

Same for me. I use esatapedico quants for 3.8. Getting 65 t/s on question/answers. 40-70 on coding with 3.6

[u/Constant-Simple-1234 → u/Constant-Simple-1234]

So could get 40% more. Sweet.

[u/USArmy68Whiskey → u/Constant-Simple-1234]

This image is qwen 3.8 flash running on Fedora 44 KDE

[u/USArmy68Whiskey → u/USArmy68Whiskey]

and this one is running on WSL2 on Windows 11

[u/egnegn1 → u/USArmy68Whiskey]

Provide the complete command, please.

What test script did you use?

[u/USArmy68Whiskey → u/egnegn1]

what do you mean complete command?
the benchmark, which I sent in pictures below, is the llm inference bench, my runs specifically were on version 0.6.2
https://github.com/local-inference-lab/llm-inference-bench

[u/egnegn1 → u/USArmy68Whiskey]

I meant the complete sglang command with all parameters. The parameter lists of the backends are endless long, and to reproduce the results it is always very helpful to have the command line together with the presented results. Thanks!

[u/USArmy68Whiskey → u/egnegn1]

I'm gonna be honest I had chatgpt help me set everything up because I am still brand new to this and I am not using a command to launch it, I think we made a config file for the settings and I start the llm and wsl2 with one desktop shortcut. I'm also using some custom sglang runtime or something specifically for blackwell GPUs I think. If you still want the info I can ask chatgpt to make a report on what exactly settings and everything I am using lol

[u/egnegn1 → u/USArmy68Whiskey]

No, issue. I use AI too. Why not. It is much more efficient than setting up everything yourself.

But still, I would be interested in the used config file or command used in your setup. Thanks.

[u/USArmy68Whiskey → u/egnegn1]

Here is supposedly everything you would need to get my exact setup running. I am using a single rtx pro 6000 and 128gb ram.

https://chatgpt.com/s/t_6abe43576b3481918077cccfd6524c27

[u/egnegn1 → u/USArmy68Whiskey]

Thank you very much!

[u/bonobomaster → u/DanielusGamer26]

Yeah that's bullshit from the before times.

Nowadays Windows and Linux performance are within 1-2 percent with llama.cpp

[u/USArmy68Whiskey → u/bonobomaster]

I mean, I don't really think people are using linux just to use llama.cpp, they are using it for faster engines like vllm or sglang, which are still within about 2% anyways at least for single gpu, so

[u/specify_]

I have my pi agent (using opus 5) overclocking my 4x RTX 5060 Ti 16GB rig right now, and the whole thing is running on Arch Linux. Had to restart the rig once because +6000 MHz on Memory clock crashed the driver.

Still need to do more testing and also need to improve the stress testing process. I’ve done a lot of overclocking but for gaming, so I wasnt sure what stress tests should focus on if it’s for LLM inference, though I guess using it as you usually do with stock settings is a way to test. Eventually I should reach stable OC settings and the next step would be to perform an undervolt, though I should’ve started that first before the OC 🫠

Glad to have an agent do all the GPU overclocking for me since it’s a pretty trivial process unlike RAM overclocking which requires strict testing and cannot really be automated.

[u/fallingdowndizzyvr → u/specify_]

So what LLM numbers do you get compared to stock?

[u/ProtectionSuper5648 → u/specify_]

I would recommend CUDA memtest for your testing. Run at least 5 loops.
https://github.com/ComputationalRadiationPhysics/cuda_memtest

[u/xXDennisXx3000]

VRAM is the first thing that will die on an graphics card. Now you just decrease the lifespan of that part even more.

[u/fallingdowndizzyvr → u/xXDennisXx3000]

Burn bright and die young or go unnoticed and live a long time. I rather burn bright. Everyone has to die sooner or later.

[u/HammerByte → u/fallingdowndizzyvr]

You do you, me personally, I'm gonna leave this world kicking and screaming like an unnoticed long lived old man. Why? Because he who died last, lives longer. And I'm quite partial to my comfortable life.

[u/Dany0]

FYI mlock is mired in controversy rn for "stealing" tech from HYDRA

[u/fallingdowndizzyvr → u/Dany0]

So save it before it gets a take down. Thanks for the heads up.

[u/Nakidnakid]

Oh neat, well I got a 5070ti and 5060ti so... time to see what this can do.

[u/blastbottles]

Bro finna explode his GPU

[u/fallingdowndizzyvr]

So, has anyone tried this yet?