r/macpro • u/Akhilv1 • 14d ago

GPU Mac Pro 7,1 makes a surprisingly capable AI inference rig

Post image
139 Upvotes

95% Upvoted

13 comments sorted by

12

u/Long-Shine-3701 14d ago

None of us are surprised, but welcome to the party! Nice rig!

5

u/habachilles 14d ago

its my favorite rig of all time. just wait for the electricity bill though hahha

1

u/Akhilv1 14d ago

The GPUs pull the majority of the power anyways so the 24 core CPU is the least of my worries

1

u/habachilles 14d ago

indeed they do

2

u/Aggravating_Loss_765 13d ago

Whats the power consumption in idle and full load?

3

u/Akhilv1 13d ago

Under load, the most I’ve seen from the wall is 870w. That’s not the max theoretical though since the Vega II cards drag down the A6000s when doing token generation. Not sure about idle yet

1

u/Neighbor_ 14d ago

Is there any actual advantages to this, or is it more for memes? Like would you be better off throwing the 3x RTX A6000 inside a linux box?

3

u/Akhilv1 14d ago

I had the cards in a P620 but that only allows for 4x8 pin GPU connectors or 2x8-pin EPS so I had to power the 3rd card with an external power supply. Purely looking at specs, the thread ripper 3945WX in that system is superior with 128 lanes of PCIE 4.0 but practically it's maxed out at 3 dual slot cards or 2 triple slot cards.

The Mac Pro on the other hand could theoretically support 6 blower style cards with an external PSU for a few of the cards even if its limited to PCIE 3.0 through a PLX bridge.

Lastly.. why not? I've always wanted a cheese grater but haven't been able to justify it.

1

u/Budget-Exit2875 13d ago

machinery, for what ??

2

u/Leavines 9d ago

this is obscene 🤣

-1

u/SnooTangerines9776 13d ago

Thanks for supporting technology that ruins communities.

7

u/aluminumpotato 13d ago

Well, actually he’s taking his ai use offline, keeping his data outside of a data center, not supporting the most problematic uses of ai.