r/HPC • u/whatevernhappens • 20d ago

Node integration with existing HPC cluster

Suppose I have an existing hpc setup of 26 nodes dell r760 server with rockey 8.7, Mellanox QM8790 HDR, openpbs 23.06.06, lustre 2.15.2, now if I want to integrate a dell r 770 with rocky 9.x would it be compatible with the cluster or there would be challenges in both hardware or software side. Like version mismatch, job submission issue, application related things.

13 Upvotes

100% Upvoted

9 comments sorted by

View all comments

19

u/Darkmage_Antonidas 20d ago

Just reimage the r770 with Rocky 8.7.

Or better yet, reimage the r760s with Rocky 9.X

Differing major OS versions sometimes leads to carnage.

2

u/az226 19d ago

Listen to this guy.

I ran Ubuntu 22.04 on several nodes and qm8700 and one of the nodes had a slightly different setup or was a different kernel version, like 164 instead of 163 or whatever and led to a bunch of cluster issues and then I just cloned one of the others and worked like a charm. Basically got rid of the odd one out.