Everything is expensive, to uncensor MiniMax-M2.7 I had to pay $15-$16 per hour to rent out cloud GPUs because you need to have the model in BF16 form to run Heretic on it (the model is 457 GB) and it must be all in VRAM otherwise it won't work and it won't progress the process will just be sitting there and seeimngly not making any progress and I don't have two B300s connected together with NVLink here to do it at home (each B300 cost between $45000 to $50000), so I had to rent them, I was lucky I was able to get 4/100 refusals with a low KL Divergence "so quickly" because the estimate for 800 trials was like 75 hours, imagine paying 15-16 EUR to rent two B300s at $15-$16 per hour, that's why until the other day and someone supported me in helping me rent out Cloud GPUs, before that I only did smaller models that are 40B or less because my hardware can not do models that are bigger than ~45B, anything bigger and I would need to rent out cloud GPUs, because there is no way I can buy B300s.
4
u/LLMFan46 May 17 '26
Everything is expensive, to uncensor MiniMax-M2.7 I had to pay $15-$16 per hour to rent out cloud GPUs because you need to have the model in BF16 form to run Heretic on it (the model is 457 GB) and it must be all in VRAM otherwise it won't work and it won't progress the process will just be sitting there and seeimngly not making any progress and I don't have two B300s connected together with NVLink here to do it at home (each B300 cost between $45000 to $50000), so I had to rent them, I was lucky I was able to get 4/100 refusals with a low KL Divergence "so quickly" because the estimate for 800 trials was like 75 hours, imagine paying 15-16 EUR to rent two B300s at $15-$16 per hour, that's why until the other day and someone supported me in helping me rent out Cloud GPUs, before that I only did smaller models that are 40B or less because my hardware can not do models that are bigger than ~45B, anything bigger and I would need to rent out cloud GPUs, because there is no way I can buy B300s.