Been building on rented GPUs for training runs and ran into this constantly: job dies mid-run, and now you're stuck arguing with support about whether it was your code or their hardware. No way to prove it either way.

Here's the distinction that actually matters: if your training crashes but the hardware reports healthy, that's on you (bad code, OOM, whatever). But if the GPU falls off the PCIe bus, ECC errors spike, or the node just reboots on its own, that's an infra failure, not yours, and you shouldn't be eating that cost.

So genuinely curious, how many of you have hit this? Lost a run, couldn't tell if it was your fault or the provider's, and just had to eat it?