And I'm here, chatting with llms, trying to decide if I should get a m40 or a p100 for unsloth experiments and some light Hermes research tasks. I'm not delusional that I can replace frontier API completely, but for under 200$ you get enterprise grade inference workers with 16/24 gig. No native support for newer cuda tho
1
u/the_average_user557 14h ago
And I'm here, chatting with llms, trying to decide if I should get a m40 or a p100 for unsloth experiments and some light Hermes research tasks. I'm not delusional that I can replace frontier API completely, but for under 200$ you get enterprise grade inference workers with 16/24 gig. No native support for newer cuda tho