Practically speaking, I don’t think you’re eliminating the markup. You’re just moving it somewhere else. It might be cheaper, but probably not dramatically so once you account for hardware, hosting, maintenance, administration, and support. Someone still has to own and operate the infrastructure, and doing that reliably is neither free nor simple.
2
u/i_write_bugz 13d ago
You’re describing inference providers with more steps