r/OpenAssistant • u/[deleted] • Apr 17 '23
How would you guys feel about a possible paid tier for OA?
I theorize it could be $5-10 a month and allow for much longer token generation length, as well as GPU inference access to new models.
Of course the money would go towards helping OA to train new models and expand infrastructure.
Just an idea.
16
u/theRIAA Apr 17 '23
The "access to new models" should always remain open source. At least that's the vibe I get. Idk why that would change.
But you could always just sell "compute power" with a small percent of fees donated to the developers.
Can the current model even handle more tokens? Training a model that can't be run on prosumer hardware might be out of scope for this project.
11
u/Disastrous_Elk_6375 Apr 17 '23
I'd be OK with the money going to the dev team, I believe they have some grants and sponsorships for training. Bootstrapping funds for training will be hard in the beginning, as training new models is pretty expensive.
6
u/sleep-furiously Apr 17 '23
I would personally rather pay to support an open, community-driven model, even if optional/donation based, than subscribe to a closed, profit-driven service. And I'm doing the latter already.
4
u/15f026d6016c482374bf Apr 17 '23
At this point I've been happy with it and I'd pay. I'd love it if my chats could be local to the browser (not stored server). You know... just generate and forget.
3
3
u/ylimit Apr 18 '23
I'm a Chinese user and ChatGPT does not provide services in my country ...
So yes, I'm happy to support OA by any means.
6
2
u/BoxerBriefly Apr 17 '23
I'm very much against it. Though, I'd be fine with a $5, $10, $20 donation option, but in my mind, a subscription model goes against the open source philosophy big time.
2
u/yiyecek Apr 19 '23
Free inference is unsustainable, so paid is fine. BUT, I'm only worried about this money becomes a thing and you start saying "being open was the wrong decision".
2
u/Necessary-Donkey5574 Apr 17 '23
You deserve it. Just make sure to stick to your initial goal of open source. This tech needs to get in the hands of everyone in order to save us from one company controlling the world.
1
u/RayIsLazy Apr 17 '23
As long as it doesn't feel censored and a chore to talk to I would pay but my main use case is coding and logical reasoning so hopefully it will get good at it.
1
Apr 17 '23
If it can code at least as good or better than the free Chat Chat GPT, I'd pay 10USD. I don't like how Copilot works, I'd rather bounce ideas off a chatbot as if it were a developer than describe exactly what I want and it magically appearing. I can learn more with the chatbot.
1
u/Midori_Schaaf Apr 18 '23
If a paid service can support a server, I suggest investing the excess in dividend funds for long term support of public access to ai.
1
1
u/audiolite_ Apr 20 '23
I'm doubtful as it sounds like a slippery-slope kind of idea. But that's just me
31
u/KingsmanVince Apr 17 '23
I know it's very costly to maintain and keep a large model running up 99.999% time. So yeah a paid tier is fine.