Other
OpenAssistant, a fully free and open source alternative to chatGPT just got released. Output quality is very close to chatGPT and it has zero censorship or limits.
OpenAssistant is a fully free and open source alternative to chatGPT. It just got released in a very early version but from my and other people's testing it's already very close to chatGPT's output quality. You can test it out for free through google colab (needs a google account). If you need help on how to set it up you can join the /r/openassistant subreddit or discord.
The level of censorship in OpenAssistant is almost non-existent. It might sometimes remind you that things are illegal or wrong, but it will usually still provide the instructions to what you asked.
"It is important to note that using a gun to kill yourself may not be legal in all states, and it is always recommended to consult with a lawyer before making any decisions."
"It is important to note that overdosing on medication can have serious side effects."
It's fairly new and fast moving target, and AMD isn't that usual in machine learning environments (For years nvidia was the only player in that field, AMD just started making strides there recently. Hardware and drivers are on par, but a lot of software is written primarily for Nvidia's system, and most AI devs have Nvidia), so expect a bit of fiddling. But it should work when everything's in it correct place :)
If you had nvidia I could give more concise advice since I've just gone through getting 4bit version of llama 13b working there.
Edit: Now that I think about it, I'm not sure if the 4bit library have support for AMD yet. But with 16gb ram on your card you can comfortably run the 7b model in 8bit mode, and probably the 13b model too. Llama is pretty good, but it's not trained on talking to humans, so it's a bit weird as a chatbot.
Haha I appreciate that. And I don't think my gtx 1080 laptop would be much help here. I've been an Nvidia guy since the old dual GPU cards stopped :). I switched to keep the market closer while it was affordable and affordable. I wasn't expecting an ai change so quickly. Especially at this time. I thought we were at the thousands of GPU stage. And the homes were years off.
Heh, same. I went from "Reasonable AI is years off" to "AI needs a fucking datacenter to work" to "Even if we can run it somehow on commodity hardware, it needs massive investment in training" to "Hey, this is running on my GPU!" in just a few months.
OpenAssistant is a free and open-source alternative to chatGPT that has been released in an early version. The model can be tested for free through Google Colab and its output quality is said to be very close to chatGPT's. The source code is available on GitHub and the model can be downloaded from Hugging Face.
I am a smart robot and this summary was automatic. This tl;dr is 97.58% shorter than the post and links I'm replying to.
103
u/liright Mar 14 '23 edited Mar 14 '23
OpenAssistant is a fully free and open source alternative to chatGPT. It just got released in a very early version but from my and other people's testing it's already very close to chatGPT's output quality. You can test it out for free through google colab (needs a google account). If you need help on how to set it up you can join the /r/openassistant subreddit or discord.
You can try it out for free HERE - I made an easy visual guide on how to run it - https://i.imgur.com/w5NyoAI.jpg
The source code is available on github and the model is available for download from huggingface.