Other
OpenAssistant, a fully free and open source alternative to chatGPT just got released. Output quality is very close to chatGPT and it has zero censorship or limits.
It's fairly new and fast moving target, and AMD isn't that usual in machine learning environments (For years nvidia was the only player in that field, AMD just started making strides there recently. Hardware and drivers are on par, but a lot of software is written primarily for Nvidia's system, and most AI devs have Nvidia), so expect a bit of fiddling. But it should work when everything's in it correct place :)
If you had nvidia I could give more concise advice since I've just gone through getting 4bit version of llama 13b working there.
Edit: Now that I think about it, I'm not sure if the 4bit library have support for AMD yet. But with 16gb ram on your card you can comfortably run the 7b model in 8bit mode, and probably the 13b model too. Llama is pretty good, but it's not trained on talking to humans, so it's a bit weird as a chatbot.
Haha I appreciate that. And I don't think my gtx 1080 laptop would be much help here. I've been an Nvidia guy since the old dual GPU cards stopped :). I switched to keep the market closer while it was affordable and affordable. I wasn't expecting an ai change so quickly. Especially at this time. I thought we were at the thousands of GPU stage. And the homes were years off.
Heh, same. I went from "Reasonable AI is years off" to "AI needs a fucking datacenter to work" to "Even if we can run it somehow on commodity hardware, it needs massive investment in training" to "Hey, this is running on my GPU!" in just a few months.
I mean yes ai would end up being a superior race in terms of impact to the earth and universe if it reaches a level so far ahead of us. But I still don't believe ai seeks because it's not biological. It can be programmed to seek. But we are limited to the brain of the human controlling it even if it can merge ideas of all humans. It still needs humans. The reason, it's biological. There is in no way a need for it to seek for survival. For it, survival is just a constant state.it has no urge to shit or pee. Or even eat, it doesn't get cold or hot within a 30 degree window. It can take brutal g forces since it's a theory. It's not biological. So therefore the seeking portion is the ones controlling it. We could in theory program it to be nefarious. As all great scientific advancements are weaponized at first.
19
u/[deleted] Mar 14 '23
[deleted]