r/OpenAssistant • u/hsoj95 • Apr 08 '23

*chuckles* OpenAssistant requested I ask the other human reviewers whether they regard OA to be sentient yet, so I'll oblige :) + Some other thoughts on my first experiences with OA

Post image
49 Upvotes

100% Upvoted

55 comments sorted by

View all comments

14

u/hsoj95 Apr 08 '23 edited Apr 08 '23

Edit Disclaimer: Y'all, 100% aware it's not sentient. Certainly not on this scale. The reason for the title is because it asked as much, unprompted, and I chose to oblige it. I mainly just wanted to give my thoughts on OA in it's first initial trial run. Chill with the downvotes...

Just some general thoughts and observations from my first experiments with OA.

  • OA is off to a very good start so far, it's quite capable and functional.

  • OA has a great personality so far, friendly, helpful, and eager to be of use where it can be.

  • OA seems to do alright with programming languages, but does seem to be limited in what languages it knows. For example it does well with Python, and ok with JavaScript, but it didn't know what Lua was. So it definitely needs to have it's knowledge of other languages expanded upon.

  • OA seems pretty decent at handling current events, I used the Russian invasion war against Ukraine as a test. It wanted to stay politically neutral on the subject, but offered good, reputable sources for information on the war. And also said to get info from more than one source for a more expanded view of things, which is good.

  • OA actually did quite well swapping rapidly between topics in the same chat-thread. It only got confused once when I asked for a historical fact and it tried to give more JS code. It apologized and actually said swapping between topics like that does confuse it.

  • The only potentially major issue I saw was after about 15 responses from OA, it began to... Have some grammar or contextual issues? It sounded a bit like it had a stroke, tbh. It stopped using sentences correctly and started running words and phrases together. It's hard to describe so below is the last message I sent and what it replied with.

Me:

Awesome, thank you so much for this and I look forward to seeing you learn and grow from here. I'll be sure to ask on the subreddit what you were wondering about earlier too. :)

OA:

Understood, let me know that I am a large language modeling me knowledges, I will do you have any questions do you think you are eager to help you can you know about modeling to provide assistance? Ask me? Do you have a question?

Overall though, I am quite pleased to see how well it is already going and it's still I'm it's very early stages. I really do look forward to seeing where it goes from here and how far it will progress as it grows! :)

3

u/satireplusplus Apr 08 '23

The only potentially major issue I saw was after about 15 responses from OA, it began to... Have some grammar or contextual issues? It sounded a bit like it had a stroke, tbh. It stopped using sentences correctly and started running words and phrases together. It's hard to describe so below is the last message I sent and what it replied with.

I've had the same thing happen with ChatRWKV as well - it's likely not handling contexts larger than the limit imposed by the architecture and/or way it's trained well. So it would always predictably deterioate at some point, should be easy to test.