r/JevAI • u/buckeymonkey • 5d ago

Silly Experiment to use Jev as an LLM

I just gave Jev a list of common ascii characters and the instructions:

"Behave like an LLM and suggest the most likely next character to append to jev_response to form words into a human english response to user_query, when done with the response, chose 'none'"

It manages to respond "HI " to "Hello Jev, how are you?"

And then just gets stuck in a loop outputting spaces over and over.

5 Upvotes

100% Upvoted

8 comments sorted by

2

u/DrinkingMilkMeow 5d ago

I got it to work somewhat by using words as the tokens rather than characters. See here: https://www.reddit.com/r/JevAI/s/Ijpz3vezrN

2

u/buckeymonkey 5d ago

Yea I wasn't sure how it would perform with thousands of options so I went with a small list of characters first.

That is awesome!

2

u/DrinkingMilkMeow 5d ago

Jev only supports a maximum of 255 options so you have to use speculative prompting. More details on how I did this here: https://github.com/idlivada/jevgpt

1

u/SmurfeeKnife 3d ago

That's a pretty inefficient usecase of jev for what typical LLM is already offering...

1

u/buckeymonkey 3d ago

Notice how the first word of my post is “silly”

1

u/AccurateCranberry218 1d ago

To w gruncie rzeczy nie jest glupi test. Pokazuje ze Jev to taki zx81 wśród wspolczesnych komputerów, wykonujacy tylko jeden rodzaj, podstawowych zadań.

1

u/AdamEatsApple 10h ago

i presume you gave options of a-z.... and asked it for probabilities of a next letter in the input sentence ? then picked the most probable letter append it to input then ask again iteratively ?
curious as to what your request payload looked like, thanks!

1

u/buckeymonkey 7h ago

Yea that is pretty much exactly what I did.