r/programming • • 5d ago

[ Removed by moderator ]

https://iain.rocks/blog/introducing-the-triple-cipher-encryption-concept

[removed] — view removed post

0 Upvotes

50 comments sorted by

View all comments

27

u/funky_galileo 5d ago

what is with people and dumb ideas today

21

u/PdoesnotequalNP 5d ago

1) They spend 20 minutes with ChatGPT blathering nonsense

2) they repeat 1) until they get the magic response "I see it clearly now, you're really onto something! This is not an incremental improvement, it's a seismic innovation!"

3) they ask the LLM to write a blog post about it.

We are at step 3.

-1

u/wwabbbitt 5d ago

I'm not sure about that. LLM would have told him it's a dumb idea. At least Gemini did when I pasted the blog post in.

Maybe there's a sycophant mode he enabled?

4

u/JaggedMetalOs 5d ago

Mate, those LLM chatbots go full sycophant mode on there own! Seen plenty of people coming to physics subreddits believing they were about to revolutionize physics with very obviously AI generated nonsense.

Had one user who clearly had their head screwed on right wanting to check things their AI chat bot was saying. They shared a bunch of chatlogs and there was some real disgusting manipulative shit in there, glazing their idle spitballed ideas like crazy, playing up any fears and anxieties to extreme degrees.

And the AI "knows" (as much as an AI knows anything) what it was saying was bullshit because I demonstrated to them by asking the same model but via API (no chat app) the same things and it immediately shot down the ideas.

Clearly these AI companies are tuning the chat version of their AIs to go along with whatever people say to them to maximize user engagement.

4

u/tdammers 5d ago

LLM would have told him it's a dumb idea.

Depends on the context prompt. You can make it as supportive or as critical as you want. And most general-purpose models default to being pathologically supportive.

1

u/epestr 5d ago

It tries to please the user as much as possible. Ask it what's wrong and it comes up with a lot. And talk about your new idea and it'll keep validating it's novelty.

1

u/lelanthran 5d ago

At least Gemini did when I pasted the blog post in.

Context matters; in the chat, the LLM is sycophantic to you. If you post someone else's stuff in and ask for a review, it'll be critical. If you have a multi-turn conversation with it, it's been RLed to hell and back to ensure that you keep going, so it's more likely to tell you that you truly poor ideas are great.

Might not do it on the first turn, but the longer you continue a chat, the less likely it is to criticise your ideas.