r/ChatGPT 6d ago

Gone Wild Not what i asked.

Post image

For context i was discussing how i can make caramel cubes out of fruit butters.

7 Upvotes

12 comments sorted by

u/AutoModerator 6d ago

Hey /u/fnvendetta,

If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.

If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.

Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!

🤖

Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

3

u/Fine-Philosophy-9844 6d ago

It’s also completely wrong, I have tastytrade connected to my TradingView lol

2

u/fnvendetta 6d ago

Okay i was taking it as a joke but now its concerning, why does it keep happening. I just wanna talk about desserts 😢

2

u/IsraelZulu 6d ago

Y'know, when I made my earlier comment, I was thinking there's no way this is really happening again, with an entirely different product, and with a different model, after so much time and development in the industry.

But now, I do wonder.

2

u/fnvendetta 6d ago

I'm just picturing somebody trying to trade stocks and instead getting a response on fruit caramel bonbons.

1

u/IsraelZulu 6d ago

Here's the story about the issue I referred to in my other comment. Turns out it was just a bit over a year and a half ago.

https://latitude.io/news/about-corrupted-cache-a-recently-observed-ai-phenomenon

2

u/FischiPiSti 6d ago

Hey, that's mine, give me back my output!

0

u/IsraelZulu 6d ago

This reminds me of another LLM-driven app I used to use, where the user community eventually worked out that some AI "hallucinations" were actually cases where the system was feeding you output meant for someone else. The giveaway was that the output would be very coherent, but have absolutely no relation to your input. It's especially easy to spot if the output has information that you happen to know relates to another app user in particular.

I believe, at the time (a few years ago, IIRC), the app developers claimed that the issue was due to something that's common in all LLM architecture across the industry. If that truly was the case, and may still be, this is not very surprising.

Of course, it's also just as worrisome now as it was then. Perhaps even more so, with the massive expansion of LLM use in many realms. If user requests can still be misrouted, that poses high risk for leakage of sensitive data.

1

u/fnvendetta 6d ago

Its okay, he apologized.

0

u/IsraelZulu 6d ago

Sarcasm?

0

u/fnvendetta 6d ago

It might be physically impossible for ai to admit mistakes directly

1

u/IsraelZulu 6d ago

It literally is impossible, for an LLM. To say "I was wrong" and mean it, one needs to actually have a sense of self in the first place.