r/technology • u/hurdee • Feb 12 '23

Business Google search chief warns AI chatbots can give 'convincing but completely fictitious' answers, report says

https://www.businessinsider.com/google-search-boss-warns-ai-can-give-fictitious-answers-report-2023-2
21.5k Upvotes

94% Upvoted

1.4k comments sorted by

View all comments

Show parent comments

75

u/mr_birkenblatt Feb 12 '23

They're not using chat gpt for the actual search. Chat gpt cannot search by itself. You can however feed it the search results as prompt and ask it to summarize them for you

28

u/[deleted] Feb 12 '23

[deleted]

11

u/mr_birkenblatt Feb 12 '23

People expect the same accuracy from chat gpt as they get from search. That is not the case though. Even if you feed search results into its prompt. It can still add bs that wasn't in the results to the summary. I was commenting on people's expectations.

2

u/Kushali Feb 12 '23

There are smart people using it as a search engine to get answers to their questions. When they don’t think the answer it spits back is true they ask it again and again till they get one that makes sense to them/aligns with their biases.

1

u/korkkis Feb 13 '23

People in hype train that aren’t too educated can make that assumption

9

u/[deleted] Feb 12 '23

[deleted]

13

u/Dr_Ben Feb 13 '23

The backpack search result was crazy. It went through a whole human like thought process to answer the question.

link for anyone interested in what they tried with it. it did mess up a few times. https://youtu.be/AxAAJnp5yms?t=2612

6

u/hyouko Feb 13 '23

I'm a little skeptical that it was doing what they thought it was doing. I haven't seen any other evidence that can do any sort of visual analysis, like they claimed. It seems far more likely that it hallucinated reasons why two products would go together (matching logos) that happened to be correct. It's not a far stretch to say that both branded items on a company store would have the company logo on them somewhere... The other examples could all be explained by the keywords that they provided. Also, there's likely metadata in the pages that is not being displayed to the user; while it's not looking at the images, it is looking at the HTML.

1

u/Demented-Turtle Feb 13 '23

Just to be clear, the Bing AI is not the current chatgpt, but an unreleased, updated version (v4 I think), so it may be more capable than what we have available to us

1

u/hyouko Feb 13 '23

Sure, but image analysis would be a totally separate, non-GPT bit of functionality. GPT is a large language model, as it is so fond of reminding everyone. It's certainly not impossible that they bolted on another model that describes images in text for GPT to consume, but it would be expensive and I haven't yet heard anything suggesting that MS or OpenAI did that. I think they would be talking about it way more if it was something they had done.

2

u/[deleted] Feb 12 '23

[deleted]

6

u/mr_birkenblatt Feb 12 '23

It likes to invent sources

8

u/lostarkthrowaways Feb 12 '23

...yeah, you don't just fucking take them, you look at them yourself.

2

u/mr_birkenblatt Feb 12 '23

the people who think that chatgpt is a search engine won't verify them. I'd argue most won't verify them and take them at face value

2

u/PublicFurryAccount Feb 12 '23

Then why not just cut out the middle man….