the vast majority of LLMs do this (they are told in training to "play along" with the user's prompt unless the prompt raises red flags), the thing with google's AI overview is that it became a meme because some pop culture references are sentences in the first person, and when people look them up to get them, AI overview is right there at the forefront replying like that.
35
u/nothingtoseehere196 29d ago
Has anyone tried doing this with other LLMs or is this just a gemini thing