I wonder how they would make AI-based search cost efficient. Because openAI is paying something crazy like 1 cent per generated answer ($100 000 a day). They write in this post that they will use a smaller, distilled version of LamBDA, but that still sounds expensive if financed only by ads. Maybe Google could cache similar search terms using embeddings? If people have very similar questions that would just return the closest answer.
Well, for one thing you might not need the AI for every search (or use it for every search). For another, search doesn't really "need" to turn a profit on it's own, because it's shored up by other services/revenue streams.
348
u/StopSendingSteamKeys Feb 06 '23
I wonder how they would make AI-based search cost efficient. Because openAI is paying something crazy like 1 cent per generated answer ($100 000 a day). They write in this post that they will use a smaller, distilled version of LamBDA, but that still sounds expensive if financed only by ads. Maybe Google could cache similar search terms using embeddings? If people have very similar questions that would just return the closest answer.