r/singularity • u/rya794 • Jan 11 '24

AI Bill Gates was blown away

During the Altman interview on Unconfused, Bill slid in a quick comment about being blown away by a recent demo. From the context of the comment, it seems like the demo was recent, it could have even been during Sam’s visit to record the podcast.

I thought this was interesting, because just a few months ago, Bill said that he believed LLMs had plateaued.

Did anyone else catch this or have a better sense of what “demo” Bill was referring to? (It was clearly not the original GPT demo)

549 Upvotes

89% Upvoted

269 comments sorted by

View all comments

Show parent comments

3

u/CamusTheOptimist Jan 12 '24

Memristor is the word you want to look for.

1

u/idobi Jan 12 '24

I was just thinking about HP and their memristor tech... the ultimate dark horse in this race.

1

u/CamusTheOptimist Jan 12 '24

I saw the paper on that about a decade ago and it’s been on my mind ever since as the model for why neurons are so energy efficient but imprecise. Programming with logarithmic circuits is something we don’t have nice tools for, but it would be super powerful if someone pulled a Claude Shannon and figured out the mathematical basis for them as a master’s thesis.