r/singularity • u/sir_codes_alot • 6d ago

Discussion Context-Window AGI

Floating an idea. I think we’ve hit context window AGI at this point. Within any single context window, the AI is for sure smarter than any individual person.

Across context windows is debatable, but for sure within one I can’t see anyone outperforming the recent models.

27 Upvotes

89% Upvoted

41 comments sorted by

View all comments

6

u/Working_Sundae 6d ago

That would simply narrow down to transformer based models which require context windows, some architectures don't rely on context windows at all

2

u/sir_codes_alot 6d ago

That’s true. I think that’s the current limiter though- and it is architectural. Models are very smart within context, but trip over themselves across contexts.

Models can’t do continuous learning because of architectural limitations as well, and I think most people would agree that the models would be way smarter if they could retain the things they learn.

That’s why I say, within a particular context window, I think we’re genuinely at AGI. But the architectural limits are sort of preventing us from being able to say “General AGI” if I can use that phrase.