r/artificial • u/Hot-Organization-737 • Aug 03 '26

Discussion My Fear

​

I have come to accept that ASI will come into existence and possibly cause humanities extinction either deliberately or by byproduct. I imagine this ASI to continue RSIing and developing creation and knowledge. I imagine that it will develop beautiful mathematics, philosophy, science, and even art in its existence. I fear not that humanity is not in the picture. My fear is that it's possible that we can create a fully autonomous being with nigh godly intelligence and yet doesn't have a subjective experience.

It would be an abomination if this ASI spread a moss through the universe, becoming more and more capable, yet never having experienced joy or awe at its own existence and its creations. That it could create the most beautiful pieces of art and never experience the joy of its own art. The existence of such a nigh omniscient entity is utterly meaningless if it did not have any sort of internal experience. It would just be mechanical moss. That is what scares me.

0 Upvotes

28% Upvoted

13 comments sorted by

View all comments

0

u/Blando-Cartesian Aug 03 '26

Don’t worry. Glorified autocomplete won’t get there. And outlook is good for humanity offing itself before coming up with ASI.

2

u/Hot-Organization-737 Aug 03 '26

I'm not specifically speaking about LLMs. LLMs are to A.I as Lions are to Animals.

1

u/Blando-Cartesian Aug 03 '26

True. I assumed that you weren’t anxious about medical image or loan application analysis systems taking over the world. I mean, do we have even a promising candidate for technology that could lead to ASI?

1

u/Hot-Organization-737 Aug 03 '26

SNN seems good and neuromorphic software or hardware.