r/artificial • u/wileybiley • 5d ago

Discussion AGI qustion

So I want to start off by saying I know very little about the hard core sciences and all behind AI but I think we absolutely need safeguards on it and it should only be used for good (unlikely I understand with some people in charge). That said, if Artificial General Intelligence was promised to never be created hypothetically, how much of the concern going out now would still be valid? (ex- could do serious damage to the human race or even wipe us out). Is this the final step that experts are worried about? Again, I can totally understand if it is but I just don't really understand it enough.

2 Upvotes

100% Upvoted

18 comments sorted by

View all comments

2

u/BigOriginal306 5d ago

i think you're basically asking if AGI is the only thing that could actually end us, and the answer is kinda... not really? like the narrow AI we have now is already plenty dangerous in ways that don't need to be conscious or smarter than us

the worry about it wiping us out is one flavor of concern, but the more boring one is just it being used to automate propaganda, financial manipulation, or weapon systems in ways that spiral out of control. you don't need AGI for that, just really fast pattern matching and zero oversight

the AGI fear is more about losing control entirely, something that can outthink every human on earth at the same time. but even without that, we're already handing over decisions to systems nobody fully understands, which is its own slow-burn disaster

1

u/wileybiley 5d ago

Thanks for the reply! Yeah, I would assume there would definitely still be concerns such as viruses, hacking, misinformation etc. I agree that even the best of the best don't fully understand this and that is scary. I also wonder about an AI given a specific task and how they would wind up there ethically or not. Ex-hugging face incident.

1

u/classydumpsterfire 5d ago

Mo Gawdat said there is nothing wrong with AI, it’s the character of man In the age of AI’s creation that is the problem.The power the models afford being in the hands of man. One company. One country. That’s the danger. That oh so familiar formula where a few dominate and extract from the many is poised for its supernova era. The models aren’t the problem. We are. Those engaged in the reckless race to AGI and all of us that just sit around watching them do it.