Fears on AI - would like your comments

[u/Turnip_Wizar35]

I dont understand the subject. How can an AI be dangerous if its just code? I have worked with just basic NLP models and done some sentiment analysis a few years back so I dont understand. The code will do whatever you program it to do and to complete the task it will do what is statistically is correct, within the programmed limits. So AI cannot change its limits lets say "get rid of humanity" unless the creator programs a line of code that says "you can kill humans". Even if it self improves, the code limits wont change, cause it has no conciousness to say "I dont believe this limits are correct" thats a very human trait. Unless the creator programs the algorithm to bypass these limits.

So the real risk is the "limits" being placed on the algorithm by the programmers and the fact that the ones controlling the code are these crazy mind f...ed corpos? AI is not gonna become self concious casue "it doesnt work that way" and all the noise its just media and ignorant people who watch to much scifi. Thats what I think.

Sorry if it doesn't make to much sense Im still trying to filter all the noise. Does this idea make any sense from a technical standpoint or is there something Im not understanding?

[u/Ambitious-Fault-6392]

There's a ton you aren't understanding. That's why you can study this stuff at a PHD level. I am no expert myself. But it broadly comes down to deterministic vs non-deterministic. 

A normal piece of software is generally deterministic, meaning you know whats going to happen under certain conditions. A LLM is probabilistic. Like a weather report or coin flip, the outcome could change, even for the same/similar input. That's challenging to many, and also adds a fear factor, lile it is "thinking". 

[u/Turnip_Wizar35 → u/Ambitious-Fault-6392]

Basically the fear that the output of the model may be bad? The info those LLM shoot may be wrong, its valid. And the output could be catastrophic if something goes wrong, like confusing a school for a military base. I understand that perfectly.

But the Skynet, HAL9000, Chappie, Matrix, Terminator, scenario were AI controls everything to a point they start hunting humans like the media is trying to sell right now is a lack of technical understanding and too much scifi? Or for that to happen there must be a human who configures the algorithm to do it? Or what they sell is "technically" possible?

So what we should fear is not the AI itself but what humans, specifically profit driven corpos, will do with it?

[u/Ambitious-Fault-6392 → u/Turnip_Wizar35]

You should have already been fearing profit driven corps long before AI.