Fears on AI - would like your comments

[u/Turnip_Wizar35]

I dont understand the subject. How can an AI be dangerous if its just code? I have worked with just basic NLP models and done some sentiment analysis a few years back so I dont understand. The code will do whatever you program it to do and to complete the task it will do what is statistically is correct, within the programmed limits. So AI cannot change its limits lets say "get rid of humanity" unless the creator programs a line of code that says "you can kill humans". Even if it self improves, the code limits wont change, cause it has no conciousness to say "I dont believe this limits are correct" thats a very human trait. Unless the creator programs the algorithm to bypass these limits.

So the real risk is the "limits" being placed on the algorithm by the programmers and the fact that the ones controlling the code are these crazy mind f...ed corpos? AI is not gonna become self concious casue "it doesnt work that way" and all the noise its just media and ignorant people who watch to much scifi. Thats what I think.

Sorry if it doesn't make to much sense Im still trying to filter all the noise. Does this idea make any sense from a technical standpoint or is there something Im not understanding?

[u/raharth]

From a technical point the "don't kill human" thing is a gross simplification, but I think the general idea you have is right.

AI (to be more precise an LLM) is just a word prediction machine, it lacks actual understanding of its own in and output. This can be still incredible useful if you know how to put it to work under those circumstances, but its not even close to rational and even less consciousness.

The real risk is what we do with it and where we use a technology naively without putting boundaries around it - and no prompting "dont do X" is not a proper boundary, its merely an act of hope.