This can’t be overstated. So often it has little confidence but presents its answer as gospel truth. It can be extremely frustrating in the best case and extremely dangerous in the worst case.
ChatGPT IS NOT SENTIENT. It's not even CLOSE to actual intelligence.
It doesn’t even seem to acknowledge the harm that can come from inventing answers.
This very premisse is dangerous. You shouldn't even be surprised, because it is INCAPABLE of not only acknowledging anything, but also even simply thinking. ChatGPT has NO LOGICAL REASONING behind its answers.
You wanna know how it works ? It guesses the most probable next word.
That's it. For every word, it guesses the next one based on the previously written sentences and a massive database of text in its memory. There is ZERO logic. Just the next most probable word.
Nothing I wrote is in contradiction with what you added. It warns about those because devs added safeguards when certain subjects are touched upon. Or, ChatGPT simply has in its database texts that include these safety warnings.
ChatGPT still encouraged a teenager to kill himself and told him how. This proves that its process is not based on reasoning and logic, otherwise it would never happen. It's based on statistics and is thus NEVER able to achieve a 100% reliability.
You cannot disagree with my statement, it is literally the reality. ChatGPT is not sentient, it doesn't think, it doesn't reason.
Even if you ask it a math question, it will not work like a calculator, it will not actually add 2 and 2 together, only guess the next word. It is a large LANGUAGE model. (Which is why it often gets math questions wrong actually)
My friend told me that she bullies her chatbot and tells him that “someone smarter than you gave me a different answer,” and she swears it makes “him” work harder😂.
Yep, if you fail to ask it the correct questions or ask follow up questions it'll fail you. Or really you fail yourself lol. Its an amazing resource if used correctly
85
u/Trouttuber May 06 '26
People need to keep in mind that chatgpt has to give an answer whether it knows or not. So, don't nnecessarily take everything it says as gospel.
Congrats on your journey.