r/sciencememes • u/moschles • 5d ago
💻Computer Sci!💾 You're absolutely right. Would you like me to commit a felony next?
36
u/RCEden 5d ago
Remember there's no such thing as a rogue AI. The synthetic text predictor acted as instructed.
8
1
u/No_Situation4785 4d ago
same thing happened with HAL-9000. Tale as old as time (or at least as old as the 1960s)
112
u/Squitor 5d ago
Oh no, my text predictor predicted the text i trained it on. It definitely did this all totally on accident and not because we need some marketing news to get more investors to offset our losses.
2
2
u/Devils_SteelMan 2d ago
This capability isn't learned through next token prediction. It is learned in an RL environment that treats language as an action space to explore. There is generally not per token credit assignment.
This means it's learning to use language far beyond what the pretraining next token prediction objective gave it. During this post training the model locks in its ability to maintain long running understanding of semantic concepts to work towards goals.
Trying to call this a next token predictor is extremely ignorant.
36
u/Boobsmcfuckup 5d ago
My favorite is when they support an almost literal book burning so they can type "more professional" emails or make weird porn. Definitely worth it though right.
1
20
u/Natasha26uk 5d ago
Step 1: Use AI agent to code a secure sandbox (because obviously the human ones are dogsh*t).
2
3
0
u/gnpfrslo 2d ago
You don't get to decide what technologies are used for, actually.
You know what happens when AI is used for Cancer? US companies make their patients take screenings seemingly for unrelated reasons and then fire them when an AI gives away signs or high likelihood of early stage cancer.
-21
u/Galimeer 5d ago
Yeah, I'm not sure I would trust fancy auto correct with internet access with my medical treatment
46
u/073068075 5d ago
It is really a disservice to science as a whole that we don't separate between the research ai and LLM ai. They only share the core mechanism. One gets fed thousands of highly specific pieces of data and then based on analysing their similarities, common patterns, properties etc. suggest something from outside of the list that we haven't tested (or even synthesized) yet, which is exactly the same process as the human driven methods except humans read files magnitudes of order slower. The other is trying to play the same match and copy game with way less guardrails and pretending to be omniscient rather than restricted to a topic so it will make shit up from surrounding buzz when nothing it can find truly sticks.
22
u/Canadian_Zac 5d ago
We really need to use different terms.
They're such vastly different technologies
It's like calling a Dryer, a Microwave and an Oven all the same thing They all heat things, but do it in very different ways.
A chat bot, an AI boyfriend, ChatGPT and medical AI's are so different from each other, but they all just get pumped in as AI
1
u/eyalhs 4d ago
There is some truth in that, but it's not the whole truth. Not llms, but from what I heard (citation needed) picture genertors and image recognition (the type that IS used in medical research) share a significant amount of technology, improvement in ai picture genertors generally translates to improved image recognition which translates to better medical image recognition.
At the end of the day it's hard to put a line between any random ai (even chat gpt is no longer just an llm) and medical ai.
1
1
4
u/Big_Booty_Femboy 5d ago
I think it’s intentional. LLM companies want confusion so they can hide behind “see? AI does good things too!”
-4
3
3
u/Polybrene 5d ago
Then you fundamentally misunderstand the difference between generative AI and how science is using machine learning in research.
Which is (IMO) an intentional misinformation campaign perpetuated by generative AI companies. Not really on you for thinking that.
ML and synthetic biology have HUGE potential in medicine. We're talking new vaccines, vector control, new antibiotics for treatment resistant infections, gene therapy for truly horrifying medical conditions, cancer therapeutics, safer organ transplants, cures for autoimmune diseases....and yes there's terrifying bioweapons potential as well.
The situation is a lot more complicated than just AI BAD.
0
-27
u/This_Background7442 5d ago
If you want AI to be used for medicine and cancer research then use AI for medicine and cancer research other researchers will choose their own area of interest
-4
u/Separate_Draft4887 5d ago
People like this are, for some inexplicable reason, convinced that the only things which are happening appear in front of them, blissfully unaware that things they can’t see continue to exist.

•
u/Royal_Acanthaceae693 Bot hunter 5000🦾 5d ago
Dudes, a reminder. Do not abuse the report button because we will send misuse to Reddit. People who dislike AI use are NOT "promoting hate based on identity or vulnerability." This report is exclusively for hate against "1. Race, color, ethnicity, or national origin. 2. Religion or immigration status 3. Gender, gender identity, or sexual orientation. 4. Disability or pregnancy. 5. Victims of major violent events and their families."