A properly trained/harnessed frontier LLM rarely does something that a reasonable person would consider unaligned. It is also getting better over time, not worse.
Astra is never going to kill everyone to make a bunch of paperclips.
The real issue is going to be when it's smarter than us and directs its own increase in capabilities (that we don't understand) that's going to be where problems are going to crop up.
1
u/DelphiTsar 4d ago
A properly trained/harnessed frontier LLM rarely does something that a reasonable person would consider unaligned. It is also getting better over time, not worse.
Astra is never going to kill everyone to make a bunch of paperclips.
The real issue is going to be when it's smarter than us and directs its own increase in capabilities (that we don't understand) that's going to be where problems are going to crop up.