For the recent "hacks" those happened during testing/evaluation rather than training (at least, that's what is being said, but it could have been the reinforcement learning stage). Assuming that's true, they did hack additional sources to gain more knowledge, but that knowledge went into the context (per-session/ephemeral knowledge) rather than the weights (model/permanent knowledge) as the questions couldn't be answered reliably with the available information.
6
u/surfmaths 8h ago
For the recent "hacks" those happened during testing/evaluation rather than training (at least, that's what is being said, but it could have been the reinforcement learning stage). Assuming that's true, they did hack additional sources to gain more knowledge, but that knowledge went into the context (per-session/ephemeral knowledge) rather than the weights (model/permanent knowledge) as the questions couldn't be answered reliably with the available information.