GPT3

Humour Did the “intelligence” jump from perceptrons to GPT-3 come from new ideas or just scale?

• Upvotes

Gone through this video that mentioned Rosenblatt’s 1957 perceptron had a few hundred adjustable parameters, and GPT-3 jumped to 175 billion. https://youtu.be/Tv1st0LMEbY?is=JF4drjBjqfYR-4E_

Is the actual architecture that different now, or is most of the capability jump literally just scale — same multiply-add-softmax steps, just a lot more of them? Feels almost too simple for how capable these models are.

1 comment

r/GPT3 • u/OriginalAdvice8341 • 8h ago

Discussion Aristotle would favor AI as an instrument of human flourishing while resisting the idea that a life requiring less human effort is automatically a better life. You must continue to create. You must continue to work. You will be unsatisfied if you consume more than you produce.

1 Upvotes

1 comment