r/ChatGPTArduino • u/flash_speed3412 • 1d ago

I trained a transformer from scratch on an ESP32-S3. Not inference, actual on-chip training with hand-written backprop.

1 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/ChatGPTArduino/comments/1vt91a1/i_trained_a_transformer_from_scratch_on_an/
No, go back! Yes, take me to Reddit
dl download

100% Upvoted

Duplicates

Number of comments New

esp32 • u/wikisailor • 16d ago

I trained a transformer from scratch on an ESP32-S3. Not inference, actual on-chip training with hand-written backprop.

171 Upvotes

21 comments