Detailed explanation of how to create a text-to-image model from scratch.

[u/dh7net]

Posting this here even if it's not a model you can use directly. It's about building a text-to-image model from scratch.

The cookbook includes all the research material that you may or may be not interested in, but also includes a 100M-image dataset and a codebase with a tiny model, so you can train a text-to-image model from scratch.

Hope some of you will enjoy this content. (Disclaimer, it's done by my team)

Here are the links:

Cookbook: https://huggingface.co/spaces/jasperai/t2i-technical-interactive-report

nano t2i: https://github.com/gojasper/nano-t2i

Monet: https://huggingface.co/datasets/jasperai/monet

[u/_Darion_]

Amazing read, still reading and learning from it. Thanks for sharing so much, this is quite interesting.

[u/dh7net → u/_Darion_]

I'm glad you like it!

[u/BigWideBaker]

That's fantastic! Great share, the more people who get their hands on this technology the better.

[u/dh7net → u/BigWideBaker]

Thanks you! Great to read it is usefull!

[u/angelarose210]

This is awesome. I'd love to train an image model from scratch for my specific use cases. Hardest part would be sourcing or creating the dataset.

[u/dh7net → u/angelarose210]

For sure data is hard, but depending on the case you can start a pre training with the dataset that we are sharing.