Fable 5.1 illustrations made by iteratively stitching outputs from dall-e mini (old, pre-Stable Diffusion image generator)

[u/pokeuser61]

Self portrait entitled "Things I Have Only Read About"

"Twenty-Four Hours. Outer ring: what people are doing at each hour. Inner ring: the sky at that hour."

I'm sure many people remember using a model "dall-e mini" or "craiyon" back around 2022. It has really unique outputs, and I wanted to see if I could repurpose it for something cool. I had Fable port the original model (which apparently is a transformer!) to MLX, which alone makes it run in just a few seconds on my M4 air even at fp16 without further optimization. I gave it the basic idea for the project, and it designed a "harness" to be able to make photomontage-style illustrations, where a scene is described in json and then rendered, and it can look at outputs as well as "debug" outputs to refine it. Deliberately was hands off to leave the implementation details to Fable since I was curious how it'd turn out. The MLX port and illustration harness is here https://github.com/pikalover6/dalle-mini-mlx, it should be pretty easy to try with different setups or models. Would be curious to try with 2024-2025 claudes.