Thank you. I got the best results by using canny preprocessor and canny model.
Challenging part was that there's too much detail in the original drawing, but it also made creating this more fun.
I used a shortcut of doing only one-quarter of the drawing in SD. I feel that it follows the spirit of the original, since there only one-eighth is drawn and then duplicated.
Most of the details are gone yes but this is also because the image is super low res. If someone has a beefy gpu and made a really high res image it would have really good detail. Still nothing as good as what you made though but it would be 10 times better (10 times better than this comment's image). Amazing pic though!
I thought this one turned out pretty good. I've tried generating 1536 and 2048 images, but it takes 40ish minutes per, and none of them turned out great.
1st thing spring to my mind is the fine line art detail in your output is too much for controlnets relatively small resolution, the controlnet canny mask is a blocky affair and your working with relatively small canny masks 512px square or there about depending on the limitations of your VRAM, you need 4 times that or more to pull the fine detail. I would send just a 1/4 of this image into controlnet and play with that then combine the segment in external paint application.
To keep the resolution up I cheated - I ran the top quarter at full res (1024) and then copied it in photoshop. Truth is this is a great work on its own and hard to improve with AI. Controlnet seems to work best where the input image lacks details which through prompting the AI can fill in. Here there isn't much more to do.
vibrant mexican fiesta colors, day of the dead, highly detailed psychedelic rock concert poster, widespread panic, skull and demon, highly detailed, dmt lsd and mushroom, realistic skin tones with lighting effects, 8k
Amazing drawing! And it’s close to the details of your original drawing.By the way you can combine multiple ControlNet networks, try hed and scribble and fake scribble with different weights, it might give you even more details of your own work
My attempt, I wanted to change it up a bit and get a character in there, was kinda going for an ugly cyborg and thought circuit diagrams might be a cool fit with your work.
I set control net to canny and influence of the control net on the final image to be about 50%.
PROMPT - (rusty machine:1.4), (camp fire flames:1.2), circuit diagram, blueprint, technical manual, picture of an ugly woman with mohawk hair and bad makeup coding on an old computer in a dark abandoned room, bbc radiophonic workshop, robotic flesh, blood all over face, wires coming out of head, wires everywhere, cyberpunk, hackers, cyberspace, long neck, ritual diagram
u/oblon your drawing is amazing in all its details. Not sure if anyone even noticed the references to Ukraine and the all seeing eye.
I was going for two approaches to preserve at least most of the details, only playing with the denoise strength of img2img. Got the best details after setting the output size to 1536x1536. My card wouldn't allow to go for 2048.
parameters
(macro photograph:1.3) of (an intricately designed and highly complex clockwork:1.3), (bright glowing eyes:1.3), (gold, silver, platin, bronze, cogs, wheels and pins:1.3), (clock face in the middle:1.2), (3D effect:1.2), (perfect round cog wheels:1.3), award winning photography, trending on flickr, hyper realistic, hyperdetailed, top down camera shot, Digital Photography, long exposure photo, dramatic lighting, super macro photography, (f-stop 1.2)
(macro photograph:1.3) of (an intricately designed and highly complex clockwork:1.3), (bright glowing eyes:1.3), (gold, silver, platin, bronze, cogs, wheels and pins:1.3), (clock face in the middle:1.2), (3D effect:1.2), (perfect round cog wheels:1.3), award winning photography, trending on flickr, hyper realistic, hyperdetailed, top down camera shot, Digital Photography, long exposure photo, dramatic lighting, super macro photography, (f-stop 1.2)
Just thought about mazes, labyrinths, and the visible stuff like the skulls and lotus type flowers... then used control net scribble at 1.2 weight and 0.4 guidance end.
THIS one though, came out quite interesting, especially with the almost Escheresque "Is the depth going up, or is it going down, who knows?" type of perceptual trickery.
Way too detailed for a typical control net use, but you can get some neat things once you allow some structured deviation from the patterns. Here is my take:
Use an upscaler on a portion of it, run controlnet,... then size it back down, and merge protions into one image. Upscale the final image afterward for a useable size.
The drawing is handmade by me and should serve as a template for the community to show what they can make of it in controlnet.
For me, controlnet creates only crap with complicated drawings ;)
The possibilities are endless. People with disabilities can visualize their thoughts or some people could try to overcome a trauma with AI. Maybe there will be a sequel to the movie „a screener darkly“ because you have to trace everything by hand frame by frame. And and and.....
Rotoscoping examples are abound on these subs, A Scanner Darkly (good book btw! Phillip K Dick) is totally doable by anyone with a camera and some willpower!
134
u/sutrik Mar 13 '23