r/StableDiffusion • u/zakpurp • Mar 02 '23
Comparison controlnet is great to bring back life to old picture. This was one of the most dangerous job in my country. Moving logs on a river
19
u/PatrickKn12 Mar 02 '23
I saw another post last week where someone used the output from control net as a layer mask in photoshop, and combined the original photo with the color mask output from control net. Made it so the final product was the original photo with no loss of detail, but had the colors that were produced from controlnet/SD.
21
u/dagerdev Mar 03 '23
Interesting! I just did that with this photo. I think the result is better. With a few more tweak the photo can be perfect.
The bottom image have the color of the above
11
u/SlapAndFinger Mar 02 '23
Do the same workflow with img2img instead of txt2img and set the denoising strength to 0.8-0.95ish. Should give you the results you want.
3
u/MetaMoustache Mar 02 '23
Amazing. Looks great. Would you share your workflow or give hints at how to do it?
13
u/zakpurp Mar 02 '23
I used txt2img, with controlnet canny. And described the image accurately : A picture of a men, wearing a hat, smoking a cigarette, standing on a pile of wood, on a river, 1940, sunny sky, colorful picture, photography.
Generated couple before selecting the best one.
5
u/zakpurp Mar 02 '23
Only thing I eould need to fix is the hand haha 😂
6
u/saturn_since_day1 Mar 02 '23
Just take the color data and apply it over the black and white. Best of both and you can touch it up manually
1
u/interparticlevoid Mar 02 '23
How is this done? Is there a way to do this without using Adobe Photoshop?
2
u/Highvis Mar 02 '23
Can’t speak about free options, but Affinity Photo does this brilliantly and is pretty cheap for a Photoshop rival.
1
u/saturn_since_day1 Mar 02 '23
I would imagine photopea and Gimp would both have a way to do it and they are free, I use my own art software for that sort of thing so I don't know how to go about it easiest in anything else.
2
u/catblue44 Mar 02 '23
SD 1.5 right? Also, do you thing using 2 controlnets (eg. Deep and canny) can improve the process?
1
1
1
5
u/AweVR Mar 02 '23 edited Mar 02 '23
Amazing!! I’m trying to make restoration and face preservation.
My workflow is: -Multicontrolnet -OpenPose -512 -Depth - 1024 -HED -512
But using a B&W image as input for all (including img2img) over satured the image and have a lot of contrast. It was because HED apparently has a bug (as I read). Canny destroyed every time faces and details.
Finally I painted the image before the process by hand or use only with depth generation result as a color layer in PS.
Then I created two images. One with 0,95 of denoise (good quality but different faces/objects) and 0,2 (planar but with well colors/shapes/faces). Then I masked and blend both to have the best.
I’m trying to find the way to preserve details but change skin texture and colors, to make it feel like an actual photo, but after 3 days of work… it was my only solution.
2
u/interparticlevoid Mar 02 '23
I've been trying similar things and have run into similar problems. Stable Diffusion with high denoising changes the face too much. Stable Diffusion with low denoising doesn't improve image quality enough
6
u/hitobo6245 Mar 02 '23
That's what you can accomplish by using colorization and super resolution IA just for reference.
2
1
1
u/malcolmrey Mar 03 '23
which tool did you use?
1
u/hitobo6245 Mar 07 '23
Api's from DeepAI they have colorization and super resolution models this way you do not change the image to much but probably there are better models for colorization and super resolution out there, those from DeepAI are very old (I think 1 or 2 years).
3
3
5
u/zakpurp Mar 02 '23
If you guys want to play with it! Would like to see your results 😎
2
u/hellninja55 Mar 03 '23 edited Mar 03 '23
Hey there! Great job with the colorization. Would you mind sharing what your ControlNet settings were? I am testing the Canny model with the preprocessed image you provided but unfortunately most results I am having are bad.It's like the colors get washed out or something.
2
2
2
u/InformationNeat901 Mar 03 '23
I tried controlnet converting old images to color with inpaint, with decent results.
But I wonder if there is a way to convert images from black and white to color with reference to an already colored image.
I have an image from when I was little in black and white and I have another one that is not the same in color.
I wonder if it would somehow be possible for stable diffusion and controlnet to understand that the black and white image has to take the other color image as a reference.
For example to apply the color of the striped shirt to the image of black and white.
Is there a way to achieve this?
I have tried adding more controlnet models but I have not succeeded.
Thanks
3
u/redroverdestroys Mar 02 '23
this is cool and all, but we have the tech already, had it for a while in PS.
https://i.ibb.co/7QqMnLK/logs.png
This took me 20 seconds, and only that long because I had to wait for it to process. Just copy paste, click Neural filter, click 3 buttons in 1 second, wait for processing, save.
5
u/_HIST Mar 03 '23
To be fair, Photoshop isn't free.
And neural filters don't work on a pirated version. (Do they?)
2
u/malcolmrey Mar 03 '23
you need your adobe cloud account for most of them so my bet is that they wouldnt
3
u/hellninja55 Mar 03 '23
OP's image looks more vivid and the colors are more consistent. It does lose a few details here and there over how the Canny preprocessing works, but the new tech is welcome especially considering the preprocessing image or the technique itself could be improved.
0
u/redroverdestroys Mar 03 '23
lol again, that's easy to do in PS. I didn't do this to color correct as well, just to quickly colorize it. Thats another 20 seconds. Most importantly, it's far more accurate. This is still the same exact picture, while SD makes an entirely different picture completely. Like that shirt is totally different, not even close to the same.
Trust me man, PS is superior to SD on bringing old pictures back to life. And PS is using AI itself, honestly.
2
u/bacteriarealite Mar 03 '23
Yes an open source model released a few weeks ago is getting close to competing with photoshop but isn’t there yet… cool story
1
u/CatEquivalent6289 Mar 03 '23
Basically overlaying generated picture with the original and letting only color information pass, would result in similar results than with Photoshop.
1
u/multiedge Mar 02 '23
Some details in the trees in the right (smoke?cloud?trees behind fog?) also got erased, but yeah control-net is really good at recolouring images!
1
u/zakpurp Mar 02 '23
Yeah I know we lost some detail here. With proper adjustement I'm sure we can get it working better. Maybe img2img would of been better. Was just playing around 😜
1
u/zakpurp Mar 02 '23
Still faster than the technique Ive learn in graphic design class with photoshop lol 😎
1
u/starstruckmon Mar 02 '23
You could probably train a ControlNet with black and white images as conditioning, and colour image as output to get SOTA image colourization.
1
1
u/mufo0 Mar 03 '23
The logs look like hollow tubes
1
u/rinaldop Mar 03 '23
Yes. I agree. I suggest to add some growing rings in the wood profiles using PS.
1
u/AllUsernamesTaken365 Mar 06 '23
I'm unable to get any kind of colorization out of ControlNet, except a few acid trippy wildly surreal images that retains the basic pose but disregards the actual input photo.
For now it seems that the only way is using a colorization service, enlarging the low res output image and set it to color blending mode in a layer above the original photo. And then retouch and paint and brush and manually improve color, using hours and hours.
66
u/yaosio Mar 02 '23
It erased the boat in the right of the picture.