Enhancing your renders with AI

chris-2599934chris-2599934 Posts: 1,804
edited October 16 in Art Studio

I've recently started using Krea AI to enhance my Daz renders. Like all AI image generators, it sometimes gets its hands and feet mangled, but it can also produce some pretty amazing results.

This isn't Daz AI. I think there's a fundamental flaw to Daz AI and other methods where a model is generated from Daz content (and/or real pictures), you say what you want in a sentence or two, then let the software do the work of assembling the scene. We're Daz hobbyists. We like "doing the work." That's the whole point - choosing your characters, placing them in a scene, choosing a camera angle. How is writing a sentence and getting a picture back any fun at all?

So, rant over, let me show you what I mean:

Here's the top-voted picture in my gallery. It's a re-creation of the painting Hylas and the Nymphs by John William Waterhouse (I'd link to the original but... let's just say the water level was lower in Waterhouse's day). It won a PC+ rendering competition and I'm quite proud of it:

Now let's see what it looks like when AI gets its hands on it:

That's still my (and Waterhouse's) image, but it's a much improved version. The hair, the skin, the water, all are massively improved. It's a shame it's lost the mistiness in the background, and it's malformed Hylas' left hand and the pitcher he's carrying. The text prompt for this (auto-generated from the picture) was "The image portrays a scene from a fairy tale, where a man is seen talking to a group of girls in a pond" - I might re-instate the mist by specifying it ni the prompt, but I don't think it makes a lot of difference - it's the source picture that's doing most of the work.

In a minute I'll post another picture, and tell you how you can try this out on your own images. 

PS. I've just tried enhancing Waterhouse's original painting the same way, and the result is pretty good. I'd share it here but, well, water levels...

hylas-enhanced.png
2048 x 1264 - 4M
Post edited by chris-2599934 on

Comments

  • chris-2599934chris-2599934 Posts: 1,804
    edited October 16

    Here's another render to play with. This picture was an entry in the Freebies competition when the theme was "April Showers." The girl's called April, geddit?

    This is made entirely with free content, so the quality's not what it might be, but that gives the AI more of a challenge. I did cheat slightly - the clouds of steam that I added to the original render confused the AI a bit, so I AI-ed the original render without the steam layer, then put the steam back on. Anyhow, here's how she looks:

    aprilns-enhanced.png
    1200 x 1600 - 3M
    Post edited by chris-2599934 on
  • chris-2599934chris-2599934 Posts: 1,804

    So how can you try this on your own renders?

    • Create a free account at Krea, and go to their Enhance page. For each image...
    • Upload the image file as prompted
    • On the right hand side, change the resizing from 2x to 1x - you only get a certain amount of computing power every day, and resizing images when you don't need to means you can't do so many images.
    • Click the down arrow next to where it says "Upscaling" and correct the prompt it's generated from your image. I'm not sure how much difference this really makes, but it's fun to see how it sometimes misinterprets your images.
    • You can also adjust the Strength, Resemblance and Clarity sliders to control the process - I just leave these at default values.
    • Click "Enhance" to set the process running, it takes a few seconds
    • Right-click your image to download it

    I really think this could be the basis of a genuine "Daz AI" in the future - build your scene, render it big (because the bigger the image, the less prone it seems to be to AI hand mangling) but don't wait for it to reach 100% convergence - it only has to look reasonably ok, it doesn't matter if it's a bit grainy. Then apply the (built-in) AI enhancement and you're done. Like the de-noiser, but so much better.

  • GordigGordig Posts: 10,030

    I'll be honest: I don't really think the AI-enhanced versions are an improvement. The skin and faces look more realistic, but your Hylas render is more dynamic, and the AI not only didn't fix the things about the shower render that were actually wrong, but added a whole lot of distortion.

  • barbultbarbult Posts: 24,223

    Gordig said:

    I'll be honest: I don't really think the AI-enhanced versions are an improvement. The skin and faces look more realistic, but your Hylas render is more dynamic, and the AI not only didn't fix the things about the shower render that were actually wrong, but added a whole lot of distortion.

    The shower woman's face looks better, I agree, but all the steam is gone and the rubber duck looks melted. I've had similar mixed results with Krea Enhance. It is fun to play with, but results are mixed.

  • MimicMollyMimicMolly Posts: 2,186

    The only enhancement my Iray renders need is grain removal. (My PC is old and weak, that's why.) Anything else, I mostly feel confident enough to manually edit it in. But I'm also not adverse to experimenting with AI and even combining the best parts of the original and AI. I may try Krea later.

    Besides the body part mangling, which includes the pupils, another aspect I dislike about AI is the blank, non-existent expressions the AI humans have. It's apparent in your Hylas render. Your original one has such lively faces, but the second one they seem like they've been scolded/reduced to silence. Then in the April Shower ones, April appears genuinely surprised in the original. But in the AI, it is now a dull surprise.

    For a while, I had been editing my own DAZ faces onto AI because the original AI face wasn't expensive enough.

  • MimicMollyMimicMolly Posts: 2,186
    edited October 19

    Okay, so I tried it. (Thanks for the mention, BTW.) Decided to test how well it would do with badly edited backgrounds. So the original is my render overlaid on a square AI background. I quickly painted over stuff to make it a rectangle. Next to it is Krea's attempt to enhance/correct my manual butchering. I'm impressed with the results, but not particularly pleased that it changed my character's face and even took away his sly grin. (The character is supposed to look a bit like the Joker, but the AI enhancement doesn't.)

    I plan to further combine the two.

    GiacPrototype.jpg
    1400 x 1024 - 457K
    Post edited by MimicMolly on
  • 3Diva3Diva Posts: 11,395
    edited October 20

    @chris-2599934 The nymphs one came out SO COOL! I really like the outcome of that!

    @MimicMolly The AI enhancement looks good -but you're right, the looks of the guy changed a lot. He looked slightly "villainous" in the render and the enhanced version he looks a lot more "sweet". lol :) I did like how it turned out though! Handsome fellow! 

    Post edited by 3Diva on
Sign In or Register to comment.