Stable Diffusion 3 in Daz AI Studio?
Stability AI released the API for Stable Diffusion 3.
I spent 10$ to purchase 1000 Credits from Stability AI to test it in ComfyUI.
Let's adress the elephant in the room:
prompt:
a photo of an elephant in a security control room,
holding a sign "SD3 for Daz AI?"
rim lighting, depth of field, cyberpunk,
###
Available information
As far as we know Daz AI Studio is based on SDXL.
Stable Diffusion 3 is an upgrade to the SD1.5 and SD2 base models.
Images can be generated at 1024x1024.
Different aspect ratios and upscaling is possible.
SD3 is advertised to be better with multi-subject prompts and spelling abilities.
From a technical point of view it should be possible to provide both SDXL and SD3 checkpoints in Daz AI Studio.
Nevertheless, training LoRA for different base models would take additional time.
###
Questions & Speculation:
Based on that three scenarios seem plausible:
A) Training with SDXL in Daz AI Studio has progressed too far to wait for SD3
B) It was known that SD3 will arrive. SDXL was used for some first tests. The actual training will continue with SD3.
C) Some LoRA will be released for SDXL. Later on there will be a switch to SD3.
###
My impressions:
multi-subject prompts
Using prompts to describe locations of objects in combination with specific colors seems to work better.
But there are still limits on that front with more complex prompts.
prompt:
a small blue cube on the left,
a white sphere in the middle,
a large red pyramid on the right,
on a desk, office, sunrise,
###
prompt:
photo of sports cars racing,
blue sports car on the left,
white sports car in the middle,
red sports car on the right,view from behind, new york city, yellow smoke, rain, at night, back-lit, depth of field,
spelling abilities
Spelling seems to work better for short text.
With longer text you need to reroll several times to get useful results.
prompt:
a wide shot of a gothic male android with a reflective face plate and a visor,
using a flame torch to cut through a metal door, floating sparks,
interior of a space station in the orbit of a noir planet,
metal sign "Under Construction",
ominous,
back-lit, rim light, depth of field,
###
close-up view of a security monitor,
a display showing an open window "Stable Diffusion 3, API test, sd3api.py, release date, Daz AI Studio, soon?, ",
in a security control room,
at night, rim lighting, depth of field, cyberpunk,
###
Did you test Stable Diffusion 3?
Do you think a version of Stable Diffusion 3 will be available for Daz AI Studio?
Comments
Not bad.
For how many images these 1000 credits lasts?
Stability AI is working with this pricing on its developer platform:
SD3 - 6.5 credits per successful generation of a 1 MP image
SDXL- 0.2 up to 0.6 credits per successful generation of a 1MP image
For SDXL the value depends on 1024x1024 resolution and variable steps.
Source:
Attached to this post. Screenshot made on Stability AI - Developer Platform 2024-04-20.
Unknown licensing terms for public version of SD3
The public release of SDXL was under a Stability AI CreativeML Open RAIL++-M License dated July 26, 2023.
A public release of SD3 is rumored to arrive at some point but its licensing terms remain unclear.
Daz Production Inc as a partner of Stability AI may have special conditions.
Ok, thank you very much for the information.
:According to a Twitter post last month, Stability AI's CTO and interim CEO wrote that the public release will be open-source:
https://twitter.com/thibaudz/status/1772204495167983909