Looks as if the #StableDiffusion image generation on the #Swift side of the fence for #macOS has been progressing faster than I thought 🙂

It feels as if it’s been barely any time since I last took a look but there are a lot more #CoreML StableDiffusion models out there now and a lot more GUIs too. I took a look at a few, combined features from a few, added my own features too and came up with something which lets me maintain my image gallery and to generate new images too.

Given that on my 32GB M1 MBP it takes about 13 seconds to generate an image at 20 steps (except for the first time) it is pretty fast too. At least, fast enough for my needs 🙂

So it looks as if I’m back to messing with StableDiffusion on Swift rather than #Python, at least for the time being …
Showing a GUI for StableDiffusi…

@f The biggest shortcoming I have seen with CoreML is conversion of models fails often. Not sure how interested in solving that problem apple or the community is.

@trode From what I can tell based on my very limited research, it doesn’t look as if they are very interested at all. I tried several conversions the Apple way (or using other approaches based on the same approach) and all of them failed for me.

I then found the Guernika Converter (https://huggingface.co/Guernika/CoreMLStableDiffusion) and that actually worked correctly … for some models. Some would convert but didn’t work correctly with (at least) my Swift code.

But it is slightly better overall than anything else I’d tried before.

@f Gurnika is nice! I was able to get apples tool setup on my system and had very similar results on Gurnika & the apple tools. Gurnika was way easier to setup tho!

@trode I’m sorry it didn’t work for you. I had major issues with the Apple code and was going to spend the weekend breaking it down and re-working it to see why it failed. Guernika saved me all that … but then I realized that even that didn’t do what I wanted since I wanted an EINSUM compiled version of Dreamlike Diffusion but apparently the EINSUM version doesn’t work on macOS … I don’t know why but I saw a note to that effect on HuggingFace.

Ah, well 🙂

@f Yep, same. Thanks for your posts on web clients I'll be trying a couple of those when I find the time!

@trode Have fun and if you wanna talk about any of this stuff, I’m always around — I don’t like larger communities and so don’t frequent Discord etc. but do miss the shop-talk 😛

At the moment the one I like the most out of the web clients is InvokeAI but there are a lot of nice web clients around. Apparently there’s also a bunch of native macOS clients but they seem to be not so well-known, at least in the circles where I read stuff …