Flux, LoRAs, and comicbook experiments

Flux makes image generation easier to prompt, and the community's new LoRAs are already pushing it into playful new directions.

Published: Thursday, September 5th 2024

1 min (193 words)

ajfisher - gemini / Black Forest Labs

At the start of August, Black Forest Labs launched Flux - a new image generation model. Playing with it for the last few weeks, it’s pretty great - especially if you can run it locally for maximum tweakability. Being able to prompt without a lot of arcane directions (eg high definition, 8K, good hands, masterpiece, high quality etc) and get a good result means much faster iteration and more experimentation. Both of which are critical for pushing boundaries and tool adoption.

Now we’re a month in, we’re starting to get fine tuned models (LoRAs - Low Rank Adapters) from the community that allow you to force the generated images in a particular direction beyond what the text prompt will do naturally.

So for example, you can take a LoRA trained on porcelain objects and apply it to pop culture heroes. These were quick to produce and without any clean up - which speaks to how impressive Flux is as a step up from the original Stable Diffusion and newer SDXL models.

Spiderman

Spidergirl

Hulk

Deadpool

Ironman

Black Panther

The next few months are going to be interesting, as the full weight of community creators starts experimenting with these new image generation capabilities.