SDXL SiFi Movie Knowledge

Today I found myself a little bit bored for about a second and typed 'Star Wars' into Stable Diffusion XL just to see what would happen. The model I was using seemed to have some reference training on the movie Star Wars as the image produced was clearly trained on the franchise. So, I decided to give a few movies a try. I know this is a truly pointless exercise, but sometimes that is okay. Here are some of the results.

For this setup I am using my primary development server (R9 7590X 128GB DDR5, RTX3060 12GB). I am using the model CNCXL v 1.0. To interface with Stable Diffusion I am running Automatic1111's WebUI in a docker container.

The prompt is formatted as "Still movie frame of {{Name of Movie}}, 35mm film, dark theme". The sampler/solver is DPM 3++ SDE Exponential. Resolution is 1024x576. CFG Scale is 3- 7. No negative prompt or refiner. And I am running 2 batches of 2 images each time.

Honestly, I am pretty impressed. For current open source AI the logo is very good. The characters are well represented, and the theme is spot on.

Again, the model certainly seems to understand what I am referencing. It follows the theme very well. I can hear the quietness of the film looking at these images.

I'm not as familiar with this movie. I think it got the theme right. Not so sure about the helicopter or other subjects.

As expected the prompt 'Alien' is too generic, even with the word movie contained in the prompt. Interestingly, there is some theming of these aliens that is clearly being pulled from the franchise.

This prompt seemed to help a bit. But still would need some work. Not very impressed.

Seems to have been trained on this franchise as well. As expected it isn't very specific with the glyphs. We also see a bit of merging between the 35mm film and the subject in the last one.

I was more specific with this prompt. The results are certainly not horrible. Not exactly true to form, but got the theme spot on.

I mean, this isn't the worst thing ever, but I'm not very impressed. I have a feeling the franchise is in the training, but pulling out the correct vector seems to need some prompt engineering.

It obviously has been trained on this movie. Nothing is quite accurate but kind of close. And once again it got the logo correct.

I don't know how accurate this is. But I do love these images. The retro vibe is amazing.

Clearly, ET is not quite right here. But he does look amazing, just off. I don't know why I like these so much. But I have to be honest that they are just not accurate at all.

This is a case of right movie wrong actors. Kind of interesting honestly. I don't have to much to say here as it just isn't very interesting.

This one kind of just is what it is for me. It obviously knows what I am talking about. However, the images just are not very good. I am not quite sure who's face that is, and the ships are just messed up.

This one seems a bit confused, 1950s? 1970s? And I don't know what is wrong with the creature but it is just... well...