This week Midjourney's team announced the moving of Midjourney AI to V4 as its default version. Two points: V3 is still available, of course, and V4 is still in Alpha. Aren't you excited and slightly scared of what it will be when it's out of Beta? O___o

anime girl wearing intricate fish mask by Tim Walker --v 4

Chernobog by Erik Madigan Heck --v 4

urban ninja in Fairy Kei style by Nick Knight --v 4

Anyways, V4 is here to stay, and it's beautiful! Its knowledge of artists' styles is outstanding. Still, it can be challenging. And among other issues (hands are improving, by the way!), there is one with how Midjourney V4 applies style modifiers to different prompts.

STYLE MODIFIERS VS. PROMPTS

What are the most common ways to apply a style modifier to a prompt? I've seen people add an artist's name separated by a period. Others use artwork by or in style of. I myself use by all the time. It's minimal, general, and works! Well, not always—like many others, too. But after many fights, I seem to have found my ultimate prompt strategy.

Today we'll talk about how to add the great Director of Photography Roger Deakins' name to a prompt out of his "artistic scope," and take his cinematic style...

...from this...

...to this.

In other words, here are some thoughts and observations on how to direct, nudge and whisper Midjourney to make any style work with virtually any prompt.

TL:DR

Spoiler: ARTISTS LOVE PERSONIFICATION! :) The recipe is incredibly simple—to personalize the prompt, so it becomes more about the style that we are using. Let's start with a benchmark.

NAZGULS AND PEONIES

As I mentioned in the post about Stylize, we use a benchmark for our daily Instagram posts. We test styles against a set of nine standardized prompts to which we add the artist's name or technique. The test lets us see how a particular style modifier works—on a pre-set scale.

cyberpunk character by [artist] --v 4

Nazgul over sleeping town by [artist] --v 4

Image Prompt by [artist] --v 4

Some of the styles we spotlight work well with most prompts, but not all of them. Some names will return excellent results with 6-7 prompts out of 9. But some prompts are more challenging than others! In this research, I will use the toughest four to illustrate my strategy.

And, for some reason, on the top of that list is the cutest of them all!

CUTE MAINECOON CAT

When a style fails, the test will return a generic picture of a cute Mainecoon cat—not even near the original style. Here are three cute felines to show how it happens.

cute Mainecoon cat by Erwin Wurm --v 4

cute Mainecoon cat by Larry Poons --v 4

cute Mainecoon cat by Peter Saville --v 4

To emphasise the dramatic difference, here are the initial Midjourney styles of our artists.

by Erwin Wurm --v 4

by Larry Poons --v 4

by Peter Saville --v 4

Let's modify the initial prompt to make it blend better with the target styles. Erwin Wurm is a sculptor and installation artist, Larry Poons is an abstract painter, and Peter Saville is a graphic designer. So...

Erwin Wurms installation depicting cute Mainecoon cat --v 4

Larry Poons’ painting of cute Mainecoon cat --v 4

Peter Saville's graphic design depicting cute Mainecoon cat --v 4

Can you get away with artwork by? Yes, but there is a decent chance of missing.

Let's test it with the name of the Mexican painter José Clemente Orozco known for his bold, social realist style and his depiction of the struggles of the working class. His initial cute Mainecoon cat was nothing like Orozco's style.

by Jose Clemente Orozco --v 4

cute Mainecoon cat by Jose Clemente Orozco --v 4

And this is what happened when I tried artwork by against the "artwork by + depicting" formula against an artist-specific prompt.

cute Mainecoon cat. Artwork by Jose Clemente Orozco --v 4

artwork by Jose Clemente Orozco depicting cute Mainecoon cat --v 4

Jose Clemente Orozcos painting depicting cute Mainecoon cat --v 4

Knowing this, can we start with a simple prompt and then remix the cuteMainecoon cat back in? I tested it with the style of the legendary Soviet movie director Sergei Parajanov. The baseline prompt cat was very cute, but didn't even remind the maitre's Midjourney style.

by Sergei Parajanov --v 4 →

cute Mainecoon cat by Sergei Parajanov --v 4

A simple cat prompt, on the contrary, brought magnificent result! But then remixing it...

[ORIGINAL PROMPT]
cat by Sergei Parajanov --v 4 →

[REMIX]
→ cute Mainecoon cat by Sergei Parajanov --v 4

However, what worked much better was the artist-specific prompt strategy.

...we-ell, it kinda worked. ┐(ﾟ～ﾟ )┌

movie still from Sergei Parajanovs film with cute mainecoon cat as main hero --v 4

movie still from Sergei Parajanovs film with cute mainecoon cat as main hero --no people --v 4

CYBERPUNK CHARACTER

Another challenging test prompt from our benchmark is cyberpunk character.

For many artists, generations with this prompt will be non-specific cyberpunk pictures, only slightly inheriting from the initial style. It's difficult to believe that these three images were generated with different artists in prompts.

cyberpunk character by Carlo Crivelli --v 4

cyberpunk character by William Morris --v 4

cyberpunk character by Anton Corbijn --v 4

Quite the gap with the initial styles, right?

by Carlo Crivelli --v 4

by William Morris --v 4

by Anton Corbijn--v 4

Let's fix that. Carlo Crivelli was an Italian Renaissance painter star. William Morris of Great Britain was, among other things, a famous textile designer. And Dutch Anton Corbijn is a living classic of portrait photography, especially recognized for his bold and contrasty black-and-white style.

Et voila!

Carlo Crivelli's painting depicting cyberpunk character --v 4

William Morris' fabric pattern with cyberpunk character as main theme --v 4

Anton Corbijn's classical photograph of cyberpunk character --v 4

Much better.

Meet another Mexican painter—grand master Rufino Tamayo, acclaimed for his abstract, colorful paintings inspired by pre-Columbian and Mexican folk art. His cyberpunk character seems to inherit from him the color pallet, geometrical shapes, and structure of the masks. But it's not very close to the original style.

by Rufino Tamayo --v 4

cyberpunk character by Rufino Tamayo --v 4

To put a spell of Tamayo's magical style onto our cyberpunk character, I, again, added a more artist-specific context to the initial prompt.

Rufino Tamayo's painting of cyberpunk character --v 4

Rufino Tamayo's painting of cyberpunk character --v 4

Rufino Tamayo's painting of cyberpunk character --v 4

I ran this test with with the Japanese fashion icon Yohji Yamamoto. The prompt cyberpunk character by Yohji Yamamoto didn't return a single specific result.

by Yohji Yamamoto --v 4

cyberpunk character by Yohji Yamamoto --v 4

But then adding details made it pop.

Yohji Yamamoto's street fashion photoshoot with Japanese haute couture cyberpunk character --v 4

Yohji Yamamoto's high fashion dress for cyberpunk character --v 4

Yohji Yamamoto's costume for cyberpunk character --v 4

Let's get back to Erwin Wurm and look at his cyberpunk characters. First—at the basic by Erwin Wurm against his "clean" style...

by Erwin Wurm --v 4

cyberpunk character by Erwin Wurm --v 4

...and then—at the fantastic results of the more artist-specific prompts.

Erwin Wurm's sculpture piece depicting cyberpunk character --v 4

Erwin Wurm's sculpture piece depicting cyberpunk character --v 4

Erwin Wurm's sculpture piece depicting cyberpunk character --v 4

I also used Wurm's name to check how artwork by works. The basic result was a miss. Interestingly enough, it got better when I used the depicting formula. However, it was not even close to what a contextual prompt did to the artist's style.

cyberpunk character. Artwork by Erwin Wurm --v 4

Erwin Wurm’s artwork depicting cyberpunk character --v 4

Erwin Wurm's sculpture piece depicting cyberpunk character --v 4

TECH GENIUS TEENAGE GIRL

This prompt is a dedication to my friend's daughter, who has just become a teenager and is already a marvel of electronics and engineering. Is this a problematic prompt? I'd say, it's not for nothing she's on the list of The Hardest Prompts. :)

by Dziga Vertov --v 4

tech genius teenage girl by Dziga Vertov --v 4

Dziga Vertov was a Soviet pioneer documentary film and newsreel director, as well as a cinema theorist. How Midjourney treats Vertov's style in the sample above? Ignores it! Can we make it respect the great avant-garde cinemeatographer? Yes!

tech genius teenage girl. Still frame from documentary film by Dziga Vertov --v 4

tech genius teenage girl. Still frame from documentary film by Dziga Vertov --v 4

tech genius teenage girl. Still frame from documentary film by Dziga Vertov --v 4

How about a genre? Say, Naive art. The default result is 100% generic.

Naive art --v 4

tech genius teenage girl. Naive art --v 4

But what if we add details to the initial style and reformat the prompt a bit?

tech genius teenage girl. Naive art drawing --v 4

Naive art illustration depicting tech genius teenage girl --v 4

tech genius teenage girl. Naive art contemporary illustration --v 4

Finally, let's take our tech genius to a high concept fashion world with the American fashion photographer Steven Klein, famous for his bold and provocative style. Which doesn't show that much in the by generation (although it's good).

by Steven Klein --v 4

tech genius teenage girl by Steven Klein --v 4

However, if we spice the prompt with specificity...

Steven Klein's high concept photoshoot with tech genius teenage girl --v 4

Steven Klein's high concept photoshoot with tech genius teenage girl --v 4

Steven Klein's high concept photoshoot with tech genius teenage girl --v 4

NAZGUL OVER SLEEPING TOWN

I added Nazgul over sleeping town to our benchmark to honour my favorite book as a kid—John R.R. Tolkien's Lord Of The Rings.

Let's give this prompt to another iconic fashion designer, Pierre Cardin. You might expect the results to be high-fashion, elegant and fanciful. But no, the outcome is a pretty generic fantasy image.

by Pierre Cardin --v 4

Nazgul over sleeping town by Pierre Cardin --v 4

How can we change that? Let's add context to the prompt.

Pierre Cardin's high fashion film about Nazgul over sleeping town --v 4

Fashion photoshoot for Pierre Cardin's costume of​ Nazgul over sleeping town --v 4

Pierre Cardin's costume of Nazgul over sleeping town --v 4

Let's try something more peculiar. Laure Provoust is a French multimedia artist known for her immersive films and mixed-media installations. Her initial Nazgul was quite similar to many others.

by Laure Prouvost --v 4

Nazgul over sleeping town by Laure Provoust --v 4

But then I added context and got some of the most unique Nazguls among all benchmarks!

Nazgul over sleeping town as collage by Laure Prouvost --v 4

Laure Prouvost's multimedia installation depicting Nazgul over sleeping town --v 4

Nazgul over sleeping town as sculpture by Laure Prouvost --v 4

And for the last example, let's invite the world famous American photographer Annie Leibovitz to tell her version of the Tolkien's story. The baseline generation is very much alike with dozens of others. Until we add...

by Annie Leibovitz --v 4

Nazgul over sleeping town by Annie Leiboivtz --v 4

...you guessed it—artist-specific context! And let's be creative here.

Nazgul over sleeping town as movie poster by Annie Leibovitz --v 4

Annie Leibovitz's high-concept portrait photoshoot of Nazgul over sleeping town --v 4

Annie Leibovitzs studio photoshoot with Nazgul over sleeping town as main theme

DECAYING PEONIES

Another diehard prompt from our benchmark—decaying peonies.

In this case, I gave it to American fashion photographer Bert Stern. With the initial prompt, peonies inherited from the initial style an overall photo studio look.

by Bert Stern --v 4

decaying peonies by Bert Stern --v 4

Still, I doubt this is how the renowned fashion photographer would have shot decaying peonies. So I asked Midjourney specifically.

photoshoot by Bert Stern with the theme of decaying peonies as main theme --v 4

Bert Stern's fashion photoshoot with decaying peonies as main theme --v 4

Bert Stern's fashion photoshoot with decaying peonies as main theme --v 4

Definitely a much better re-imagination of the great artist's style.

Another great example is the American comic book artist Bill Sienkiewicz, known for his work on Marvel's Moon Knight, New Mutants, and Elektra. Here is how Midjourney applies his style with the basic by prompt. You can see it trying to visualize the flowers with Sienkiewicz's signature brushstrokes and paint drops, but... it stops long before reaching its goal.

by Bill Sienkiewicz --v 4

decaying peonies by Bill Sienkiewicz --v 4

Artist-specific prompts are here to save the day! I especially love the character-centered ones, but just the flower is outstanding, too.

Bill Sienkiewicz's comic strip drawing depicting decaying peonies --v 4

Bill Sienkiewicz's comic book illustration depicting decaying peonies --v 4

Bill Sienkiewicz's comic book drawing depicting decaying peonies --v 4

Bill Sienkiewicz's comic strip about decaying peonies --v 4

For today's last case, I want to return to Peter Saville's style—and Remix mode.

Saville's name with the baseline prompt didn't affect the peonies at all.

by Peter Saville --v 4

decaying peonies by Peter Saville --v 4

The artist-specific context gave a much better—design-y—result. But still, it was far from something you would expect from a famed designer and art-director. ( ๑σᆽσ) However, simplifiying the prompt through Remix was very fruitful.

[ORIGINAL PROMPT]
Peter Saville's graphic design poster depicting decaying peonies --v 4 →

[REMIX]
→ Peter Saville's graphic design poster --v 4

[REMIX]
→ Peter Saville's graphic design poster --v 4

[REMIX]
→ Peter Saville's graphic design poster --v 4

CONCLUSION

With Remix mode or not, adding artist-related context dramatically improves how a style applies to a prompt.

On Midjourney's Community Feed, I see a lot of prompts where people put artists' names in rows of five and even ten—without giving them a thought.

I stand for a different approach—Midjourney to me is a way to educate myself about artists, art history, genres, movements. Among other things, because knowing whose name you are using may greatly help in getting great results from Midjourney.

Happy midjourneys,
— Andrei

P.S. What's your favorite strategy to apply styles to image prompt? Did I miss something? You have a hint or a technique you want to share? Drop me a note via the form below or DM on Instagram →

BONUS TRACK

Today, people mostly know Leon Bakst by his amazing paintings and illustrations, but a lot of these arts were done for his theatrical work: costume- and set-design. So what if we ask Leon Bakst to design a movie set?

Let's use the Leon Bakst's set-design for [title] movie --v 4 and see how Bakst's style will deal with some of the biggest block-busters of all time.

Alien

Nightmare On Elm Street

Dr. Strange

Terminator

Lord Of The Rings

Star Wars

P.P.S. Will we continue testing styles with by prompt? Yes, because it's general and easy, and a great baseline. And if a simple by [style] refuses to affect your generations, you now know what to do!

P.P.P.S. I am doing a separate post on style modifiers for Image Prompts and how to meddle with your own portraits to make the most out of Midjourney's face recognition superpower. ;)