HOW TO CREATE MUSIC VIDEOS WITH AI

Explore the synergy of ChatGPT, Midjourney and Videobolt to craft custom AI-generated video backgrounds and bring your music to life.

AI gives you the power to generate pretty much any image. Combine that with our music visualizer LoFi Anime Girl and you get a chill music video with an anime character that is automatically shaded to fit the background.

Overview

The basic outline of what we'll do is:

  • Ask ChatGPT to create a prompt for Midjourney,
  • Use Midjourney to generate backgrounds based on that prompt,
  • Import that background into LoFi Anime Girl,
  • Enjoy some chill tunes.

The whole process will take 10 minutes at most, even if you've never used any AI tools. We decided to use ChatGPT and Midjourney, but there are many other AI generators to try out.

1. Generate a prompt for Midjourney with ChatGPT

Looking to optimize your AI image generator results? A helpful strategy is to leverage ChatGPT to create the perfect prompt for Midjourney. Conveniently, you can do this right from the widget below.

Simply input your preferred style and environment, then hit the 'Copy prompt' button. Once you've got your prompt, jump over to ChatGPT, paste it in, and wait for your response. Don't forget to copy this response — it's your golden ticket!

This approach works particularly well for anime-style visuals, though if you're interested in more realistic imagery, make sure to explore our separate prompt for that as well.

Act as a stable diffusion photography prompt generator that accepts a visual description and outputs a detailed paragraph of 100 words that I can copy into my diffusion model. Always start the prompt with "/imagine prompt:" and end with “—ar 16:9”. Include a variety of anime related terminology including the description of the Akira style and most importantly a description of the drawing style. Now give me a clear and concise natural language visual description of the following: ruined futuristic park street
Copy prompt

2. Generate a background

Now that you have the prompt, we should go over to Midjourney to generate the image. The process is similar to our last step:

  • Log-in to Midjourney Discord Server;
  • Enter any of the newbies channels;
  • Paste the prompt;
  • Download (or refine) one of the generated images.

Midjourney put together a detailed visual Quick Start Guide, so be sure to check it out if you're stuck at any point.

The image generated by Midjourney based on my prompt

3. Import background and adjust visualizer

Everything is now ready to create our music video. I'll use the track "Ice Flow" by Kevin MacLeod (incompetech.com | Licensed under Creative Commons: By Attribution 4.0 License).

It’s just a few steps:

  • Import song into the track placeholder
  • Import the generated image as the background placeholder
  • Set Environment dropdown to Custom to display custom background
  • Adjust character position, rotation and intensity of color correction
  • Render the video and enjoy
Something went wrong
Details: VIDEO_ERROR (3016)
import ai background with zooms - Poster image

In order to import your assets click the placeholder in the sidebar and select an upload option. Once your media is in place, switch over to the Customization tab. In order to display your custom background, set the Environment dropdown to Custom. If you wish to change the position or rotation of the character, change the Position and Flip controls. If you wish to control how much color from the background image is transferred onto the character, you can adjust the Strength slider.

My final settings are: Position = Left, Flip = On, Strength = 20. Here is a before and after:

Something went wrong
Details: VIDEO_ERROR (3016)
lofi anime girl viz midjourney background before after fixed - Poster image

And just like that, with some clicks and a few minutes you can create a very satisfying lo-fi style music video that music listeners on YouTube are bound to enjoy. We’d love to see the videos you make, so shoutout @videoboltnet on Twitter and Instagram.

Watch this space for more news, roundups and guides. Have a great day and see you soon.

Avatar
Published on Apr 27, 2023 by
Petar Drndarević
Big lover of film and music. Long time Videobolt power user, copywriter and support provider.
Overview
Generate a Midjourney prompt
Generate a background
Import background
Adjust visualizer
Conclusion

Explore Music Visualizers

Enter the world of music visualization with 700+ easily customizable templates.

Make Music Videos