With facial recognition technology, AI algorithms can recognize the key characters and sort certain scenes for human editors.

The experimental project is called Salt (Opens in a new window), and it’s built entirely with AI-generated art. To create the visuals, Stelzer has been tapping publicly available programs such as Midjourney, Stable Diffusion, and DALL-E 2, which can essentially draw anything you want by relying on a mere text description from the user. On Twitter, Stelzer has been releasing Salt in short clips, called “story seeds.” As you can see, the film project is a bit like watching a Ken Burns’ documentary revolving around still images. That’s because AI-generated art can’t render moving pictures, at least not yet. Nevertheless, Stelzer can create the feeling of motion through video editing and even some deepfake programs, which can make the characters’ faces move. All the voices in the film—including the female ones—also come from Stelzer, who’s been using an AI voice generator called Murf (Opens in a new window) to create them.

“It’s all AI, except for one voice, which is… mine,” Stelzer told PCMag via Twitter.

Artificial intelligence in filmmaking

Artificial intelligence in filmmaking might sound futuristic, but we have reached this place. Technology is already making a significant impact on film production.

Today, most of the outperforming movies that come under the visual effects category are using machine learning and AI for filmmaking. Significant pictures like ‘The Irishman’ and ‘Avengers: Endgame’ are no different.

It won’t be a wonder if the next movie you watch is written by AI, performed by robots, and animated and rendered by a deep learning algorithm.

But why do we need artificial intelligence in filmmaking? In the fast-moving world, everything has relied on technology. Integrating artificial intelligence and subsequent technologies in film production will help create movies faster and obtain more income. Besides, employing technology will also ease almost every task in the film industry.

Applications of AI in film production

Writing scripts

‘Artificial intelligence writes a story is what happens here. Humans can imagine and script amazing stories, but they can’t assure that they will perform well in theatres. Fortunately, AI can. Machine learning algorithms are fed with large amounts of movie data, which analyses them and comes up with unique scripts that the audience love.

Simplifying pre-production

Pre-production is an important but stressful task. However, AI can help streamline the process involved in pre-production. AI can plan schedules according to actors and others’ timing, and find apt locations that will go well with the storyline.

Character making

Graphics and visual effects never fail to steal people’s hearts. Digital domain applied machine learning technologies are used to design amazing fictional characters like Thanos of Avengers: Infinity War.

Subtitle creation

Global media publishing companies have to make their content suitable for viewers from different regions to consume. To deliver video content with multiple language subtitles, production houses can use AI-based technologies like Natural language generation and natural language processing.

Movie Promotion

To confirm that the movie is a box-office success, AI can be leveraged in the promotion process. AI algorithm can be used to evaluate the viewer base, the excitement surrounding the movie, and the popularity of the actors around the world.

Movie editing

In editing feature-length movies, AI supports film editors. With facial recognition technology, AI algorithms can recognize the key characters and sort certain scenes for human editors. By getting the first draft done quickly, editors can focus on scenes featuring the main plot of the script.