eWEEK content material and product suggestions are editorially impartial. We might generate income whenever you click on on hyperlinks to our companions. Learn More.
AI video startup Runway has introduced a brand new, extra superior AI video technology mannequin, which the corporate is looking Gen-4. With this mannequin, Runway hopes to unravel a number of of essentially the most tough challenges that plague AI video technology. The firm’s announcement describes its Gen-Four mannequin as “a new generation of consistent and controllable media.”
Addressing challenges in AI video technology
One of the chief difficulties that the brand new mannequin seeks to beat is the dream-like, usually incoherent nature of AI-generated movies. Current fashions battle to take care of constant characters and objects throughout frames, so their look usually modifications drastically relying on the atmosphere and lighting situations.
Runway has launched a number of examples of movies to reveal how the Gen-Four AI mannequin can resolve these points. For occasion, one in every of these movies confirmed the identical statue in several places, and the thing appeared constant regardless of the modifications in digital camera angles and lighting situations. This stage of spatial consistency — together with the flexibility to render a number of angles of the identical scene — is a brand new capacity unique to Gen-4. Earlier variations, Gen-2 and Gen-3, lacked this performance.
“With Gen-4, you are now able to precisely generate consistent characters, locations and objects across scenes,” says the brand new mannequin’s touchdown web page. “Simply set your look and feel and the model will maintain coherent world environments while preserving the distinctive style, mood and cinematographic elements of each frame. Then, regenerate those elements from multiple perspectives and positions within your scenes.”
The new AI technology software is rolling out to paid Runway customers in phases beginning on Monday. Paid customers who don’t presently see that Gen-Four choice of their account ought to examine again later.
Runaway carves out niches AI video technology
Runway will not be a family identify like different main AI firms, akin to OpenAI, which have huge quantities of funding to spend on each improvement and advertising and marketing. However, Runway is carving out an area for itself as a quality-first AI video generator that appeals to filmmakers, designers, and different creators.
Notably, Runway was among the many first firms to launch a workable AI video technology software for public use, again in early 2023. Subsequent variations have been employed in real-world artistic initiatives, albeit in a restricted means. Both The Late Show with Stephen Colbert and the movie Everything Everywhere All at Once have used the AI software to generate animation sequences. Viewers may even see extra visuals created with Runway AI now that the brand new mannequin has launched.
