With every shot requiring a brand new set of prompts, it’s additionally exhausting to instill a way of continuity all through a video. The colour, angle of the solar, and shapes of buildings are tough for a video technology mannequin to maintain constant. The video additionally lacks any close-ups of individuals, which Kahn says AI fashions nonetheless are inclined to battle with.
“These applied sciences are all the time higher on large-scale issues proper now versus actually nuanced human interplay,” he says. Because of this, Kahn imagines that early filmmaking functions of generative video could be for large photographs of landscapes or crowds.
Alex Mashrabov, an AI video skilled who left his function as director of generative AI at Snap final 12 months to discovered a brand new AI video firm referred to as Higgsfield AI, agrees on the present failures and flaws of AI video. He additionally factors out that good dialogue-heavy content material is difficult to provide with AI, because it tends to hinge upon refined facial expressions and physique language.
Some content material creators could also be reluctant to undertake generative video merely due to the period of time required to immediate the fashions repeatedly to get the tip consequence proper.