"A family of settlers, admiring a herd of bison, breaks into a run as two demonic winged creatures fly overhead. The little girl passes through a fencepost like a ghost. This surreal five-second scene was created thanks to a new feature within AI platform Runway called Motion Sketch. As the name suggests, it generates videos from simple doodles that you can make directly on top of a still image."
"In the case of the clip below, I started by generating an image using Google's Nano Banana Pro -- one of the text-to-image models offered through Runway's platform -- then simply drew a smattering of bird-like shapes and two arrows pointing the direction in which the family and the bison should flee. I added some text prompts for a little extra guidance, and the model did the rest."
Motion Sketch in Runway converts simple doodles drawn atop a still image into short animated video clips. Users can draw motion cues such as arrows and bird-like shapes and add text prompts to guide movement directions. The feature can turn a generated image into a surreal five-second scene, animating characters and environmental elements. Motion Sketch performs best with careful guidance and iterative prompts, similar to how generative text models require prompt engineering. Nano Banana Pro on the platform can generate base images from text or from doodles. Access to Motion Sketch requires at least a Standard Runway subscription. Creative professionals benefit from visual-first control over motion.
Read at ZDNET
Unable to calculate read time
Collection
[
|
...
]