"A family of settlers, admiring a herd of bison, breaks into a run as two demonic winged creatures fly overhead. The little girl passes through a fencepost like a ghost. This surreal five-second scene was created thanks to a new feature within AI platform Runway called Motion Sketch. As the name suggests, it generates videos from simple doodles that you can make directly on top of a still image."
"In the case of the clip below, I started by generating an image using Google's Nano Banana Pro -- one of the text-to-image models offered through Runway's platform -- then simply drew a smattering of bird-like shapes and two arrows pointing the direction in which the family and the bison should flee. I added some text prompts for a little extra guidance, and the model did the rest."
Runway's Motion Sketch generates video from simple doodles drawn directly on top of still images. Users can combine text-to-image models such as Google's Nano Banana Pro with hand-drawn arrows and shapes to indicate motion and direction. The system accepts text prompts for added guidance and synthesizes short animated clips from those inputs. Results can be surreal and expressive but often require iterative refinement and careful sketching to achieve precise movements. Motion Sketch aims to help visually oriented creators translate sketches into motion without crafting complex written prompts. Access to Motion Sketch requires at least a Standard Runway subscription.
Read at ZDNET
Unable to calculate read time
Collection
[
|
...
]