Stability AI released Stable Animation SDK, a text-to-animation tool for developers. It allows you to create animations with prompts, a source image, or a source video. Users will also get access to Stable Diffusion models, including Stable Diffusion 2.0 and Stable Diffusion XL.
There are three ways to create animations:
> Text to animation: Users input a text prompt (as with Stable Diffusion) and tweak various parameters to produce an animation.
> Text input + initial image input: Users provide an initial image that acts as the starting point of their animation. A text prompt is used in conjunction with the image to produce the final output animation.
> Input video + text input: Users provide an initial video to base their animation on. By tweaking various parameters, they arrive at a final output animation that is additionally guided by a text prompt.