Dreamix - Applying Video Diffusion Models as General Video Editors (AI-fused Video Editing)

Dreamix: Video Diffusion Models are General Video Editors Dreamix can create videos based on image and text inputs. In this example it is able to instill complex motion in a static image, adding a moving shark and making the turtle swim. In this case, visual fidelity to object location and background was preserved but the turtle direction was flipped. Given a small collection of images showing the same subject, Dreamix can generate new videos with the subject in motion. In this example, given a small number of images of the toy fireman, Dreamix is able to extract the visual features and then …