Gen-4 Image to Video | Runway Academy

Key Takeaways

Welcome to Rimway Academy. Today we're talking about our latest AI model, Gen [Music] 4. Gen 4 brings an entirely new level of control, consistency, and fidelity to video generation. working across any style or scene that you're looking to generate. Gen 4 will soon offer references which will allow you to generate consistent characters, objects, and scenes. But today, we'll focus on Gen 4 image to video. To get started with Gen 4, open a generative session and make sure that Gen 4 is selected from the model drop down. Then upload an image to use it as the first frame of your video. Gen 4 supports imagetovideo with multiple aspect ratios and will automatically adhere to the closest aspect ratio of your image, but feel free to change it if you'd like. It's generally recommended to provide a text prompt along with your image in order to direct your scene and control the camera. Prompting should focus on the things that you want to happen in the video, focusing primarily on the subject action and the camera action. A simple prompt for this image could be, "The man is looking around. The camera zooms in on him. [Music] or the man turns around and walks into the distance. Or we can prompt for slightly more complex actions like the man walks past the camera on the right and walks into a dark cave as the camera follows his movements. Of course, you can still use Gen 4 with no prompts at all to still get stunning [Music] results. Gen 4 also works well in a visual effects workflow by prompting for scene actions to take place or by animating visual effects assets that can be used in a more traditional compositing workflow. Don't forget to combine runway workflows and models together like act one to make your character speak. They'll never suspect me in the woods. Or expand video to see more of your scene. Run your Gen 4 outputs through video to video to completely reimagine them by stylizing the first frame. And of course, upscale them to 4K once you're done for even higher fidelity. We're excited for you all to use Gen 4 to bring your ideas to life. Make sure you check out the help article for Gen 4 prompting tips and tricks. Join the Runway Discord to see how our creative community is using Gen 4. Or if you need additional assistance, you can always use this button on your dashboard at any time. [Music]