AI Video Editing Hack

Key Takeaways

Meta's new image and video model can track objects automatically for you. So, I uploaded a short clip of my desk with my whole filming setup here. And after searching for monitors, SAM 3 found all of them and tracks them as I move the camera throughout the video. But, it's not just static tracking. I can apply effects directly to these objects like putting a spotlight over my filming camera while blurring out the rest of the background. Add a completely new effect like contour, which outlines the object with clean animated lines. This would usually take so much time to manually create an effect like this some editing software, but SAM 3 makes it so easy. And I didn't have to label or train it at all. SAM 3 just knows what these objects are and keeps tracking them across the whole video. And since this is a Meta product, it's also coming soon to Instagram edits. So, creators will be able to make videos that stand out by easily applying effects to specific objects. You can try it today yourself in the Segment Anything Playground and soon right inside Instagram edits.