AI Sky Replacement with SkyAR

Key Takeaways

have you ever been on a road trip and wondered what if we are in minecraft the truth is we can't really be in minecraft because this is in russia in the 1980s there's only our craft but with modern technologies we can easily insert a minecraft background that suits your taste however it is always the method that poses difficulties for us to do any visual effects so let me show you a new ai research paper today that can produce stunning augmented reality effects just like what you are seeing here with just a few commands dynamic sky replacement and harmonization in videos or short for sky ar is a really specific ar effects ai that focuses on replacing the sky with basically anything you want this effect itself is pretty basic it crops out the sky and replaces with whichever image that you want by placing it in the background additionally with some motion tracking it is able to stick the image like it's the skybox which is really accurate in some cases it is the time that it reduces compared to manually editing them makes this ai appealing since this ai automates motion estimator sky matting skybox creation and relighting it makes creating any creative work a lot faster it took my gtx 1080 around 16 seconds to process 30 frames of footage which is relatively fast compared to manually cropping all those 30 frames unlike snapchat's reverse sky effect it is not only limited to changing between day and night it does have a similar matting process but this ai can manage any other image of your choice and also include a motion tracking to pin the landscape or the object in the same location this ai learnt how to accurately motion track the sky and remove them but at the same time it is only limited to its own trained data set which is only the sky during the daytime furthermore you can obviously see traces of light star on the edge of the matting or mountains are too far away and being treated as half transparent you can definitely train one yourself and make it better or even train to match something other than this guy though and this would definitely be very useful if it can be exported into different video editing formats and key points but that sounds kind of impossible right now but if you get a little bit creative you can find ways to work around this ai and create really cool effects like looking out the window of an airplane and changing its view for more insightful information or an installation tutorial i'll link it down in the description and this video is sponsored by infinite red infrared consulting handles your mobile web and ai needs if you're looking for someone to build your app visit and reach out at infinite.red big thanks to mark chevin and other patreons that supports me through patreon thank you guys for watching i think my nose is really weird today so my voice might sound a little bit off head over to my discord if you want to share your renders or get some helpful tips on how to improve your renders and as always i'll see you in the next one