The Future Of Online Shopping

Key Takeaways

i think there is nothing harder than finding the right size and the right look from online shopping and it is often easy to get the wrong size or style and you have to return it for the one that you want but then it takes like another month for this whole process before you can get your item which is really annoying so to propose a solution for this there are some ai researchers out there who have dedicated their time to solve this problem which is also known as virtual trions when given a pair of images we will want to apply for example the jeans onto the other image and in order to do that it will require us to synthesize high resolution images and the best image synthesizer right now is style gen 2. so a group of researchers from google mit ai lab and udub published this paper called vogue virtual try on by building upon stylegen 2 with various other algorithms to create this photorealistic try on ai so it looks really natural and high quality when you see the garment projected onto the person it is really flexible in projecting the garment too it not only is capable of being projected onto different poses but also can be applied to different directions of the body different body postures and even project short sleeves onto a person who has long sleeves on even when the arms were not shown from the input image it is able to synthesize consistent skin tones just by determining it from the hand and the neck really really impressive the same goes for projecting the pens too it gets the right waist level and even generates buttons that were not present in the referencing image not only that it is also able to generate a pocket where the hand can fit into accurately too i would definitely not have noticed this because it was just too natural such small details able being recognized by the ai is just surprising however if you look closely you can tell that the original image and the resulting image is slightly different in the region that is not supposed to change and this is actually because it is the way of generating these images that makes it look different to put it simply it's like music categorization map where in different directions you move the slow lead genres changes they are all still music of course but they sound gradually different when you move from the border of one category to another to put it into the perspective of vogue try on instead of music we now have clothes and so the music genres are like the type of clothes from hip hop to classical is like from short sleeves to long sleeves and the garments inside the image is now being represented by having thoughts on the categorization map and in a more technical term this map is called the latent space it exists in between the encoder and the decoder and it represents the image data in the most compressed form because it is so compressed by slightly changing its values of this latent space representation can affect the generation when it is being decoded at the end and instead of just being a compressed image data this ai focused on the garments instead of like the rgb values or other less relevant details in the good old days we have never dreamed about controlling this latent space because it is a very complex form of data and tuning it was basically impossible so after a lot of research papers in the recent years made by a lot of different ai researchers we are now able to control the latent space representations like we never had before and you can see that these kind of tasks has been shown a lot in ai face generation where we get the input phase latent space representation and we can then adjust the representation to get different hair lengths mustache gender age and even more while preserving the original look so this technique has been applied into this research paper with modifications and additions such as image segmentation for different regions of the body from the top the bottom the neck the chin to the hands and so this is how the ai can recognize where the arms are underneath the clothes and generate human skin over the arm instead of just clothes however there are also improvements to be made to this paper and it is far from perfect yet so far this ai is only capable of clothes with plain colors or simple patterns anything more complex than that such as a logo cannot be easily transformed into accurate latent space representation therefore in the generation would turn out distorted too and if you also look closely at the patterns or the buttons they are also not completely perfect and to exactly imitate try on they need to also figure out how to represent different clothes sizes but just by looking at the progress this paper has made against the older research papers i am pretty optimistic that this can turn into a very helpful tool in the near future and this video is sponsored by infinite red infinite red consulting handles your mobile web and ai needs if you are looking for someone to build your app visit with the link down in the description thank you guys for watching as usual and a big shout out to mark schfin and many other patreons that support my work through patreon join my discord and follow my twitter if you haven't and i'll see you all in the next one