Creating immersive experiences with Microsoft Mesh

Key Takeaways

hey Brent oh hey Mega great to see you beautiful weather we're having up here today huh definitely are you in VR headset I am in a VR headset uh are you on PC then yes ah it's great that we can collaborate together immersively on PC and in VR inside a Microsoft mesh what do you say we hop out of here for a minute and tell our viewers about our product let's do it all right we've seen some of our early Partners build solutions that Target scenarios such as employee onboarding training social Gatherings and more with mesh you get a lot of out-of- thee box functionality you get a built-in Avatar system you can use different input devices and it also comes with spatial audio so there's a lot that just comes with mesh but there is a lot of room to add your own magic to build custom experiences that's right we have have developer tools so that you can bring things like web content into your experience physics for real world like interactions scripting that can actually connect to your business Logic on the back end and Performance Tools to make sure things work great on Quest so when you're building custom experiences you know they're going to be great let's jump over into Unity so we can show you how to use these developer tools let's do it so what we have here is a scene in unity that we can use to build experiences inside of mesh now we want to understand is our scene are we looking down at it from up here or are we down here on this little boat sailing to this island or are we somewhere in the middle well for this experience we're actually going to be somewhere in the middle and to help you understand what your experience looks like for that scale we can go to mesh toolkit and add our play mode setup and we get this little Dev person who's about person height and we can use them to design our experience around a certain size now that they're in here we can see what things will look like and let's say we want to add some web content so we'll go ahead and go in here back to mesh toolkit add a web slate and once this web slate is in here we can position it where we want it make it the size that we want it add the content to it that we want down here you just enter the URL you want uh this one I'm going to take us to the mesh homepage because everyone wants to see the mesh homepage and then when you get play mode you can see that content interact in here and test things out but before we do that we would want to go through into this tool down here our content performance analyzer and make sure our environment is going to perform well inside of mesh so to do that we just click run all and that will go through and it looks at the scene and analyzes some different things in here and lets us know you know did we pass do we have some warnings are there some things that just aren't working and we can go in here and see okay we've got some issues we can fix some of these things can be fixed automatically some cannot uh but we try and make it as easy as possible if you to bring your environments inside of mesh cool awesome thank you Brent for showing us that with those steps we'd have an environment ready to party in and mesh you can bring your co-workers what I'm going to do is take it a step further to add some magic and interactivity to the scene using visual scripting so what we're looking at here is a Teleport button what I want to do is have my users click that button and teleport to the top of this generator which my technical artist has added an animation to which is pretty cool so let's open this button and what we're going to do like I mentioned is use visual scripting to make this happen so let's edit our embedded graph right here and we already have some logic written out what this teleport button Behavior logic is doing for those familiar with visual scripting is it's just saying that if you click on this button something is going to happen now it's our job to set what that something is so we want to get to the top of that platform so let's go into our Travel Group points over here you'll see I have some other travel points already set up um what I'm going to do is create another one and call this teleport location wind turbine make sure not to have any typos there and I already have my position in mind so let me just add that in and we'll set the rotation to 270 because I want to make sure the Avatar is spacing the generator which is located right here so I have that travel Point added what I need to do is add this travel Point script what I need to also do is unselect this point uh what you'll notice here is this location is selected because it's activated as the SP where our avatars are going to spawn into I don't want my avatars to spawn into the top of the turbine when they first join the event I just want to set this as a travel point so we can call that into our visual scripting here so what I'm going to do is activate my game object there we go and call in this location and I'll press this value to activate this as well and then I need to add a special travel Point script as you can see there's a bunch of different options that you can use to customize this experience in this case I have a specific point that we've already made so I'm going to drag this in right here awesome so what's happening in this logic right now is this has been set um to true so that this when the button is selected I'm teleporting to the top however I want to reset this back to false so that the next time I press the button I can teleport again I don't want this to be just a oneand done deal so I am going to connect this logic here and there we go we'd have our travel uh teleport button working and we can test this out by going into play mode while play mode loads here I'll tell you a little bit about what we're looking at this is mesh 101 it is our developer tutorial that's designed to guide you through basic building blocks of what it is like to build for mesh so for example we have an information dialogue trigger we have this teleport button right here we have video player as well and it walks you through how to build these things in unity for an experience in mesh awesome so let's check out if this button works great we've made it to the top of the turbine like I mentioned there is an animation here that our Tech artist has set up so we can go ahead and look into this generator and that's it for our work in unity regarding visual scripting awesome we've made it to our physics interactivity station with physics you can control things like grab ability gravity buoyancy and throwability this is a super simple example where these blades start moving when we bring them into the ocean wind now there's one turbine that's not moving and I'm going to show you how easy it is to make that turbine grabbable and releasable I just have to bring in my mesh interactable property script turn this on and make it manipulable there's a bunch of different settings that I can use and customize the experience but that's how simple it is to make it grabbable and releasable now I think Brent is already in mesh partying with these turbines and I really want to head over there we have an environment that's already published so let's jump right into mesh hey again Brent good to see you playing with the turbines yeah good to see you too you know something I really like about mesh we have the developer tools that we've shown you today and also we have all the stuff that comes with mesh out of the box like this Avatar system and spatial audio comes together to create a truly unique product and if you all want to learn more about mesh you can follow the link in the description and if you want to keep up with n365 you should subscribe to the channel now I'm going to head back over here to the turbines thanks for listening all see you in mesh bye