NEW VR in Stable diffusion? The future is now!

Sebastian Kamph · Beginner ·🛠️ AI Tools & Apps ·3y ago

Key Takeaways

Sebastian Kamph discusses Scotty Fox's work on integrating Stable Diffusion AI into virtual reality, showcasing live rendering examples and potential applications.

Full Transcript

the year is 21 39. the majority of Earth's population is living inside the simulation an artificial intelligence without a designated name is controlling the world this is how it all began in 2022 a human named Scotty Fox began working on a virtual reality simulation well beyond this time no one realized the importance of this and what it would mean for future Generations Estes is evolving the novel AI in a research lab is taking control of the facilities unbeknownst to the researchers what happened next very few know relevant videos have been restored from that time this is one of them of them hey we're back So today we're gonna be talking about VR in stable Fusion yep you heard that right this is brand new stuff I've been following this guy Scotty Fox who is a developer for the forum for quite a while he's uh next to the developer he's also a very nice guy been helping out with the Forum and teaching people how that works but on the side he's working on his VR project for stable fusion and it's super cool because it's live rendering as you are inside the VR everything goes on as you have the the Google song so we're gonna see some examples on that over to you Seb thank you Seb okay so here we are at Scotty Fox Twitter and I'm gonna link it in the description below go follow him he's a stand-up guy so it describes himself here as a visual magic Craftsman avoiding warranties and Tech or science and as I mentioned is one of the deforum depths he sips the coffee so apparently it's not that important I don't know we're gonna dive straight into it here's a real-time immersive stable Fusion VR example so this is an example of someone having the VR headset on I would assume Scotty and moving around as the environment is live rendering and what happens is that it's rendering Parts Little parts of this and as they get completed they're diffused into the immersive space so to speak so as he's looking around things are changing things are changing and they're not popping back in back in all a little at a time so if you you can see there's there's well I can't keep up with the mouse but you can see small changes every now and then so you're not getting you know the full complete big change of the image you're getting the little changes I think this is this is just amazing this is fantastic I love this I mean we've been talking about uh can this change that or can this tool um beat that but this is this is um now this is really cool stuff and this is uh it's it's super revolutionary let's look at another example actually we're gonna look at this this way so you can see a bigger View now this is some sort of outdoor space oh there's some nature going on that that's cool I'm going to remove the sound here so I don't get copyright strike man imagine being inside one of these spaces and just having it change as you're exploring it I'm Gonna Keep Going check one of the other ones so here on October 30th he had a success with the new method of prediction improved cohesion of Nader and Senate wrapping no more seams yeah okay I remember that so the blending is uh is cleaner I've been following this work for quite some time now and I mean I was impressed with the initial stuff I was really impressed with the initial stuff but what is going on here now it's um again it's revolutionary it's gonna be real fun to see where where this is going I actually saw him he wrote something was it my demo face is now complete or demo demo phase is not complete I will focus on tutorial content so um so we can see something soon that we can actually try for ourselves now that would be really cool or actually that you can try at home if you have a VR headset now I don't yet sadly but I read a book instead of VR testing it was a novel experience anyway see what else is going on oh yeah I saw this and this is not um this is not his project it's another um it's another group that works on this or actually Sean here so it's um it's painting inside the VR space and it's working together with stable diffusion uh that's also amazing it's a cute 3D robot man that's amazing so we're just going to go through the stuff here because I know Scott has been posting a lot of cool stuff lately and I figured now it's been piling up and it's time to go over it now I'm not sure he's gonna if he's gonna release this individually or if it's going to be a part of the Forum I mean the Forum is arguably the best animation tool for now I mean World Fusion yeah that's cool as well because the cohesion is amazing but I like the Forum I like it see what else is going on you can just again I'm gonna link this stuff so just go check out this Twitter and you can delve into detail so there's some sort of houses here around him you can see the small small change is coming in there we go I don't know if the I don't think this yeah you can't see the the seam the transition the transitions aren't as seamless as what you see not in the newer post but this is still very cool see what else it's got going on is it really really nice image actually um check out this one here you can see you got more changes going on now there are faster changes they're not as seamless but it's still very cool to watch so this is some sort of a room it looks like almost like a will look like some steampunk stuff but that got removed really fast and there's a sort of character there to the left a big big windows and all that character is gone now there's like Renaissance furniture and the style has completely changed now it's like an illustration of sorts we're kind of seeing some change again we're still in the illustration space the windows are here and what is that some kind of skeleton maybe on the left I have no idea yeah at least or some kind of sculpture now we get some some graffiti on the walls just imagine being one of in one of these spaces and everything's changing all the time and this is yeah this is stable diffusion at work making these changes and this is not this is not a pre-rendered video it's happening live and diffused in as it's finished and I think I think I read somewhere that he does this on a 2080 TI so it's not super super heavy somebody gone past the graffiti stuff and now it's that was more of a regular room or except those windows looks like an expensive house all right this was super cool I think this stuff is just fantastic I think it's amazing and I'm super intrigued by it if you have any thoughts about this or would you think it could be used for just put them in the comments below and if you want to see more content like this press the like button and subscribe because damn the algorithm knows you want this stuff and if you don't well that's fine too have a good one see ya

Original Description

A lone developer is on a quest to incorporate Stable diffusion AI into virtual reality. Let's have a look at what's going on. What would you do if you hade VR options in Stable diffusion? https://twitter.com/ScottieFoxTTV Chat with me in our community discord: https://discord.com/invite/dFB7zuXyFY Support me on Patreon to get access to unique perks! https://www.patreon.com/sebastiankamph Ultimate Stable diffusion guide https://youtu.be/DHaL56P6f5M The Rise of AI Art: A Creative Revolution https://youtu.be/Ujpr62w7qcU Ultimate Animation guide in Stable diffusion https://youtu.be/lztn6qLc9UE Dreambooth tutorial for Stable diffusion https://youtu.be/Z-hyKADmHmE 5 tricks you're not using https://youtu.be/-5TaeHvnVxE Avoid these 7 mistakes https://youtu.be/b8xWjrzTAPY How to fix live render preview: https://youtu.be/_4rY0oPbUYA CHAPTERS 0:00 Introduction 0:55 VR in Stable diffusion 9:42 Closing words
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Sebastian Kamph · Sebastian Kamph · 27 of 60

1 How to install stable diffusion tutorial (automatic1111)
How to install stable diffusion tutorial (automatic1111)
Sebastian Kamph
2 Inpainting in Stable diffusion for beginners.
Inpainting in Stable diffusion for beginners.
Sebastian Kamph
3 OpenAI NEW Whisper is AMAZING!
OpenAI NEW Whisper is AMAZING!
Sebastian Kamph
4 Tutorial - Free AI Game assets in Stable diffusion. Episode 1: Sword
Tutorial - Free AI Game assets in Stable diffusion. Episode 1: Sword
Sebastian Kamph
5 Game assets in Stable diffusion. Ep 2: Jewelry
Game assets in Stable diffusion. Ep 2: Jewelry
Sebastian Kamph
6 Stable diffusion Animation tutorial with AUTOMATIC AUDIO SYNC. Make your own AI music video!
Stable diffusion Animation tutorial with AUTOMATIC AUDIO SYNC. Make your own AI music video!
Sebastian Kamph
7 Stable diffusion img2img tutorial.
Stable diffusion img2img tutorial.
Sebastian Kamph
8 Stable diffusion tutorial - AI Game assets. Episode 3: Treasure chest
Stable diffusion tutorial - AI Game assets. Episode 3: Treasure chest
Sebastian Kamph
9 Stable diffusion animation tutorial. Deforum ALL settings explained. Make your own AI video!
Stable diffusion animation tutorial. Deforum ALL settings explained. Make your own AI video!
Sebastian Kamph
10 Dreambooth tutorial for stable diffusion. Quick, free and easy!
Dreambooth tutorial for stable diffusion. Quick, free and easy!
Sebastian Kamph
11 Dreambooth to CKPT. NEW VERSION! Dreambooth locally on potato pc.
Dreambooth to CKPT. NEW VERSION! Dreambooth locally on potato pc.
Sebastian Kamph
12 Stable diffusion tutorial. ULTIMATE guide - everything you need to know!
Stable diffusion tutorial. ULTIMATE guide - everything you need to know!
Sebastian Kamph
13 AI music video. Neffex - Winning
AI music video. Neffex - Winning
Sebastian Kamph
14 Stable diffusion video input tutorial. How I made this music video singing animation.
Stable diffusion video input tutorial. How I made this music video singing animation.
Sebastian Kamph
15 Stable diffusion color grading tutorial. Quick trick!
Stable diffusion color grading tutorial. Quick trick!
Sebastian Kamph
16 Prompt Editing and Alternating Words in Stable Diffusion.
Prompt Editing and Alternating Words in Stable Diffusion.
Sebastian Kamph
17 Stable diffusion gui most important setting. Live render preview.
Stable diffusion gui most important setting. Live render preview.
Sebastian Kamph
18 NEW Voice2img prototype! This AI assistant is using Stable diffusion!
NEW Voice2img prototype! This AI assistant is using Stable diffusion!
Sebastian Kamph
19 Prompts and FREE ONLINE stable diffusion. OpenArt AI tutorial
Prompts and FREE ONLINE stable diffusion. OpenArt AI tutorial
Sebastian Kamph
20 Stable diffusion Halloween concept art tutorial.
Stable diffusion Halloween concept art tutorial.
Sebastian Kamph
21 Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Sebastian Kamph
22 Stable diffusion prompt tutorial. NEW PROMPT BOOK released!
Stable diffusion prompt tutorial. NEW PROMPT BOOK released!
Sebastian Kamph
23 Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Sebastian Kamph
24 How to install Deforum locally. Stable diffusion animation.
How to install Deforum locally. Stable diffusion animation.
Sebastian Kamph
25 Dreambooth in Automatic1111. Cpu only & gpu option.
Dreambooth in Automatic1111. Cpu only & gpu option.
Sebastian Kamph
26 Nvidia's NEW text to image AI eDiff-I. Will it dethrone Stable diffusion?
Nvidia's NEW text to image AI eDiff-I. Will it dethrone Stable diffusion?
Sebastian Kamph
▶ NEW VR in Stable diffusion? The future is now!
NEW VR in Stable diffusion? The future is now!
Sebastian Kamph
28 Motion capture workflow implementation with Stable diffusion
Motion capture workflow implementation with Stable diffusion
Sebastian Kamph
29 Don't make these 7 mistakes in Stable diffusion.
Don't make these 7 mistakes in Stable diffusion.
Sebastian Kamph
30 Stable diffusion up to 50% faster? I'll show you.
Stable diffusion up to 50% faster? I'll show you.
Sebastian Kamph
31 Stable diffusion 2.0 Released
Stable diffusion 2.0 Released
Sebastian Kamph
32 Top 5 Stable diffusion tips for newcomers.
Top 5 Stable diffusion tips for newcomers.
Sebastian Kamph
33 3 AMAZING Stable diffusion models that will change your life!
3 AMAZING Stable diffusion models that will change your life!
Sebastian Kamph
34 Best NEW AI tool? InvokeAI tutorial for Stable diffusion.
Best NEW AI tool? InvokeAI tutorial for Stable diffusion.
Sebastian Kamph
35 Monetize your AI art on Creative Fabrica with CF Spark.
Monetize your AI art on Creative Fabrica with CF Spark.
Sebastian Kamph
36 NEW Stable diffusion 2.1 RELEASED!
NEW Stable diffusion 2.1 RELEASED!
Sebastian Kamph
37 Stable diffusion 2.1 is GREAT. At this one thing. 2.1 install tutorial.
Stable diffusion 2.1 is GREAT. At this one thing. 2.1 install tutorial.
Sebastian Kamph
38 Your face in AI images? The EASY way.
Your face in AI images? The EASY way.
Sebastian Kamph
39 3 FANTASTIC Stable diffusion models you don't know about!
3 FANTASTIC Stable diffusion models you don't know about!
Sebastian Kamph
40 Unstable diffusion JUST GOT BANNED! 😲
Unstable diffusion JUST GOT BANNED! 😲
Sebastian Kamph
41 The end of AI Art? Lawsuit against Stable diffusion
The end of AI Art? Lawsuit against Stable diffusion
Sebastian Kamph
42 Stable diffusion TIER LIST. Best GUI ranked.
Stable diffusion TIER LIST. Best GUI ranked.
Sebastian Kamph
43 Google's ChatGPT rival Bard. Is it better?
Google's ChatGPT rival Bard. Is it better?
Sebastian Kamph
44 7 Secrets in ChatGPT (Don't tell your boss!)
7 Secrets in ChatGPT (Don't tell your boss!)
Sebastian Kamph
45 How to ChatGPT? Chat GPT explained!
How to ChatGPT? Chat GPT explained!
Sebastian Kamph
46 How to ChatGPT in 20 seconds!
How to ChatGPT in 20 seconds!
Sebastian Kamph
47 Midjourney 4C Features
Midjourney 4C Features
Sebastian Kamph
48 NEW ControlNet for Stable diffusion RELEASED! THIS IS MIND BLOWING!
NEW ControlNet for Stable diffusion RELEASED! THIS IS MIND BLOWING!
Sebastian Kamph
49 Revealing my Workflow to Perfect AI Images.
Revealing my Workflow to Perfect AI Images.
Sebastian Kamph
50 LIVE Pose in Stable Diffusion's ControlNet.
LIVE Pose in Stable Diffusion's ControlNet.
Sebastian Kamph
51 Control Light in AI Images
Control Light in AI Images
Sebastian Kamph
52 Multi-ControlNet tutorial.
Multi-ControlNet tutorial.
Sebastian Kamph
53 Control Text in AI Images
Control Text in AI Images
Sebastian Kamph
54 Full AI Art Workflow. ControlNet & Stable diffusion.
Full AI Art Workflow. ControlNet & Stable diffusion.
Sebastian Kamph
55 ControlNet Guidance tutorial. Fixing hands?
ControlNet Guidance tutorial. Fixing hands?
Sebastian Kamph
56 Illuminati Model with Noise Offset & Weekly AI Art Challenge
Illuminati Model with Noise Offset & Weekly AI Art Challenge
Sebastian Kamph
57 Paint&Text2Image - MultiDiffusion Region Control.
Paint&Text2Image - MultiDiffusion Region Control.
Sebastian Kamph
58 Style2Image in ControlNet (T2I)
Style2Image in ControlNet (T2I)
Sebastian Kamph
59 Gen-1 AI Animation is WILD
Gen-1 AI Animation is WILD
Sebastian Kamph
60 Famous Scenes Remade by ControlNet AI
Famous Scenes Remade by ControlNet AI
Sebastian Kamph

This video explores the potential of integrating Stable Diffusion AI into virtual reality, allowing for live rendering and immersive experiences. Sebastian Kamph discusses Scotty Fox's work on this project and showcases examples of its capabilities.

Key Takeaways
  1. Explore the work of Scotty Fox on integrating Stable Diffusion AI into virtual reality
  2. Understand the concept of live rendering in VR
  3. Consider potential applications of AI-powered VR
💡 The integration of Stable Diffusion AI into virtual reality enables live rendering and immersive experiences, opening up new possibilities for various applications.

Related Reads

📰
We Changed How Work Software Works
Learn how to solve the problem of AI struggling with messy spreadsheets by organizing data in one system
Medium · Startup
📰
What Workflow Builders Learn When AI Draft Quality Improves but Publishing QA Still Breaks: Practical Notes for Builders
Learn how improved AI draft quality affects workflow builders and publishing QA, and what practical steps to take to ensure seamless content delivery
Dev.to AI
📰
Meshy AI 3D Generator Review 2026: 185 MB Per House, $193 to Ship It
Learn how Meshy AI 3D Generator works and its implications on data storage and shipping costs
Medium · AI
📰
5 Claude Tricks That Feel Almost Like Cheating
Boost productivity with Claude by using 5 tricks that simplify workflows and enhance efficiency
Medium · Data Science

Chapters (3)

Introduction
0:55 VR in Stable diffusion
9:42 Closing words
Up next
How to Get Your Brand Cited by ChatGPT, Claude and Gemini
Arvow
Watch →