Generated Reality maps VR movement to AI video

Duane Villanueva • Mar 3, 2026 • 1 min read

Generated Reality is an early-stage project exploring how to link VR motion tracking with AI video generation. Using a VR headset’s hand and head tracking plus a text prompt, the system generates first-person video that roughly matches the user’s movements.

Right now, the output runs at around 11 frames per second and the visual quality is still low compared to modern image models. Even so, the demo suggests a path toward interactive AI-generated environments that respond to player motion and instructions in real time.

The team says code is coming soon, which could open experimentation for VR developers and researchers building new kinds of immersive experiences.

Duane Villanueva

Communication graduate, closet cynic, and kid at heart. Duane is a rare person to find, quite literally. He often takes to himself but has proven his mettle in tech media with his quick wits. Well, the portfolio of scriptwriting, web content, and public relations help too, we suppose. As a homebody, he often spends his time on the streaming platform Twitch or ‘farming’ gaming clips with friends. He is also an avid fan of round glasses and anything relative to blueberries.

194 posts

Generated Reality maps VR movement to AI video

Comments

Cancel reply