What is Copilot Gaming Experiences?
Copilot Gaming Experiences is an experimental, AI-powered gaming experience that brings cutting-edge research to life within Copilot Labs. Built on the innovative World and Human Action Model (WHAM) technology from Microsoft Research, Copilot Gaming Experiences dynamically generates game visuals and responds to player inputs in real time, simulating interactive gameplay without relying on traditional game engines. Designed as a short, one-minute tech demo, it offers players a glimpse into next-generation AI gaming experiences.
What is WHAM? How does it work?
Copilot Gaming Experiences is a World and Human Action Model (WHAM), our groundbreaking generative AI model that can dynamically create gameplay visuals and simulate player behavior in real time. Its development by Microsoft Research, recently published in the scientific journal Nature, marks a significant step forward in our ability to merge research with real-world product innovation.
What is the experience in Copilot Labs?
This bite-sized demo pulls you into an interactive space inspired by Quake II, where AI crafts immersive visuals and responsive action on the fly. It’s a groundbreaking glimpse at a brand new way of interacting with games, turning cutting-edge research into a quick and compelling playable demo.
What games are available in the initial experience in Copilot Labs?
The initial experience on Copilot Labs is powered by a Copilot Gaming Experiences model trained on gameplay from Quake II.
How do I access this demo?
The experience is accessible through a dedicated webpage on Copilot Labs. It’s designed for desktop use only, as the demo relies on keyboard controls and inputs.
Is the experience available on mobile devices?
Currently, no. The experimental tech demo is optimized for desktop browsers because the experience requires a physical keyboard for effective control.
How do I control the game?
The game is controlled via keyboard input.
- Movement: Use WASD to move (simulating a left stick).
- Looking Around: Use the Arrow Keys to adjust your view (simulating a right stick).
- Jump: Hit Space
- Crouch: Hit C
- Fire: Hit F
Will this tech demo be available for commercial or enterprise use?
The tech demo on Copilot Labs is for consumers to try Copilot Gaming Experiences. However, the underlying Copilot Gaming Experiences research model is available for developers to try at Azure Foundry.
