A research demo at the intersection of gaming and AI. 

Welcome to an experimental, AI-powered gameplay experience hosted in Copilot Labs. Powered by the Muse World and Human Action Model (WHAM) built by Microsoft Research, this tech demo offers an early look at how generative AI can simulate interactive gameplay.

Copilot Gaming Experiences represents a practical step forward in exploring how AI can create brand new ways to interact with games while building upon existing ones. By generating gameplay in real time, the underlying Muse shows how classic games like Quake II can be reimagined through modern AI techniques.

In this real-time tech demo, Copilot dynamically generates gameplay sequences inspired by the classic game Quake II. Every input you make triggers the next AI-generated moment in the game, almost as if you were playing the original Quake II running on a traditional game engine. Enjoy the experience, share your thoughts, and help shape the future of AI-powered gameplay experiences.

Note: Each demo session has a time limit at this time. 

What is Copilot Gaming Experiences?
Copilot Gaming Experiences is an experimental, AI-powered gaming experience that brings cutting-edge research to life within Copilot Labs. Built on the innovative World and Human Action Model (WHAM) technology from Microsoft Research, Copilot Gaming Experiences dynamically generates game visuals and responds to player inputs in real time, simulating interactive gameplay without relying on traditional game engines. Designed as a short, one-minute tech demo, it offers players a glimpse into next-generation AI gaming experiences.

What is WHAM? How does it work?
Copilot Gaming Experiences is a World and Human Action Model (WHAM), our groundbreaking generative AI model that can dynamically create gameplay visuals and simulate player behavior in real time. Its development by Microsoft Research, recently published in the scientific journal Nature, marks a significant step forward in our ability to merge research with real-world product innovation.

What is the experience in Copilot Labs?
This bite-sized demo pulls you into an interactive space inspired by Quake II, where AI crafts immersive visuals and responsive action on the fly. It’s a groundbreaking glimpse at a brand new way of interacting with games, turning cutting-edge research into a quick and compelling playable demo.

What games are available in the initial experience in Copilot Labs?
The initial experience on Copilot Labs is powered by a Copilot Gaming Experiences model trained on gameplay from Quake II.

How do I access this demo?
The experience is accessible through a dedicated webpage on Copilot Labs. It’s designed for desktop use only, as the demo relies on keyboard controls and inputs.

Is the experience available on mobile devices?
Currently, no. The experimental tech demo is optimized for desktop browsers because the experience requires a physical keyboard for effective control.

How do I control the game?
The game is controlled via keyboard input.

• Movement: Use WASD to move (simulating a left stick).
• Looking Around: Use the Arrow Keys to adjust your view (simulating a right stick).
• Jump: Hit Space
• Crouch: Hit C
• Fire: Hit F

Will this tech demo be available for commercial or enterprise use?
The tech demo on Copilot Labs is for consumers to try Copilot Gaming Experiences. However, the underlying Copilot Gaming Experiences research model is available for developers to try at Azure Foundry.

Personalized podcasts that match your curiosity and interests.

Discover Copilot Podcasts a magical listening experience tailored to you. Copilot will generate a podcast upon your request in conversation. It’s the new learning hack to breakdown any topic into a quick podcast.

Whether you crave the thrill of true crime or seek guidance for inspiration for healthier lifestyle, Copilot creates content that both inspires and informs and makes it available to you.

What is Copilot Podcasts?
Copilot Podcasts is a new way to explore and listen to content that interests you. Copilot allows you to easily request AI-generated podcasts on topics of your choice as well as listen to ones that have been pre-generated.

Who can access Copilot Podcasts?
Copilot Podcasts are available in English. We’re gathering feedback and plan to expand to more markets and additional languages soon.

Where can I listen to Copilot Podcasts?
We are bringing Copilot Podcast to mobile apps and copilot.microsoft.com. You can listen to Copilot Podcasts through the Discover feed.

How can I request Copilot to generate a podcast?
Simply message Copilot to “generate/create a podcast”. Copilot will then send you a push notification to inform you that your podcast is ready. You can tap the push notification on your phone to be taken to Copilot where you can begin listening. Please enable push notifications from Copilot in order to receive this reminder.

How can I report issues with Copilot Podcasts?
To report any issues, go to your profile and select “Give Feedback” on any platform where Copilot Podcast is available.

Are there any limits to how many podcasts I can listen to or request from Copilot?
All Copilot users in CMC or iOS and Android app can listen to an unlimited number of pre-generated podcasts. However there are different limits for user-requested podcasts. Non-signed in users can request up to 1 podcast a month, but must sign-in to request more. Free signed-in users can request a limited number of Podcasts weekly, while Copilot Pro subscribers get a near-unlimited number of user-requested podcasts weekly.

What data does Copilot Podcasts retain? What about privacy?
If you listen to podcasts, Copilot remembers your listening history. If you request a podcast, the same data policies apply as in Copilot chat. The chat history follows its standard data retention policies.

What content does Copilot Podcasts use?
Copilot carefully curates web content from Bing to generate a podcast.

Why won’t Copilot Podcasts generate content sometimes?
Certain topics may trigger safety filters, preventing podcast generation. This can happen if the request includes sensitive content, such as violence or explicit material.

Can I upload a file or share a link with Copilot to generate a podcast?
Not at this time, but we are exploring how to bring this capability to Copilot soon.

How can I go back and listen to previously requested podcasts?
At this time, you will only be able to listen to the 5 most recent podcasts on the discover feed. Soon, there will be a dedicated podcast home where you can get back to previous podcast requests, re-listen to podcasts.

Can I share Copilot Podcasts with friends?
Currently, sharing is not available, but we’re working on adding this capability soon—stay tuned!

For answers that require every angle.

Sometimes the right answer isn’t short and sweet. Sometimes it’s worth delving into vast complexities and finding a greater truth. With Think Deeper, Copilot is able to dig into a tough question for you, considering all angles to provide real-time, comprehensive information, and eliminating the need for endless searches and hyperlinks.

Finding a greater truth that has yet to be discovered requires careful, meticulous exploration. With Copilot’s Think Deeper, you can get the extra level of support you need to reach your destination with real-time, comprehensive information and insights that can light the way.

Tap into wisdom for complex problems with Copilot’s Think Deeper, now available right from your mobile device. When you use Think Deeper, Copilot takes more time to consider all the angles, so your answer isn’t just useful, it’s comprehensive.

When you need a more in-depth, comprehensive answer, that’s when you need Think Deeper. Now available via mobile app and to all Copilot users, let Copilot help you consider every angle with the advanced capabilities of Think Deeper.

Let Copilot lend you a hand with web tasks

Copilot Actions is a new way for your AI companion to take action on your behalf. Copilot can now partner with you to complete tasks behind the scenes. Use simple chat prompts to ask Copilot to handle web tasks, from booking tickets, grabbing dinner reservations, or sending a thoughtful gift you can now ask Copilot to help cross it off your list.

Copilot Actions is available to Copilot Pro users in Copilot Labs in the US. You can use it in any modern browser.

After initiating a task you’ll have the ability to pause, stop, take control, and modify your request. Copilot Actions works with most websites, so test it out and let us know what you think.

Disclaimer: Copilot Actions is an early-stage AI-powered tool. It is available today as an experiment for Copilot Pro subscribers in Copilot Labs. While Copilot Actions has strong, built-in mitigations, it is not immune to web exploits and other security risks common on the web. Please monitor its activity closely, especially when tasks involve signing into a website or personal information, such as mailing addresses, email addresses, and payment details.

Example Starting Prompts
Here are some example prompts you can use to get started with Copilot Actions. The more detailed you are in your prompt the better. Imagine you were asking a friend to do a task on your behalf, they might want to know things like your preferences, the number of people, the dates, times, etc. to ensure they did a good job.

• 
  Order me a bouquet of flowers using 1800Flowers.com
• 
  Book me a stay using Booking.com
• 
  Book me a travel package using Expedia.com
• 
  Reserve me a hotel room using Hotels.com
• 
  Book me a car rental using Kayak.com
• 
  Make me a dinner reservation using OpenTable.com
• 
  Book me a cruise using Priceline.com
• 
  Find me a cheap flight using Skyscanner.com
• 
  Find me the highest rated restaurants using Tripadvisor.com
• 
  Book me a vacation rental on VRBO.com
• 
  Schedule me a tour using Viator.com

What is Copilot Actions?
Copilot Actions is a new AI feature available in Copilot Labs. Copilot Actions is a new way for Copilot to be your companion by completing tasks on your behalf. Using a simple, conversational prompt as input, you can instruct Copilot to perform typical actions on the web — like searching for a venue or event, filling out a form, reserving a table in a restaurant, finding or booking travel, and so much more.

Please monitor its activity closely, especially when tasks involve signing into a website or personal information, such as mailing addresses, email addresses or payment details.

How do Copilot Actions work?
Copilot does this by operating its own browser that runs in the cloud in the same way that a person would: via mouse clicks, scrolling, and typing. When a task requires your attention, for example when your personal info or payment details are needed, Copilot will ask you for your input or for you to take control of the remote browser.

Who has access to Copilot Actions?
Copilot Actions is available to Copilot Pro users in Copilot Labs. Users must be signed in with their personal Microsoft Account. Initially, Copilot Actions will only be available in English to people in the United States.

During this testing period, we will collect feedback to improve our product. We hope to expand access to Copilot Actions to more customers in the future.

How can I use Copilot Actions?
To use Copilot Actions, use any modern browser on a desktop computer to navigate to Copilot.com. Copilot Pro users that have access to the new feature will be able to invoke Copilot Actions by selecting “Action” in the response options drop-down in the Chat Mode Menu in “Message Copilot” text box.

Is Copilot Actions capturing and storing images of what it is looking at on the remote browser?
Yes. When running Actions, Copilot takes screenshots of the pages it visits in the browser and uses them to inform the next step. These screenshots are linked to and retained with the conversation in your conversation history, giving you an opportunity to check Copilot’s work. When you delete a conversation, the screenshots are deleted with it. Otherwise, screenshots are retained for up to 30 days.

Does Copilot Actions store or log user inputs, screenshots, and outputs?
As part of Copilot Actions, your text prompts are stored in your conversation history. Any information you input into the remote browser, for example personal data entered into a form, is not stored by Copilot. When you take control of the remote browser using the Take Control option, no screenshots are generated nor sent to Copilot until you hand back control to Copilot. Copilot Actions model responses are being monitored for unsafe interactions and outputs.

Does Copilot have access to my passwords or personal information?
No, Copilot Actions does not have access to your passwords or personal information saved on your local browser. When completing an Action, Copilot is opening its own instance of Edge in a virtual machine.

When will Copilot Actions ask for confirmation, supervision, or for the user to take control?
At this time, Copilot will not make important decisions on its own and will ask for your attention and supervision for certain actions such as buying an item, booking a reservation, sending an email, or deleting an event from a calendar. For certain websites it will ask you to take control of the remote browser entirely.

How can I stop Copilot Actions from running
You can stop Copilot Actions from continuing a running task by clicking the pause button (with an option to resume) it or use the cancel button to completely cancel the task.

Does Copilot Actions work with every site
Copilot Actions can interact with most publicly available sites on the web. Sites that don’t align to Copilot’s policies, such as sites containing offensive content, will not be accessible.  For more information on policy see Terms of Use and Content Policy.

What are some real-world use cases for Actions?
Copilot Actions can complete a variety of tasks, like booking a reservation or appointment, ordering groceries, or sending gifts to friends. Actions work across the web so it can complete a wide range of tasks based on your prompt.

Can Copilot Actions be used in commercial/enterprise environments?
Copilot Actions in Copilot Labs is part of the consumer Copilot offering. You are required to sign in with your personal Microsoft account to use this Copilot feature.

Are there usage limits for Copilot Actions?
Yes, there is a limit to how many Copilot Actions you can perform. Copilot will let you know when a limit is reached and will explain the next steps.

What prevents Copilot Actions from being used for harmful, offensive, or illegal purposes?
Security, digital safety, and responsible AI are top priorities for Microsoft. Copilot Actions will not be available to work with sites that Copilot has determined to contain harmful content or content not aligned with policies. Copilot Actions may not be used for harmful, offensive, or illegal activity. Copilot will refuse these tasks. Serious or repeated violations of the Code of Conduct may result in your suspension from using Copilot Actions.

To learn more visit  Transparency Note for Microsoft Copilot – Microsoft Support, Empowering responsible AI practices | Microsoft AI and Terms of Use and Content Policy.

Reimagine how you see and browse with Copilot Vision’s help.  

Copilot Vision is a new way to share your experience with AI as you get things done on your PC, navigate the web or view the world from your phone. It’s like having a second set of eyes that will instantly scan, analyze, and offer insights based on what Copilot sees. When you activate Copilot Vision, Copilot can view your screen or mobile camera feed and use its voice to answer questions and interact with you. 

Copilot Vision in Edge has been rolled out to all users in the US. Copilot Vision on iOS and Android has been rolled out to all Copilot Pro subscribers in the US. We’re rolling out Vision to Windows Insiders through the Copilot on Windows app.

Who has access to Copilot Vision?

We have expanded Copilot Vision across Edge, iOS, Android and now flighting to Windows Insiders on the Windows app. Free users can try Copilot Vision on Edge and Windows, however Copilot Pro subscribers will enjoy higher usage limits. For Copilot iOS and Android apps, Copilot Vision remains a feature available to Copilot Pro subscribers only. Copilot Vision is currently available in the United States, and rolling out to more markets soon, starting in Edge.

How can I access Copilot Vision in Edge?

Open Edge browser on your desktop. Make sure you’re signed in to your personal Microsoft account. In your Edge browser window, tap the Copilot icon in the top right corner to open Copilot in the sidepane. Then tap the mic icon at the bottom of the sidepane to begin a session with Vision. The Copilot composer will show a glasses icon indicating that Vision is now active. Please note there is no longer a bottom entry point for Vision from your Edge browser.

How can I access Copilot Vision in my Android or iOS app?

Make sure you’re signed in to your personal Microsoft account. From your Android or iOS device, Copilot Vision can be accessed within Voice mode of the Copilot app. When you begin a voice conversation with Copilot, the glasses icon will appear for you to begin Copilot Vision.

How can I access Copilot Vision on Windows?

Copilot Vision can be accessed from the composer in the Copilot on Windows app. Click on the Vision glasses icon to select an open app window to share with Copilot Vision. After you share an open app window, you can ask Copilot about content in the app or ask “show me how” to complete a task using the highlights feature.

Will Copilot Vision eventually roll out to all Copilot customers?

We will soon make Copilot Vision available to all users using Copilot on Windows, Edge, iOS and Android Copilot apps. Copilot Vision on Windows, including highlights, is currently rolling out for users in the Windows Insider Program in the US and will then expand to all users. We’re taking our time to garner feedback, iterate on the technology, and will expand access to more customers over time.

Is Copilot Vision always on? Is it always looking at what’s on my Edge browser window, desktop screen or mobile camera feed?

No, Copilot Vision is not always on. Vision will only be active when you initiate a Vision session. When a Vision session is ongoing, the Copilot composer will have a Vision glasses icon indicating that you are in an active Vision session. The session will end if you end it in the composer, close the Copilot app, close the window shared, or remain inactive for an extended period. To use Vision again, click on the glasses icon in the Composer to start another session.

Does Copilot Vision store or log any user inputs?

Copilot’s model responses are being logged to enable monitoring of unsafe interactions and outputs. User images, voice audio, and context will not be logged or stored. Your voice conversation with Vision is transcribed as part of your conversation history. You may delete the chat history at any time.

Is Copilot Vision capturing and storing images of what I’m looking at?

No. No images or context are retained, transcribed, or logged. Once the session ends, all such data is deleted.

When using Copilot Vision, are you using website’s data that’s being viewed for training purposes?

No, we are not capturing, storing, or using any data to train our models. Once the Copilot Vision session ends all images, audio, and context are deleted. Model responses are stored to enable monitoring of unsafe interactions. A transcript of your conversation is stored in your history to enhance Copilot’s memory and is not used for training or personalization. You may delete the chat history at any time.

Can I opt out of this new experience?

Yes. If you would like to revert to the previous Copilot experience on Edge without Copilot Vision, you can do so in your Edge Settings. Go to the Copilot and sidebar tab and toggle off “Allow Copilot Vision to view your webpage”

Copilot Vision in Mobile is an opt in feature within the voice mode.
Copilot Vision on Windows is an opt in feature from the glasses icon in the Copilot composer.

Does this feature turn off when you go to the next web page or when you start using another app?

No, Vision remains on until you end the session by closing the Edge window or shared app or exiting from the experience in the Copilot Composer. It can only see the window that you’ve shared. You can check whether Vision is on by looking for the glasses icon in the Composer.

Does Copilot Vision work with any site or app?

Copilot Vision works with most sites, except those containing harmful or adult content. When you visit a site that is not currently enabled, the Copilot Composer will show a crossed eye, and the model will refuse to discuss the content. For more information, see our Terms of Use.

Yes, Copilot Vision works with any app on Windows. However, if the content includes harmful or DRM-protected material, Copilot will not be able to analyze it.

What prevents Copilot Vision from being used for harmful, offensive, or illegal purposes?

Security and digital safety are top priorities for Microsoft. Copilot Vision is not accessible on offensive and harmful sites, and cannot be used for harmful, offensive, or illegal topics. Learn more at Empowering Responsible AI practices.

How is Copilot Vision different than Recall?

Copilot Vision and Recall are different features with different goals.

Vision works strictly in the context of what you choose to share during the session. Screenshots, audio, and context are not stored. Only your conversation transcript is saved, and you can delete it anytime.

Recall is supported only on Copilot+ PCs. For users who opt in, Recall takes encrypted snapshots of the screen and stores them locally. Learn more at Privacy and control over your Recall experience.

Can Copilot Vision be used in commercial/enterprise environments?

At this time, Vision is only part of the consumer Copilot offering. You must be signed in with a personal Microsoft account to use these features.