Disclaimer: Copilot Actions is an early-stage AI-powered tool. It is available today as an experiment for Copilot Pro subscribers in Copilot Labs. While Copilot Actions has strong, built-in mitigations, it is not immune to web exploits and other security risks common on the web. Please monitor its activity closely, especially when tasks involve signing into a website or personal information, such as mailing addresses, email addresses, and payment details.
Example Starting Prompts
Here are some example prompts you can use to get started with Copilot Actions. The more detailed you are in your prompt the better. Imagine you were asking a friend to do a task on your behalf, they might want to know things like your preferences, the number of people, the dates, times, etc. to ensure they did a good job.
-
Order me a bouquet of flowers using 1800Flowers.com
-
Book me a stay using Booking.com
-
Book me a travel package using Expedia.com
-
Reserve me a hotel room using Hotels.com
-
Book me a car rental using Kayak.com
-
Make me a dinner reservation using OpenTable.com
-
Book me a cruise using Priceline.com
-
Find me a cheap flight using Skyscanner.com
-
Find me the highest rated restaurants using Tripadvisor.com
-
Book me a vacation rental on VRBO.com
-
Schedule me a tour using Viator.com
What is Copilot Actions?
Copilot Actions is a new AI feature available in Copilot Labs. Copilot Actions is a new way for Copilot to be your companion by completing tasks on your behalf. Using a simple, conversational prompt as input, you can instruct Copilot to perform typical actions on the web — like searching for a venue or event, filling out a form, reserving a table in a restaurant, finding or booking travel, and so much more.
Please monitor its activity closely, especially when tasks involve signing into a website or personal information, such as mailing addresses, email addresses or payment details.
How do Copilot Actions work?
Copilot does this by operating its own browser that runs in the cloud in the same way that a person would: via mouse clicks, scrolling, and typing. When a task requires your attention, for example when your personal info or payment details are needed, Copilot will ask you for your input or for you to take control of the remote browser.
Who has access to Copilot Actions?
Copilot Actions is available to Copilot Pro users in Copilot Labs. Users must be signed in with their personal Microsoft Account. Initially, Copilot Actions will only be available in English to people in the United States.
During this testing period, we will collect feedback to improve our product. We hope to expand access to Copilot Actions to more customers in the future.
How can I use Copilot Actions?
To use Copilot Actions, use any modern browser on a desktop computer to navigate to Copilot.com. Copilot Pro users that have access to the new feature will be able to invoke Copilot Actions by selecting “Action” in the response options drop-down in the Chat Mode Menu in “Message Copilot” text box.
Is Copilot Actions capturing and storing images of what it is looking at on the remote browser?
Yes. When running Actions, Copilot takes screenshots of the pages it visits in the browser and uses them to inform the next step. These screenshots are linked to and retained with the conversation in your conversation history, giving you an opportunity to check Copilot’s work. When you delete a conversation, the screenshots are deleted with it. Otherwise, screenshots are retained for up to 30 days.
Does Copilot Actions store or log user inputs, screenshots, and outputs?
As part of Copilot Actions, your text prompts are stored in your conversation history. Any information you input into the remote browser, for example personal data entered into a form, is not stored by Copilot. When you take control of the remote browser using the Take Control option, no screenshots are generated nor sent to Copilot until you hand back control to Copilot. Copilot Actions model responses are being monitored for unsafe interactions and outputs.
Does Copilot have access to my passwords or personal information?
No, Copilot Actions does not have access to your passwords or personal information saved on your local browser. When completing an Action, Copilot is opening its own instance of Edge in a virtual machine.
When will Copilot Actions ask for confirmation, supervision, or for the user to take control?
At this time, Copilot will not make important decisions on its own and will ask for your attention and supervision for certain actions such as buying an item, booking a reservation, sending an email, or deleting an event from a calendar. For certain websites it will ask you to take control of the remote browser entirely.
How can I stop Copilot Actions from running
You can stop Copilot Actions from continuing a running task by clicking the pause button (with an option to resume) it or use the cancel button to completely cancel the task.
Does Copilot Actions work with every site
Copilot Actions can interact with most publicly available sites on the web. Sites that don’t align to Copilot’s policies, such as sites containing offensive content, will not be accessible. For more information on policy see Terms of Use and Content Policy.
What are some real-world use cases for Actions?
Copilot Actions can complete a variety of tasks, like booking a reservation or appointment, ordering groceries, or sending gifts to friends. Actions work across the web so it can complete a wide range of tasks based on your prompt.
Can Copilot Actions be used in commercial/enterprise environments?
Copilot Actions in Copilot Labs is part of the consumer Copilot offering. You are required to sign in with your personal Microsoft account to use this Copilot feature.
Are there usage limits for Copilot Actions?
Yes, there is a limit to how many Copilot Actions you can perform. Copilot will let you know when a limit is reached and will explain the next steps.
What prevents Copilot Actions from being used for harmful, offensive, or illegal purposes?
Security, digital safety, and responsible AI are top priorities for Microsoft. Copilot Actions will not be available to work with sites that Copilot has determined to contain harmful content or content not aligned with policies. Copilot Actions may not be used for harmful, offensive, or illegal activity. Copilot will refuse these tasks. Serious or repeated violations of the Code of Conduct may result in your suspension from using Copilot Actions.
To learn more visit Transparency Note for Microsoft Copilot – Microsoft Support, Empowering responsible AI practices | Microsoft AI and Terms of Use and Content Policy.
