Microsoft is adding tons of new AI features to its operating system, Windows 11, including Copilot Vision, the AI tool that can see your whole screen.

The new Copilot vision is accessible to all Windows 11 users in the Copilot App, even if you’re not on a Copilot + PC.

“The new Copilot Vision update for Windows insiders now lets the AI see everything, which is a big jump from how Copilot Vision worked before. Before this update, Vision was only allowed to see 2 windows/apps at once and connect them, but this new update lets Copilot see your whole display.” - Daniel Morrisey, MBD News

Users on a Copilot + PC now have a new tool called Agent. This lets you tell Copilot to do things in a more “natural language.” It’s kind of like ChatGPT Agent. If Copilot Agent can do it, it will do it for you.

Microsoft is also improving its “Click to do” feature, where a user holds down the Windows key (Win) and left-clicks on a website, app, or text. You tell Copilot what you want it to do, and if it can, it will do it. It’s also adding more support for First-Party apps like Teams and Word. You can tell it to schedule a Teams meeting or draft a Word document.

Microsoft is also adding more “creative” tools for Copilot + Pc users in Paint, like making a sticker (clipart with color) or selecting a part of the image to edit just that section.

Microsoft says these new features are coming out “over the next month”.