The new Windows Copilot in Windows 11 is essentially Bing.com/chat integrated into a panel powered by Microsoft Edge.
If you tried the first preview of Windows Copilot, you probably know that it's disappointing. But that could change soon, as the company tries to achieve a deeper integration of Copilot in Windows 11.
Using the Microsoft Edge APIs, Microsoft is preparing plugins for Windows Copilot that could allow it to control operating system-level functions, such as changing settings, opening apps, turning dark mode on or off, changing brightness level and reading content of another application.
There are currently several new .json files in Windows 11 preview builds, such as “TaskManagerService-ai-plugin.json”, which suggests that Windows Copilot can access the Task Manager.
For example, you'll soon be able to ask Copilot to manage a process using Task Manager.
Windows Copilot is modular and could change the way you use Windows 11
Microsoft wants Windows Copilot to be as modular as possible. Most of Copilot's functions are handled using company or third-party plugins. These plugins will allow you to launch or close apps, set alarms, search for files, and more.
Microsoft is currently preparing a new set of JSON files representing different plugins for Windows Copilot.
Among the numerous plugins, one that stands out is AccessibilityTools-ai-plugin.json. That particular file could allow Copilot to control accessibility features, making it easier for people with disabilities to navigate the system.
ai-plugin-WindowsSettings.json will be able to control different settings in Windows 11, while ClockService-ai-plugin.json will be able to manage time and wakeup settings.
Likewise, the LaunchApplication-ai-plugin.json and SmartFileActions-ai-plugin.json plugins could provide an interactive way to open applications through simple AI-based commands.
Copilot's plugin architecture also includes openapi.yml files for each JSON plugin. These YAML files likely define API endpoints for plugins, facilitating communication between the AI and the operating system.
The company seems to be trying to strengthen its infrastructure before making the plugins available to everyone, and third-party plugins will be activated in the coming weeks.
