Microsoft’s AI Lets You Control Your PC With Your Voice

Microsoft is steering the future of personal computing toward a new era of interaction, where voice commands and artificial intelligence become central to the Windows experience. As the company prepares to celebrate four decades of its operating system, it is embedding AI deeply into Windows 11, transforming ordinary PCs into intelligent companions. Yusuf Mehdi, Microsoft’s executive vice president, describes this shift as rewriting the entire operating system around AI, creating what he calls the true AI PC.

A major part of this vision involves encouraging users to speak to their devices. Microsoft believes people will increasingly rely on conversational interactions, allowing its Copilot assistant to perform tasks on their behalf. Mehdi emphasizes that with user consent, the AI should understand context, observe on-screen activity, and take meaningful action. To support this, a new “Hey, Copilot!” wake word is being introduced, positioning voice as a third primary input method alongside the keyboard and mouse.

This is not Microsoft’s first attempt to popularize voice control. A decade ago, Cortana offered similar promises but failed to gain widespread adoption. The company now believes advances in AI will finally change user behavior. Internal data, including billions of minutes spent on voice and video calls through Microsoft Teams, suggests people are already comfortable talking through their computers. Mehdi predicts this familiarity will help voice interaction feel natural in everyday computing.

For AI to effectively assist users, it needs to perceive what is happening on the screen. Copilot Vision, now rolling out globally, enables the AI to analyze screen content and provide contextual support. It can guide users through applications, troubleshoot issues, offer step-by-step instructions for new tasks, and even assist in games. Unlike the controversial Recall feature, which automatically captured snapshots, Copilot Vision requires users to opt in and stream their screen, similar to sharing in a video call.

Beyond observation, Microsoft is developing Copilot Actions, which allow the AI to perform tasks directly on the device. Early tests include editing folders of photos, though the capability is currently limited. Navjot Virk, corporate vice president for Windows Experiences, acknowledges that the AI may make mistakes with complex applications initially. For this reason, the feature is being introduced cautiously through a preview program, with plans to refine it based on user feedback.

Microsoft is also integrating Copilot more tightly into the Windows taskbar, offering one-click access to Vision and Voice tools. A new unified search helps users quickly locate files, apps, and settings. Still, the company faces skepticism. Following the privacy concerns raised by Recall, convincing users to trust AI with screen access and system control will be challenging. Similarly, persuading people to regularly talk to their PCs remains an uphill battle.

Undeterred, Microsoft is launching a television campaign with the tagline “meet the computer you can talk to.” The advertising push aligns with the end of support for Windows 10, encouraging upgrades to Windows 11. Mehdi sums up the ambition: Microsoft wants every user to experience a PC that acts not just as a tool, but as a true partner.

(Source: The Verge)