Microsoft unveils Copilot+ PCs with generative AI capabilities baked in

We’ve been hearing rumblings for months now that Microsoft was working on so-called “AI PCs.” At a pre-Build event, the company spelled out its vision.

Microsoft is calling its version Copilot+ PCs, which CEO Satya Nadella described as a “new class of Windows PCs.” These contain hardware designed to handle more generative AI Copilot processes locally, rather than relying on the cloud. Doing so requires a chipset with a neural processing unit (NPU), and manufacturers such as Qualcomm have been laying the groundwork with chips like the Snapdragon X Elite. 

Microsoft is taking a partner-first approach to making Copilot+ PCs. Along with chipmakers like AMD, Intel and Qualcomm, major OEMs including Acer, ASUS, Dell, HP and Lenovo are on board. The first Copilot+ laptops are available to preorder today and they’ll ship on June 18. Prices start at $999.

Yusuf Mehdi, Microsoft EVP and Consumer Chief Marketing Officer, said during the event that the company has completely reimagined what a Windows PC is. He claimed that Copilot+ PCs are the most powerful PCs ever (we’ll need to see if that assertion holds up in real-world testing). Despite that, Mehdi said, the first generation of laptops are “unbelievably thin, light and beautiful.” 

Other AI PCs on the market deliver 10 TOPs (tera operations per second). To be dubbed a Copilot+ PC, a system will need to deliver at least 40 TOPs of NPU performance and have at least 16GB of RAM and 256GB of storage. Qualcomm claims the Snapdragon X Elite delivers up to 75 TOPs overall. But the pure specs matter less than what Microsoft is able to actually do with the hardware.

Mehdi also suggested Copilot+ PCs are 58 percent faster than M3-powered MacBook Airs (though it’s worth noting Apple has more powerful M3 chips in its laptops already and M4 chips on the way very soon). The company suggested that Copilot+ laptops will offer up to 22 hours of battery life while playing videos locally and up to 15 hours while browsing the web.

To help make all of this happen, the Windows Copilot Runtime has more than 40 AI models that are part of a new Windows 11 layer. They’re said to be deeply integrated into Windows to help them more efficiently access hardware and to power more robust privacy and security options. The models can work across any app, Microsoft says.

As far as the Windows features go, one aspect of Copilot+ PCs is something that’s been rumored for a while. It’s called Recall, and you can think of it as a more advanced version of the Timeline feature from Windows 10. You’ll be able to use natural language prompts to get your PC to resurface information based on what you remember about it. You’ll be able to scroll through apps, documents and messages on an explorable timeline.

According to Mehdi, Microsoft built Recall with responsible AI standards in mind. Data from it will stay on your PC and it won’t be used to train Microsoft’s AI models.

Additionally, you’ll be able to restore old snaps in Windows Photos using a tool called Super Resolution. In addition, the app will offer an option to tell a story based on your photos with the help of an AI narrator. Live Captions, meanwhile, will offer real-time captioning and translations into English from more than 40 languages (with more to come) from both live and pre-recorded video.

Microsoft now has its own upscaling tech (akin to NVIDIA’s DLSS) for games too. It’s called Auto Super Resolution and it’s said to use AI to upscale the resolution of graphics and improve refresh rates in real-time without impacting performance.

There’s also a new Copilot app that you can use as a standalone window, sidebar or in full screen. You’ll be able to drag and drop elements into Copilot from elsewhere in Windows. Thanks to the new Copilot key on keyboards, you’ll be able to fire up the app with the touch of a physical button. Copilot will eventually be able to let you adjust Windows settings too.

Given that Qualcomm uses Arm architecture, it’s perhaps little surprise that Microsoft has rebuilt Windows 11 for Arm-based chips. Microsoft has been trying to make Arm-based Windows PCs a thing for some time, with mixed results. We had major reservations about the Arm-powered Surface Pro 9 a couple of years ago. But perhaps the company has finally cracked that nut this time around. 

To help with that, Microsoft has developed an emulator called Prism that is said to be as efficient as Apple’s Rosetta 2. The aim is to help users run legacy x86/x64 apps without a hitch. Major apps such as Zoom, Chrome, Spotify and Photoshop will run natively on Arm-based Windows.

The Copilot+ PC is the natural progression of something we’ve seen in flagship Android phones over the last couple of years. The most recent Google Pixel devices, for instance, handle many generative AI processes on-device by tapping into the power of the company’s Tensor chips.

Meanwhile, Apple is largely expected to move into the generative AI space in a major way at its Worldwide Developers Conference next month. The M4 chip that recently debuted in the new iPad Pro is said to be capable of powering GAI experiences and that chipset should be coming to Macs later this year. Apple’s also said to be working on a deal with OpenAI, perhaps to bring its generative AI tech to Siri.

Catch up on all the news from the Microsoft Surface and AI event right here!

This article originally appeared on Engadget at https://www.engadget.com/microsoft-unveils-copilot-pcs-with-generative-ai-capabilities-baked-in-170445370.html?src=rss