What is an AI PC and Should You Buy One?

With 2024 on the horizon, ever louder mutterings point toward an AI PC becoming famous as the future of personal computing. But what exactly is an AI PC, and should you consider buying one? AI PCs have become a hot topic – this article explains what they are, how they differ from traditional PCs, and if this is an investment worth making.

What is an AI PC?

An AI PC is essentially a supercharged personal computer, specifically designed to handle artificial intelligence (AI) and machine learning (ML) tasks with greater efficiency. These tasks include generative AI programs like Stable Diffusion, sophisticated chatbots, comprehensive data analysis, AI model training, and running intricate simulations.

To put it simply, an AI PC is a turbocharged personal computer made solely for handling AI and machine learning workloads of higher efficacy. Examples include the tasks of Generative AI programs (like Stable Diffusion), complex chatbots, full data analysis and AI model training, simulation running wildlife ecosystems, etc.

The key components that set AI PCs apart from traditional ones are:

NPU (Neural Processing Unit): A specialized processor designed to handle AI tasks more efficiently than traditional CPUs (Central Processing Units) and GPUs (Graphics Processing Units). Dedicated processors for executing artificial intelligence tasks with higher efficiency than typical graphics cards.
Hardware: Faster and more powerful CPUs and GPUs with increased performance, enough RAM, and speedy storage systems to run high-performance AI workloads.
Software Integration: AI PCs come with AI-optimized systems like the upcoming Windows 12, equipped with features such as Microsoft Copilot.

The Role of NPUs

An NPU is a dedicated processor for AI workloads, much like how a GPU processes graphics. NPUs are parallel processors, making them essential for AI operations such as video decoding (moving objects), upscaling, and replacing the background, etc. They reduce the load on CPUs and GPUs, leading to more efficient performance and longer battery life in laptops. However current NPUs are not fully stand-alone and work alongside GPUs, and so in the future generations are expected to perform more on their own, increasing overall system efficiency.

Who’s Leading the Charge?

Several tech giants are heavily invested in the AI PC arena:

Intel: Intel’s Core Ultra chipsets include NPUs to further improve its AI capabilities.
AMD: AMD’s Ryzen 8000G series also includes NPUs, which are known as the “Ryzen AI” engine.
Apple: Since 2020, Apple has also joined this competition by introducing its first M-series processors with a neural engine.

These companies are not only incorporating NPUs but also working on defining the AI PC standards, such as Intel’s collaboration with Microsoft to include a physical Copilot key on keyboards.

These companies are not just adding NPUs but also establishing AI PC standards like Intel working with Microsoft to add a physical Copilot key on keyboards.

Performance: TOPS

A metric used to measure the performance of NPUs is called TOPS(Trillion Operations Per Second). This is quickly becoming the standard measurement for AI computing capacity. For example, the ability to run Microsoft’s Copilot AI service locally usually requires an NPU that has a capacity greater than or equal to 40 TOPS. At present, even Intel and AMD’s newest processors can barely hit 20 TOPS, while Qualcomm’s Snapdragon Elite X chips manage to obtain 45 TOPS.

What Windows 12 Will Bring to the AI PC World

Windows 12 may be a revolutionary change for AI PCs. One highlight: integration with Microsoft Copilot – an AI assistant that aims to increase productivity by lending a hand in tasks such as emailing, document summarization, or even image creation. The workforce involves an automated service that looks over your shoulder and does your work for you, only at the speed of light and without error. Windows 12 will also add better performance to the system by optimizing NPUs (Neural Processing Units). This then leads to more rapid initialization of any AI-based tasks without draining your laptop battery.

Should You Buy an AI PC?

Now, the million-dollar question: Should you invest in an AI PC right now?

Why Shop an AI PC:

Future-Proofing: When you buy an AI PC, you are prepping your machine for new technology that will make full use of AI going forward.
Improved Performance: AI PCs are better at doing more complex tasks than you can do like data analysis, graphic designing, and software development, which may go beyond home use for professionals.
Better Security: Processing data locally on an AI PC is more secure since it reduces the amount of potentially sensitive information that needs to be sent to cloud servers.
Improved Battery Life: NPUs can offload AI tasks from power-hungry CPUs and GPUs, resulting in longer battery life on laptops.

Current Limitations:

Early Adoption Risks: Just like any cutting-edge technology, simply plunking an early AI PC on your desk may not do a single thing more intelligent than any other system until more AI-optimized software gets developed.
Cost: AI PCs are expensive, as they include advanced hardware and NPUs that demand a lot of processing power.
Compatibility: Some AI PC features such as Microsoft’s Copilot, may require certain hardware options which the upcoming expected Windows 12 should support.

The new functions of the AI PC include background blur in the video call, AI-powered document summarization, and upgraded image/video editing tools. While these are useful, they are not groundbreaking. The real promise, though, is for future apps that would exploit the full horsepower of NPUs for advanced AI tasks.

Is an AI PC Right for You?

If you need a new PC and want it to be as future-proof as possible, an AI PC might make for good news. This is what makes AI PCs so appealing – some of the advantages can be had immediate support (improved multitasking and security), while others are somewhat promised future advancements. If you’re current PC is doing the job, then perhaps hold off to see where things go and become more mainstream. With AI as PCs and applications themselves are developed and used, the argument for their importance should crystalize – leading to more people believing that these are fine machines.