Models such as ChatGPT 4 (OpenAI) and Claude (Anthropic) run on cloud computing services using high-performance NVIDIA GPUs such as the A100 and H100. GPUs have been the go-to chips for AI compared to CPUs. Chip manufacturers such as Qualcomm, Intel, Apple and AMD are in the race to offer the best processors with integrated NPUs to improve on-device AI tasks. Expect NPUs to move from a niche offering on the latest processors to a default component in the standard processor. Businesses must be aware of these processors so that they can make the best choice for on-device AI tasks in terms of cost, suitability and performance.
Processor Overview
The Intel Core Ultra, AMD Ryzen 8040 series, Apple M3 and Qualcomm Snapdragon X are built for devices like desktops, laptops, mobile phones and tablets but we will focus on laptop processors, shown in Table 1. …