At last, a good reason to buy an AI PC: Reining in runaway token bills
Corporate PC buyers haven’t rushed to buy AI PCs but analyst firm Gartner thinks the machines can now do an important new job: Running AI workloads on the desktop to provide a hedge against tearaway token bills.
The firm on Monday published a Strategic Roadmap for Agentic AI PCs in which Research Vice President Steve Kleynhans argues that enterprise AI tools that run on the desktop “have been slow to materialize.”
“On -device AI has yet to achieve mainstream adoption and remains largely confined to developer and enthusiast use cases,” he added.
REG AD
He thinks that’s about to change as businesses are paying more attention to the cost of cloud-based AI, and especially “Tokenomics,” the frustratingly imprecise science of trying to figure out how each AI service provider defines a “token” and charges for them at different times.
REG AD
“As enterprises gain a better understanding of AI cloud cost dynamics, many are looking to AI PCs as a potential offset,” Kleynhans wrote. “Enterprises are becoming increasingly concerned about the economic sustainability of cloud-centric AI strategies as token consumption and associated usage costs continue to rise, driving greater interest in a hybrid strategy, by identifying workloads that can be processed more efficiently at the edge or on the device itself.”
The analyst admits “there is no consensus yet on the level of cost benefit” but feels the potential for savings is “clear.”
The main reason for his optimism is advances in development of small language models (SLMs), small reasoning models (SRMs), and targeted domain-specific language models. He’s not alone in that opinion: The Register recently covered the likes of Microsoft and Google using smaller models for some tasks.
MORE CONTEXT
- Microsoft: Removing some Copilots will improve Windows 11
- Yes! It's true! Windows 11 is an agentic platform
- Memory crunch sends PC prices into double-digit climb
- Microsoft has mostly repaired flaw in Surface hardware that allowed unprotected devices to be bricked by a single packet
-
Security GitHub AI agent leaks private repos when asked nicely
-
applications Microsoft to switch off OWA Light after nearly two decades
-
software Court tosses Microsoft's appeal in pre-owned software licenses battle
-
ai and ml Even banks and hyperscalers are now sounding the alarm about the AI bubble
-
DevOps HTTP gets a QUERY method so complex searches can stop pretending to be POST - AI and ML OpenAI hides Codex agent instructions behind encryption, leaving developers in the dark Developers worry encrypted MultiAgentV2 messages will make debugging and auditing harder
- AI and ML If you want Claude to speak nicely to you, try Hindi or Arabic Anthropic finds Claude expresses different values across languages
- ai and ml New York becomes first state to halt datacenter buildouts 50 MW-plus bit barn builds on hold while Empire State hashes out rules to protect the environment and ratepayers
- on-prem IBM's mainframe sales get mugged by AI hardware panic, stock sheds more than a quarter of its value CEO Krishna: Customers blew their Z budgets on servers and storage before prices spike, Q2 financials 'disappointing'
- AI and ML Anthropic's extravagant tokenizer complicates AI pricing Token consumption doesn't tell the whole tale but it shouldn't be ignored
- Security Russians are posing as Signal support to launch phishing attacks PLUS: US takes down Iranian propaganda sites; Marketing company asks 'Why Do We Have Your Information?' And more!
- Security Microsoft patches failed to fix on-prem SharePoint, which is now under zero-day attack PLUS: China upgrades smartphone surveillance tools; Ring eases anti-snooping stance; and more
- Black Hat and DEF CON DEF CON Franklin project enlists hackers to harden critical infrastructure Voting village reports have been so successful, says Jeff Moss, that the whole of DEF CON will now be included
- Security EQT buys majority share in Swiss cybersecurity biz Acronis Went at equivalent of $3.5B+ valuation for entire firm, though portion sold not specified
- Malware Month Ten years since the first corp ransomware, Mikko Hyppönen sees no end in sight On the plus side, infosec's a good bet for a long, stable career
- Baddies caught exploiting extensions bugs with perfect 10 scores on vulnerable Joomla websites Flaws in iCagenda, Balbooa Forms extensions can impact open source CMS that powers a million sites worldwide
- Frame: A new X11 server – implemented directly in assembly Joins yserver, Phoenix, and of course XLibre – and outlier Arcan
- Cinnamon 6.8 will support Wayland – if you want it Next version of Linux Mint’s desktop has both kinds of display server
- KDE Plasma users face a dire omen of change: 6.6.6 arrives 6.7 is now current, and in 6.8 you're getting Wayland whether you like it or not
- Collabora releases CODE 26.04 as rivalry between FOSS cloudy office suites heats up Now with Markdown support and smarter formula error handling – plus integrated AI, though it's off by default
- Blast from the past as GIMP 0.54 is revived in Flatpak form Retro-computing fun for the nostalgic with first (and last) release to use Motif instead of GTK
Kleynhans thinks some of these smaller models will happily run on today’s AI PCs, which pack neural processing units capable of at least 50 TOPS performance.
Again, he notes that polished tools for enterprise users are yet to materialize. But he thinks that the likes of OpenClaw, plus on-device AI tools such as Claude Cowork, Microsoft Scout, and OpenAI Codex, will show enterprise buyers what’s possible – and spark greater interest in AI PCs.
“Local AI models will support speech, chat, image, audio, and text generation, as well as application and model orchestration,” he predicts. “SLMs and SRMs will power always-on personal assistants and agents, fundamentally changing how users interact with their devices.”
The analyst thinks “Many routine tasks will be executed locally, with personal agents coordinating work across applications, models, and services operating both on the device and in the cloud.”
The analyst therefore offered two numerical predictions:
REG AD
By 2029, 30 percent of enterprises will be using AI PCs to reduce their cloud AI token costs;
By 2030, 70 percent of the corporate PC installed base will be capable of running some local GenAI workloads.
All those desktop AI workloads will complement clouds, which will continue to handle the most demanding workloads. But Kleynhans thinks mature AI models “will increasingly migrate to the endpoint as they become optimized for smaller systems, transforming the PC from a simple endpoint into a critical component of the broader AI infrastructure.”
Another stimulus will be the increasing power of AI PCs, which Kleynhans thinks will become ten times more powerful by 2031.
The analyst therefore thinks PC buyers need to think about AI PCs as part of an organization’s IT infrastructure and develop an ROI model based on token cost displacement.
“Initially this will be most appropriate for developers but make the discussion part of any new AI deployment for all employees,” he suggests. Another of his recommendations is to start this effort in earnest once third-gen AI PCs appear in 2027. Starting to experiment with SLMs and SRMs is another activity Kleynhans thinks is worthwhile. ®
[](https://www.facebook.com/sharer.php?u=https%3A%2F%2Fwww.theregister.com%2Fpersonal-tech%2F2026%2F07%2F15%2Fat-last-a-good-reason-to-buy-an-ai-pc-reining-in-runaway-token-bills%2F5271589) [](https://twitter.com/intent/tweet?url=https%3A%2F%2Fwww.theregister.com%2Fpersonal-tech%2F2026%2F07%2F15%2Fat-last-a-good-reason-to-buy-an-ai-pc-reining-in-runaway-token-bills%2F5271589) [](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fwww.theregister.com%2Fpersonal-tech%2F2026%2F07%2F15%2Fat-last-a-good-reason-to-buy-an-ai-pc-reining-in-runaway-token-bills%2F5271589) [](https://bsky.app/intent/compose?text=At%20last%2C%20a%20good%20reason%20to%20buy%20an%20AI%20PC%3A%20Reining%20in%20runaway%20token%20bills%0Ahttps%3A%2F%2Fwww.theregister.com%2Fpersonal-tech%2F2026%2F07%2F15%2Fat-last-a-good-reason-to-buy-an-ai-pc-reining-in-runaway-token-bills%2F5271589) [](https://www.reddit.com/submit?url=https%3A%2F%2Fwww.theregister.com%2Fpersonal-tech%2F2026%2F07%2F15%2Fat-last-a-good-reason-to-buy-an-ai-pc-reining-in-runaway-token-bills%2F5271589&title=At%20last%2C%20a%20good%20reason%20to%20buy%20an%20AI%20PC%3A%20Reining%20in%20runaway%20token%20bills) [](https://api.whatsapp.com/send?text=At%20last%2C%20a%20good%20reason%20to%20buy%20an%20AI%20PC%3A%20Reining%20in%20runaway%20token%20bills%0Ahttps%3A%2F%2Fwww.theregister.com%2Fpersonal-tech%2F2026%2F07%2F15%2Fat-last-a-good-reason-to-buy-an-ai-pc-reining-in-runaway-token-bills%2F5271589)
REG AD