AMD and Unsloth enable NPU inference for 100+ agentic AI apps on Ryzen AI PCs
AMD and Unsloth say more than 100 compatible agentic AI applications and workflows can now run local AI inference on AMD XDNA 2 NPUs through Unsloth Desktop on supported AMD Ryzen AI PCs. AMD says XDNA 2 NPUs are the first neural processing units supported by Unsloth Desktop. Apps send requests to the Unsloth Desktop API, and the Lemonade and FastFlowLM tools serve and run supported models on the NPU.
What it means
An NPU (neural processing unit) is a chip block built for AI math that can use less power than a GPU for steady workloads. AI agents are programs that carry out multistep tasks, and this lets compatible ones use the NPU while the CPU and GPU stay free for other work.
THE FINE PRINT
- The power-efficiency and resource-sharing benefits are AMD's claims; no measurements, benchmarks, or power figures were given.
- Only "supported" models and "compatible" apps work, and the source does not list which models or which Ryzen AI PC models are supported.
- Named tools include Hermes Agent, OpenClaw, Open WebUI, Cline, LangChain, and GitHub Copilot; the full list of 100+ apps was not provided.
SOURCEAMD Newsroom ↗