AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs

Over the past two years AMD has developed the AMDXDNA accelerator driver in the mainline Linux kernel for supporting the AMD Ryzen AI NPUs. But when it comes to user-space software on Linux actually able to leave the Ryzen AI NPUs it's been... extremely limited with nothing really useful besides some niche bits of code. Even AMD's own software like their GAIA on Linux has used Vulkan with their iGPUs rather than any NPU support. But finally today there is a significant shift with the Ryzen AI NPUs becoming useful on Linux and able to handle LLMs...