Best resource I found told me to install the Ryzen AI software which should make it easy to try running models locally supported by the NPU. So I followed the guide on https://ryzenai.docs.amd.com/en/latest/rai_linux.html which was super annoying because I had to create a corporate account??? Anyway I created an account and followed the install instructions. Online it said python 3.10+ should be fine but when running it complained that I had python 3.13 so I installed pyenv and installed v3.10.17. It then ran but gave me a warning (or error) that zip
and linux-libc-dev
were missing. Installed zip and libc++
because apparently thats the package for arch. Still threw the errors after all so no idea what that was about.
Then I found this guide https://ryzenai.docs.amd.com/en/latest/llm/overview.html which linked me to an outdated install guide on github which told me to install lemonade-sdk.