Free AI Models
Qwen
Alibaba's family of open AI models, with sizes small enough to run locally on a consumer graphics card.
AI Model Local AI Open Source
Qwen is the local model on my desktop. It runs in LM Studio, and Cline uses it when I want to work in my AIOS without any cloud model involved.
As of writing this I’m on Qwen 3.5 9B. I picked it because it fits entirely on the 8 GB graphics card in my PC, which makes it about three times faster than the bigger model I tried first, which had to spill over into regular memory. It’s a smaller model, so it’s noticeably less capable, but for what I use it for, fast matters more.