I tried Deepseek Coder 33b; it runs at around 2 words/second which is really slow.

Deepseek Coder V2 16b; seems to run as fast Gemma3

I don’t know, it is running much faster than I can read.

So I’m not sure why more performance would be needed, the only thing I was looking for was big VRAM, and AMD gives much more bang for you buck (especially in NZ). To get 16GB of VRAM on an NV card in NZ would have set me back an extra $800…not something I was willing to do.

q4_k_m

8.1GB file size

I have ollama running locally on my RX9070, I have to use kernel 6.14 since it’s such a new GPU.

The 16G VRAM means I can run decent models, faster than I can read… currently running gemma3:12b, it’s crazy fast.

Works perfectly on my Asus Zenbook.

I don’t use it much, but it works.

• sshfs (mount a remote file system locally)
• sshuttle (tunnel your traffic over SSH, ephemeral VPN)
• mirror a remote port to a local port (I use this to manage syncthing on my server)