Replies from 28 February 2026

Yeah on my desktop I've only got it set up to use the GPU's VRAM, from what I've read it's not very efficient to try and get it to use system RAM, whereas Apple's Unified RAM means they can use system RAM and VRAM together for better overall performance

(Just pushed a fix for that link 404ing woops!)

Hopefully https://www.jvt.me/posts/2026/02/28/local-ai-usage/ helps answer some of that - happy to share anything else of note!