lemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 3 months agoOpensource AI Must Winopensourceaimustwin.comexternal-linkmessage-square106linkfedilinkarrow-up1283arrow-down120
arrow-up1263arrow-down1external-linkOpensource AI Must Winopensourceaimustwin.comlemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 3 months agomessage-square106linkfedilink
minus-squaremabeledo@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·edit-22 days agodeleted by creator
minus-squareshortwavesurfer@lemmy.ziplinkfedilinkEnglisharrow-up4·3 months agoI ran it on my 8GB RAM desktop.
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·3 months agoI got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·3 months agoIf the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM
deleted by creator
I ran it on my 8GB RAM desktop.
deleted by creator
I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
deleted by creator
If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM