TheCornCollector@piefed.zip to LocalLLaMA@sh.itjust.worksEnglish · 17 days agoQwen3.6-35B-A3B releasedhuggingface.coexternal-linkmessage-square22linkfedilinkarrow-up146arrow-down12file-text
arrow-up144arrow-down1external-linkQwen3.6-35B-A3B releasedhuggingface.coTheCornCollector@piefed.zip to LocalLLaMA@sh.itjust.worksEnglish · 17 days agomessage-square22linkfedilinkfile-text
The Qwen3.5 models are still the best local models I’ve used, so I’m excited to see how this updated version performs.
minus-squareInfinite@lemmy.ziplinkfedilinkEnglisharrow-up5·17 days agoProbably 24 GB VRAM and 32-64 GB RAM for minimum specs with 4-bit quantization. This is a beefy boi.
minus-squarevenusaur@lemmy.worldlinkfedilinkEnglisharrow-up3·17 days agoThanks! Not for me yet. Hope to save up enough to get 24GB VRAM in near future.
Probably 24 GB VRAM and 32-64 GB RAM for minimum specs with 4-bit quantization. This is a beefy boi.
Thanks! Not for me yet. Hope to save up enough to get 24GB VRAM in near future.