• Avid Amoeba@lemmy.ca
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    1 day ago

    Local inference on AMD is getting crazy these days. 90-100tps decode for Qwen 3.8 Flash Next on a single R9700.