Some abliterated models had lower reliability and quality, I heard. Is that still an issue, or has the dev community figured out how to avoid those pitfalls?
Was spitballing about various ideas, and occasionally Qwen would go all Chinese-ethical on me, no using open systems outside of stated design, no avoiding govt blocklists, etc etc.
depends on what their base model is. Most abliterated models start off with an already quantized model, so depending on the type and level of quantization, you’ve already lost some capability. Plus, I think there are two types of abliteration, so ymmv.
If you’re set on trying out Qwen, I highlugh recomment orcarouter’s models. Very well done and they start off with a good base model - well, actually now that I think about it, Qwen3.8 basically has one base model - the 27b one, right? So that’s that.
I like the Gemma-4-E4B for speed for response, and HauhauCS has done a good job of abliterating the model appropriately. However, it’s nothing compared to the A4B models, so if your hardware can take it, go for A4B over E4B always.
Like, TTFT? Or speed of tokens? Or something else? BTW what was the gate you initially hit with Qwen?
Some abliterated models had lower reliability and quality, I heard. Is that still an issue, or has the dev community figured out how to avoid those pitfalls?
Was spitballing about various ideas, and occasionally Qwen would go all Chinese-ethical on me, no using open systems outside of stated design, no avoiding govt blocklists, etc etc.
depends on what their base model is. Most abliterated models start off with an already quantized model, so depending on the type and level of quantization, you’ve already lost some capability. Plus, I think there are two types of abliteration, so ymmv.
My current go tos, in order are -
I’ve tried and hated - hf.co/DavidAU/L3.1-Dark-Reasoning-Dark-Planet-Hermes-R1-Uncensored-Horror-Imatrix-MAX-8B-GGUF:latest
If you’re set on trying out Qwen, I highlugh recomment orcarouter’s models. Very well done and they start off with a good base model - well, actually now that I think about it, Qwen3.8 basically has one base model - the 27b one, right? So that’s that.
I like the Gemma-4-E4B for speed for response, and HauhauCS has done a good job of abliterating the model appropriately. However, it’s nothing compared to the A4B models, so if your hardware can take it, go for A4B over E4B always.