📊 BENCHMARKS & EVALS
- Task-aware Qwen3.8-27B quant retains 99% of BF16 reasoning performance
A task-aware Qwen3.8-27B quant retained 99% of BF16 reasoning performance at 15% of the size.- The quant is aimed at users running Qwen3.8-27B locally, with coding support planned next.
- The TAK (Task Aware Knapsack) quant scored 82.81% on reasoning tasks versus 83.59% for BF16 and 77.34% for Unsloth UD IQ2_S.
- TAK reduces the model to about 15% of BF16 size while preserving most reported reasoning performance.
- The pipeline specializes quantization around a target task, giving local-model builders a smaller reasoning-focused Qwen3.8-27B option.
Sources 📎 Coverage: reddit.com · 👁 via r/LocalLLaMA