📊 BENCHMARKS & EVALS
- UPDATE: Qwen3.8 Flash Next reaches 45 tok/s on an M4 Max locally
Qwen3.8 Flash Next runs locally at 45 tok/s on an M4 Max.- Local LLM users with Apple Silicon Macs or multi-GPU systems can run the model.
- The 125B-parameter MoE multimodal model supports a 262K-token context window and requires at least 75GB of memory in its smallest quantization.
- Benchmarks report 45 tok/s on an M4 Max, 25 tok/s on an M2 Ultra, and 55–61 tok/s on four RTX 3090s with vLLM.
- The reported throughput makes the model practical for local agentic workloads and tool-calling loops.
Sources 📎 Coverage: mindstudio.ai · 👁 via r/LocalLLaMA