DeepSeek releases V4.1 Flash, a 552B MoE model with 1M-token context

🚀 RELEASES & LAUNCHES

• DeepSeek releases V4.1 Flash, a 552B MoE model with 1M-token context
  DeepSeek released V4.1 Flash, a multimodal 552B-parameter MoE model with a 1M-token context window.
  • The model targets developers building multimodal AI applications and is available on Hugging Face.
  • V4.1 Flash uses a new Causal-Encoder-Decoder architecture with native visual understanding and up to 1 million tokens of context.
  • Its 552B-parameter MoE activates 8B input-side and 16B output-side parameters.
  • The asymmetric design is intended to improve inference speed, throughput, and cost for builders.
  Sources 📄 Source: mp.weixin.qq.com · 📎 Coverage: reddit.com · 👁 via r/LocalLLaMA (+6)

🔬 RESEARCH

• LocalLLaMA users discuss CEA’s split architecture for GPU-specialized inference
  A LocalLLaMA post discusses CEA’s encoder-decoder split for heterogeneous inference.
  • The discussion targets local LLM users and inference operators.
  • CEA is described as separating encoder-prefill and decoder phases.
  • The split could allow prefill- and decode-specialized GPUs in heterogeneous pools.
  • The post mentions a 4× MI50 plus 2× V620 setup and says 4.1 Flash would not fit.
  Sources 📎 Coverage: reddit.com · 👁 via r/LocalLLaMA