View Ridge Security
Back to The Rollout

Agnes-AI releases 33B open-weight multimodal Agnes-3.0-Flash

A 33B open-weight multimodal model launches, a custom runtime speeds DeepSeek on A100s, and Perplexity deploys GPT-6 Astra across production.

๐Ÿš€ RELEASES & LAUNCHES

  • Agnes-AI releases 33B open-weight multimodal Agnes-3.0-Flash
    Agnes-AI released Agnes-3.0-Flash, a 33B open-weight multimodal model with a 262K-token context window.
    • Agnes-3.0-Flash targets developers seeking local, flagship-class reasoning across text, image and video tasks.
    • The model supports adjustable reasoning effort, tool calling and a 262,144-token context window.
    • Its 72-layer hybrid architecture uses 54 recurrent delta-rule layers and 18 global-attention layers.
    • The model card reports scores of 74.20 on IFBench, 38.08 on SciCode and 85.05 on GPQA Diamond.
    • Weights are available under Apache-2.0 and can be served with Transformers, vLLM or SGLang; the architecture limits context-growing KV cache to the global-attention layers.
    Sources ๐Ÿ“„ Source: huggingface.co ยท ๐Ÿ“Ž Coverage: artificialanalysis.ai ยท ๐Ÿ‘ via r/LocalLLaMA

๐Ÿ“Š BENCHMARKS & EVALS

  • Custom runtime runs DeepSeek-V4.1 Flash on A100 GPUs at up to 62 tok/s
    An open-source runtime enables DeepSeek-V4.1 Flash inference on A100 GPUs.
    • For developers with A100 hardware, including multi-GPU servers and single-GPU setups.
    • The runtime runs the 552B MoE backbone and 196B Engram memory on 8ร— A100 80GB GPUs.
    • It reaches 52 tok/s with layer pipelining, 62 tok/s with expert parallelism, and 32โ€“35 tok/s on one A100 with CPU experts.
    • The OpenAI-compatible server supports streaming chat and completions despite A100 lacking FP8/FP4 tensor cores.
    Sources ๐Ÿ“„ Source: github.com ยท ๐Ÿ“Ž Coverage: reddit.com ยท ๐Ÿ‘ via r/LocalLLaMA

๐Ÿ’ฐ BUSINESS & FUNDING

Make AI adoption safer

Build practical guardrails around the AI tools your team already uses.

Explore Secure AI Adoption