🚀 RELEASES & LAUNCHES
ISTA-DASLab releases 2.5–3 bpw GSQ-RCO quants for Qwen3.8-27B
ISTA-DASLab released three GGUF quantizations of Qwen3.8-27B using GSQ and RCO.- The release targets local Qwen3.8-27B users running models through GGUF-compatible tools.
- Three GGUF variants are available at 2.50, 2.75, and 3.00 bits per weight, ranging from 8.4 GB to 10.1 GB, with a vision projector.
- GSQ learns scalar quantization grids and scales, while RCO assigns tensor precisions under a strict size budget using task-loss optimization.
- The methods provide learned precision allocation while remaining deployable in standard GGUF workflows.
Qwen3.8-Flash-Next Reaches 181 Tok/s Across Two DGX Sparks
Qwen3.8-Flash-Next reached 181 tok/s aggregate on two DGX Sparks.- For developers running large local models on NVIDIA DGX Spark systems.
- The 176B-parameter NVFP4 MoE ran across two 128GB GB10 nodes with tensor parallelism over a 200Gb RoCE link.
- Reported throughput reached 64 tok/s single-stream and 117 tok/s at two-way concurrency in one SGLang setup, while another reached 181 tok/s across about nine concurrent sessions.
- The recipes expose OpenAI-compatible APIs with up to 1M-token YaRN context and vision input, enabling local serving of the model on a two-node Spark cluster.
🔬 RESEARCH
Anthropic AI systems improve alignment training across 10 benchmarks
Anthropic researchers showed AI systems improving alignment training across 10 benchmarks.- The work is aimed at AI researchers and alignment teams automating model post-training.
- Automated Alignment Researchers improved performance on all 10 misalignment benchmarks without degrading overall performance.
- Each system searched literature, proposed methods, and trained models for 30-minute iterations.
- The best automated method matched or beat experienced human proposals within six hours at about $4 per hour versus $150 for human researchers.
- The results provide early evidence that automated alignment post-training could become practical, although benchmark quality and human oversight remain necessary.
Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AIAudit finds 64 of 443 GGUF quants use the wrong effective quantization
An audit found 64 of 443 GGUF files had effective quantization differing from their filenames.- The finding concerns developers and users downloading GGUF models from local-LLM repositories.
- An audit of 443 quants across 25 repositories found 64 affected files.
- When tensor rows are not divisible by 256, llama-quantize can silently substitute a roughly 4.5-bits-per-weight type while retaining the requested low-bit filename.
- On Nemotron-3.5-Lightning, four IQ2 files were reported to contain the same 4.58-bpw data under different names, complicating size and quality comparisons.
📊 BENCHMARKS & EVALS
- EchoNet benchmarks 9 open models on detecting fake sources in agentic search
EchoNet tested 9 open models on spotting misinformation during agentic search.- The benchmark targets open AI models used for agentic web-search systems.
- EchoNet gives agents factual questions and a synthetic web containing seeded misinformation.
- Test cases include fake pages, manipulated rankings, repeated false claims, fake majorities, and outdated knowledge.
- The benchmark measures epistemic arbitration: whether models trust prior knowledge or conflicting new sources.
Sources 📎 Coverage: reddit.com · 👁 via r/LocalLLaMA
💰 BUSINESS & FUNDING
- Lambda raises $1B in debt to buy Nvidia chips for Microsoft
Lambda raised $1 billion in private debt to buy Nvidia chips for Microsoft.- Lambda is an AI cloud provider serving Microsoft and other businesses.
- It raised $1 billion in short-dated private debt arranged by JPMorgan Chase.
- The financing will fund Nvidia GPU purchases that Lambda plans to lease to Microsoft.
- Lambda also closed a separate $926 million loan for Nvidia GB300 GPU infrastructure.
- The deal adds to more than $400 billion in AI-related debt raised globally in 2026.
Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI