Google open-sources ML Drift for cross-platform on-device GPU

🚀 RELEASES & LAUNCHES

• Google open-sources ML Drift for cross-platform on-device GPU inference
  Google open-sourced ML Drift, a cross-platform GPU engine for on-device AI inference.
  • ML Drift is for developers building on-device AI and graphics experiences across mobile, web and desktop platforms.
  • The Apache 2.0 engine supports OpenGL ES, OpenCL, Metal and WebGPU as a standalone library and LiteRT’s GPU backend.
  • It adds tensor virtualization, custom shader registration and native 5D tensor support for models including YOLO 11n, MobileViT v2 and Swin Transformer v2.
  • Stage-aware LLM kernels and other optimizations deliver up to 12% lower memory overhead in Gemma benchmarks.
  • Google says YouTube Shorts cut average frame latency by up to 40% after migrating segmentation effects to ML Drift.
  Sources 📄 Source: github.com · 📎 Coverage: developers.googleblog.com · 👁 via r/LocalLLaMA

🔬 RESEARCH

• Ai2 replaces priority-based GPU scheduler with budgeted fair share
  Ai2 replaced its priority-based GPU scheduler with budgeted fair-share scheduling.
  • The system serves about 150 Ai2 researchers running LLM, VLM, robotics, and scientific-agent workloads on thousands of H100, B200, and B300 GPUs.
  • Ai2 replaced priority labels with hierarchical GPU-time budgets, fair-share allocation, and a workload contract capped at 8 hours of preemption protection.
  • In a 30-day rollout, teams received 98% of allocated GPU hours and cluster occupancy stayed at 98%.
  • Debug workload p90 queue wait fell from 2 hours to 30 seconds, while human-coordinated repairs dropped 74%.
  • The budget model makes GPU squatting consume a team’s allocation and allows unused capacity to be borrowed by other workloads.
  Sources 📄 Source: allenai.org · 📎 Coverage: huggingface.co · 👁 via Hugging Face Blog

📊 BENCHMARKS & EVALS

• GLM-5.3 Flash reportedly tops Artificial Analysis cyber index
  GLM-5.3 Flash reportedly ranked above Anthropic models on Artificial Analysis’s Cyber Index.
  • Developers and security researchers can access GLM-5.3 Flash as an open-weight model through Z.ai’s API and coding plan.
  • The model has 320B total parameters, 18B active parameters, native multimodal input, a 1M-token context window, and 128K maximum output.
  • Z.ai reports an Artificial Analysis Intelligence Index score of 57 at $0.045 per task on discounted pricing.
  • Anthropic separately reported that GLM-5.3 Flash built a working exploit chain for two known browser flaws at an API cost of $20.40.
  • The results position an inexpensive open-weight model for coding, agentic workflows, and cyber evaluation.
  Sources 📄 Source: docs.z.ai · 📎 Coverage: mixed-news.com · 👁 via r/LocalLLaMA

⚠️ INCIDENTS & SAFETY

• Nikon disqualifies microscopic video contest winner over generative AI use
  Nikon disqualified Ning Xu’s winning microscopic video for violating its generative-AI rules.

  • The ruling affects entrants in Nikon’s Small World in Motion scientific microscopy competition.
  • Ning Xu’s video of airway cilia was disqualified after Nikon found its AI use violated contest rules.
  • Nguyen Nam Nhat became the new first-place winner with a video of a roundworm and single-celled Dileptus.
  • Nikon said it will revisit the contest’s rules and evaluation procedures for future entries.
  Sources 📄 Source: nikonsmallworld.com · 📎 Coverage: petapixel.com · 👁 via The Verge AI, Ars Technica AI

• [RESEARCH] 📄 Source for Instinct adds AI agent to group chats with non-users — bsky.app