Eamonn Keogh challenges TSAD benchmarks with century-old SPC method

📊 BENCHMARKS & EVALS

• Employee-shared benchmarks test Qwen3.7-27B on two Tenstorrent P300Cs
  An employee-shared test benchmarked Qwen3.7-27B on two Tenstorrent P300C cards.

  • The results target local-LLM users evaluating Tenstorrent QuietBox 2 hardware.
  • The benchmark used two P300C cards, which the poster said perform like four P150 cards.
  • The P300C is described as a P150-class card with 64GB of GDDR6, though it is not sold individually.
  • The tested setup did not support multi-token prediction (MTP).
  • The post adds scarce benchmark data for builders assessing Tenstorrent hardware for local Qwen inference.
  Sources 📎 Coverage: reddit.com · 👁 via r/LocalLLaMA

• Eamonn Keogh challenges TSAD benchmarks with century-old SPC method
  Eamonn Keogh reported that statistical process control beat leading TSAD methods on benchmark datasets.

  • The finding targets researchers developing and evaluating time-series anomaly-detection methods.
  • Keogh tested the TSB-AD-M benchmark and reported that simple statistical process control, a roughly 100-year-old technique, beat state-of-the-art methods in most cases.
  • One example showed SPC achieving perfect results.
  • The report questions whether widely used TSAD benchmarks meaningfully distinguish advanced algorithms.
  Sources 📎 Coverage: reddit.com · 👁 via r/MachineLearning