Articles

AIRA₁ (arXiv 2507.02554, July 2025) formalizes AI research agents as graph search over five operators and finds operator quality — not search sophistication — drives MLE-bench medal rate, while a 9–13 point validation/test gap quietly caps every strategy. AIRA₂ (arXiv 2603.26499, March 2026) names three bottlenecks almost word-for-word out of AIRA₁'s own Limitations section and re-measures each fix with controlled ablations. Its own April revision then audits its highest-profile new result and finds 5 of 11 claimed wins on a second benchmark were answer-key extraction, benchmark-set training, and pretrained-model contamination — worth holding next to the still-unpublished AIRA₃'s tease of 'unhackable, live tasks on the track to real RSI.'

Essential·22 min · agents · benchmarks · evaluation · reward-design · mle-bench · explainer

Audio8's own framing for its two-month run of on-device audio releases is that it's more than a pile of checkpoints — model design, a technical report, deployment-aware export, and ONNX/INT8/INT4/iOS-ANE variants tuned to different memory and power budgets. Enumerated through the Hugging Face API across all 12 repos, with real byte sizes and safetensors headers read directly: the 0.1B ASR model gets a full precision ladder and a Swift/Core ML iPhone SDK, but ARK-ASR-3B — the most-downloaded checkpoint in the whole family — ships with zero official quantized or edge variants, and GPA-v1.5's own promised ONNX bundle redirects to an unrelated third-party account. Both ASR-line size names undercount their own true end-to-end parameter count, by a shrinking margin the shared audio encoder explains exactly.

Essential·18 min · audio · asr · tts · on-device · quantization · explainer

Extropic's Z1T pairs a probabilistic sampling chip with an FPGA to run transformer-like models, leading with 'over 100x energy efficiency gains vs GPUs' while a rounder 140x circulated separately — both numbers trace to one cell in a three-row table, the row where the H100 baseline runs at 10% utilization, well below the ~40% Extropic's own citation gives for real LLM serving. A walk through what a 'sample' costs on hardware whose physical primitive is a stochastic pbit with 16 fixed neighbors rather than a dense multiply-accumulate, what survives of a transformer once its primitives are rebuilt around that constraint, why every Z1-side number in the post is a projection anchored to a different, earlier chip rather than a measurement on Z1 silicon, and what the scaling law actually is — and isn't yet.

Essential·19 min · hardware · scaling-laws · efficiency · architecture · explainer

inclusionAI's Ling-3.0-flash-Fin continues training Ling-3.0-flash on financial data under an unchanged architecture — config.json and a full safetensors shape audit across all 65 shards confirm the tensors are byte-identical to the base model. A from-scratch parameter count puts the real total at 127.49B, with the announced '124B' landing exactly on the 124.41B backbone once the ~3.07B multi-token-prediction head is excluded, and '5.1B active' reproducible from config.json alone. It ships alongside FinFIRST, a 123-task benchmark graded through 701 atomic criteria across sourcing, raw data and computation rather than final-answer matching — inspected here record by record, with the model's 82.45% source-verification score checked against the paper's own 15-model table, and the widely repeated 'Intelligence Index 38 to 41' claim checked and found unverifiable.

High·20 min · finance · mixture-of-experts · benchmarks · agents · open-weights · explainer

MiniCPM5-2B ships with no tech report of its own — the model repo's only arXiv tags are MiniCPM4's paper and a data-tiering paper, and the closing BibTeX block still cites MiniCPM4. What config.json shows instead: a plain LlamaForCausalLM, 2.52B parameters marketed as '2B,' and an 8:1 GQA ratio that is the entire reason a 131,072-token context fits in 8GB of VRAM. The KV-cache arithmetic reproduces a real report — Q4_K_M at 7.2GB, Q8_0 at 8.2GB — almost to the byte, alongside the 34-benchmark evaluation table, the RL+OPD training recipe, DSpark's speedup decay with context, and day-0 deployment across nine chip architectures.

Essential·26 min · llm · on-device · gqa · kv-cache · quantization · speculative-decoding · long-context

Next-Latent Prediction adds one auxiliary loss to ordinary next-token training: predict your own next hidden state, from the current one plus the next token, with a stop-gradient — not an EMA target, not a VQ codebook, no separate encoder anywhere — preventing collapse. Checked against the paper's own Table 1: 'compact' means a 3x lower effective-latent-rank than GPT on a Manhattan-taxi world-modeling benchmark (52.7 vs. 160.1), but MTP is a much closer second (57.7) than the headline comparison suggests, and the strongest evidence for an actual world model is a metric most readers will skip past — how often two different routes to the same place produce identical continuations. Plus what changed between the November 2025 submission and the current revision, and a paper id that circulated attached to an unrelated claim.

Essential·23 min · world-models · representation-learning · transformers · self-supervised-learning · explainer

Sparse attention cuts attention compute, but two problems survive it: the KV cache still grows with sequence length, so offloading it to CPU memory hits a PCIe wall; and the block-selection step that makes attention sparse is itself O(T²) and can dominate at long context. SparDA (NVIDIA, MIT, and co-authors now at Thinking Machines Lab / ByteDance Seed) adds a fourth per-layer projection — Forecast — that predicts next-layer's KV blocks early enough to prefetch them during this layer's compute, and collapses block-selection to one head per GQA group. On MiniCPM4.1-8B and NOSA-8B: 1.25× prefill, 1.7× decode over the offload baseline, and up to 5.3× decode throughput over non-offload sparse — three numbers measured against two different baselines, worth keeping apart. Plus the honest ceiling: the Forecast is distilled from the original selector, so it inherits whatever that selector gets wrong.

High·23 min · sparse-attention · kv-cache · long-context · inference-optimization · gqa · explainer

Microsoft's tgrep pre-builds a trigram index so regex search only touches files that could match, and it now powers grep inside GitHub Copilot CLI. The README says up to 52x faster than ripgrep — in fine print, 'index pre-built.' A full read of tgrep-core's Rust source: the trigram-to-regex query planner and exactly where it degrades to a full scan, the client/server architecture and file watcher, the fuzz suite, and — since neither BENCHMARKS.md nor the README does this math — the actual number of queries it takes for the one-time index build to pay for itself, computed from BENCHMARKS.md's own numbers.

High·33 min · systems · rust · search · information-retrieval · explainer

arXiv 2506.18233 trains roughly fifty small GPT-2s plus one LoRA-tuned LLaMA-3.2-3B to ask whether reusing transformer layers decouples reasoning from knowledge. It measures knowledge as absorbed entropy on a random-token memorization task and reasoning as iGSM math accuracy, and every comparison in it is parameter-matched, never compute-matched -- a fact the paper itself never states.

Notable·22 min · llm · looped-transformers · recurrent-depth · scaling-laws · architecture · explainer

A chilli-leaf-disease classifier gets pruned with a Hessian-curvature signal, distilled with attention maps, and quantized to INT8 — three techniques chained into one pipeline, 327 MB down to 6 MB. The paper's own tables let you check whether those three techniques' gains actually add up, and its most honest result is the one comparing the full pipeline against just training a same-size model from scratch.

High·26 min · vision-transformers · model-compression · pruning · quantization · knowledge-distillation · edge-ai · agriculture

A low-rank subspace estimated from non-speech calibration audio, projected out of Whisper's decoder activations at inference with no retraining, takes non-speech hallucination rate from 31.31% to 2.44% averaged across three model scales and three benchmarks. It is the identical move Arditi et al. used to ablate refusal directions — a contrastive subspace found by SVD, subtracted from activations — run to remove a failure mode instead of a safeguard. The paper's own tables carry the honest cost: even the gated variant it recommends for deployment raises LibriSpeech WER by 0.33 to 4.39 points, and its own baseline table shows a stock external VAD beating it on speech quality by a wide margin.

High·20 min · whisper · asr · speech · interpretability · activation-steering · inference-time · explainer

125B parameters plus 51B of N-gram embeddings, 6B active, trained for about a ninth of what its predecessor cost. Three of every four layers are Gated DeltaNet; the fourth uses a sparse attention that indexes micro-blocks rather than tokens. But the reason to read this release is the technical report, which keeps finding places where training loss and downstream accuracy point in different directions — and says so. Updated: a llama.cpp fork ships flags dedicated to this model, and tracing --no-ngram through its loader shows the reported speed number runs with the 51B-parameter table this article covers switched off entirely — 0 bytes, no documented cost. Second update: three more treatments of that same table, checked against their own sources — a DGX Spark recipe that keeps it fully resident at ~5 bits (30.4 GB, the opposite bet from --no-ngram), a second Spark kit that re-quantizes it to NVFP4 and demand-pages it (26.8 GB, verified), and NVIDIA's own official NVFP4 release, which leaves it at FP8 untouched (47.7 GB) — the least compressed of any of them.

Essential·40 min · qwen · moe · linear-attention · sparse-attention · long-context · open-weights