# arXiv digest — 2026-07-15

> Satyajit Ghana — Head of Engineering @ Inkers Technology
> canonical: https://ai.thesatyajit.com/arxiv/2026-07-15
> papers: 6
## ★ The Seriality Gap in Video Diffusion Models

- arXiv: 2607.13031v1 — [abs](https://arxiv.org/abs/2607.13031) · [pdf](https://arxiv.org/pdf/2607.13031) · [html](https://arxiv.org/html/2607.13031v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.13031)
- authors: Jorge Diaz Chao, Konpat Preechakul, Yuxi Liu, Yutong Bai
- categories: cs.LG, cs.CV

**Abstract.** When one ball strikes another, then another, video models should predict the consequences of each bounce. In controlled experiments on multi-ball hard-sphere dynamics, we find that the performance of standard bidirectional video diffusion degrades as the causal chain lengthens, even when provided more denoising steps. In a length-matched single-ball control, where ball-ball interactions are absent, the degradation largely disappears, isolating dependent-event structure rather than video length as the cause. Across intervention studies, methods that increase effective serial computation improve performance disproportionately, including autoregressive/blockwise generation and architectural depth. We identify this pattern as the seriality gap: a mismatch between tasks requiring growing serial computation and video diffusion models whose denoising loop does not provide scalable serial compute. We then prove that, for deterministic video prediction, denoising steps do not add serial computation beyond the backbone.

**Take.** A clean negative result with a proof attached — my favorite genre. On multi-ball collision dynamics, bidirectional video diffusion gets *worse* as the causal chain lengthens, and piling on denoising steps doesn't help; but a length-matched single-ball control (no interactions) barely degrades, which isolates dependent-event structure — not video length — as the culprit. They name it the seriality gap and prove that, for deterministic prediction, denoising steps add no serial computation beyond the backbone. Tellingly, the fixes that work — autoregressive/blockwise generation, more depth — are exactly the ones that add real serial compute. Sobering for anyone treating a video diffusion model as a physics simulator: the denoising loop is not the sequential reasoning you might assume it is.

## Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques

- arXiv: 2607.12829v1 — [abs](https://arxiv.org/abs/2607.12829) · [pdf](https://arxiv.org/pdf/2607.12829) · [html](https://arxiv.org/html/2607.12829v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.12829)
- authors: Daehoon Gwak, Minhyung Lee, Junwoo Park, Jaegul Choo
- categories: cs.LG, cs.AI, cs.CL

**Abstract.** Diffusion large language models (dLLMs) offer a theoretical advantage in parallel generation over standard autoregressive models. However, parallel generation alone does not guarantee practical speedups. Realizing this efficiency requires specialized inference mechanisms, such as diffusion-aware caching and reuse. As inference efficiency becomes a prerequisite for practical deployment, recent research has actively explored acceleration techniques across algorithms, architectures, and systems. However, rigorous comparisons remain difficult, as end-to-end latency stems from intricate trade-offs between algorithmic, architectural, and system-level factors that are often conflated in existing benchmarks. In this survey, we introduce a unified latency decomposition framework for dLLMs to disentangle these factors, categorize acceleration techniques along three axes (algorithmic innovations, architectural and system optimizations, and inference-time scaling), and provide guidelines for reproducible benchmarking.

**Take.** Diffusion LLMs promise parallel generation, but as I kept flagging writing up [iLLaDA](/articles/illada-diffusion-language-model), "parallel" on paper rarely means "fast" in practice. This survey is the useful corrective: a unified latency-decomposition framework that stops people conflating algorithmic, architectural, and system-level speedups, then a taxonomy of the acceleration zoo — diffusion-aware caching/reuse, architecture and system tricks, inference-time scaling — laid out along those axes. The honest through-line is that rigorous end-to-end benchmarking is genuinely hard because these factors trade off against each other, which is exactly why a single-number "5× faster" claim for a dLLM deserves suspicion. Read it as a map before you trust any diffusion-LM speedup.

## Audio-Native Speech Recognition with a Frozen Discrete-Diffusion Language Model

- arXiv: 2607.13013v1 — [abs](https://arxiv.org/abs/2607.13013) · [pdf](https://arxiv.org/pdf/2607.13013) · [html](https://arxiv.org/html/2607.13013v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.13013)
- authors: Harsha Vardhan Khurdula, Abhinav Kumar Singh, Yoeven D Khemlani, Vineet Agarwal
- categories: cs.AI, cs.SD

**Abstract.** Automatic speech recognition is dominated by autoregressive decoders that emit one token at a time. We ask whether a discrete diffusion language model can transcribe speech instead, refining a whole transcript in parallel over a small number of denoising steps. We train an audio-native interface for DiffusionGemma, a 26B mixture-of-experts model that generates text by uniform, random-token discrete diffusion rather than the absorbing-mask scheme common to recent diffusion language models. A frozen Whisper encoder supplies acoustic features, a lightweight projector maps them into the model embedding space, and low-rank adapters let the frozen backbone attend to the new modality. About 42M parameters are trained, which is 0.16 percent of the backbone. We find that the natural training objectives fail to ground the audio because their gradient reaches the projector only through attention that has already dismissed it. A connectionist temporal classification loss applied through the frozen output head breaks this deadlock. The resulting model reaches 6.6 percent word error rate on LibriSpeech test-clean, transcribes in roughly eight parallel steps regardless of utterance length, and uses a single adapter trained on six languages.

**Take.** A tidy bolt-on: freeze a 26B diffusion LM (DiffusionGemma, which denoises via uniform random-token corruption rather than the absorbing-mask scheme in [iLLaDA](/articles/illada-diffusion-language-model)), hang a frozen Whisper encoder plus a tiny projector and LoRA off it, and transcribe speech by refining the whole transcript in ~8 parallel steps regardless of length — training only 42M params, 0.16% of the backbone. The genuinely interesting part is a failure they had to engineer around: the natural objectives never grounded the audio because the gradient reached the projector only through attention that had already ignored it, and a CTC loss through the frozen output head broke the deadlock. 6.6% WER on LibriSpeech from a near-frozen model is a strong argument that diffusion LMs are a real substrate, not just a curiosity.

## ★ Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents

- arXiv: 2607.12790v1 — [abs](https://arxiv.org/abs/2607.12790) · [pdf](https://arxiv.org/pdf/2607.12790) · [html](https://arxiv.org/html/2607.12790v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.12790)
- authors: Xing Zhang, Guanghui Wang, Yanwei Cui, Ziyuan Li, Wei Qiu, Bing Zhu, Peiyang He
- categories: cs.AI, cs.CL, cs.MA

**Abstract.** Self-evolving agent systems improve by creating, revising, and retiring their own skills, but every such loop rests on a hidden assumption: a reliable evaluation metric already exists. In many real applications it does not. We make three claims. First, metrics can be evolved: our metric loop searches compositions of small drawback detectors under a full evolutionary lifecycle, trained to agree with a ten-item anchored reference set, regularized by consensus over unlabeled outputs, and audited against a held-out anchor it never reads, yielding a transparent, inspectable metric rather than an opaque judge. Second, since no metric exists to beat, the yardstick is recovering what an accurate metric would have enabled, and Double Ratchet, our co-evolution of the metric with a lifecycle-managed skill loop, does so: across code generation (MBPP+), enterprise text-to-SQL (Spider 2.0-Snow), and reference-free report generation, it retains 88 to 110 percent of the held-out lift achieved by the same skill loop driven by ground-truth labels.

**Take.** Every self-improving agent loop quietly assumes a reliable evaluation metric already exists — and in real applications it usually doesn't, which makes the whole loop circular. This paper evolves the *metric itself*: a searchable composition of small "drawback detectors" trained to agree with a ten-item anchored reference set, regularized by consensus on unlabeled outputs, and audited against a held-out anchor it never sees — so you get an inspectable metric, not an opaque LLM judge. Their "Double Ratchet" co-evolves that metric with the skill loop and recovers 88 to 110% of the lift you'd get from ground-truth labels on MBPP+, text-to-SQL, and report generation. A sharp answer to the problem lurking under every [multi-agent self-improvement](/articles/nous-hermes-moa) scheme: who grades the grader.

## Inhibited Self-Attention: Sharpening Focus in Vision Transformers

- arXiv: 2607.12881v1 — [abs](https://arxiv.org/abs/2607.12881) · [pdf](https://arxiv.org/pdf/2607.12881) · [html](https://arxiv.org/html/2607.12881v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.12881)
- authors: Peter R. D. van der Wal, Nicola Strisciuglio, George Azzopardi
- categories: cs.CV

**Abstract.** Vision Transformers (ViTs) have demonstrated remarkable performance in computer vision tasks. However, their self-attention mechanism often diffuses focus across background regions, relying on spurious correlations rather than object-relevant cues. Inspired by inhibitory mechanisms observed in biological vision systems, we propose the Inhibited Self-Attention (ISA), a novel self-attention that integrates inhibitory signals to enhance feature selectivity and suppress spurious responses. In contrast to conventional self-attention, which relies solely on positive attention values due to softmax normalization, our approach retains and utilizes negative attention scores to suppress irrelevant features and sharpen focus on objects of interest. Experiments across multiple datasets, including ImageNet-1k and COCO, and several robustness benchmarks demonstrate that ISA enhances object-centric selectivity, reduces shortcut reliance, and improves out-of-distribution generalization.

**Take.** Softmax attention is all-positive: every token can only *add* to the mix, so nothing can be actively suppressed. Inspired by inhibitory neurons in biological vision, ISA keeps negative attention scores so a ViT can push background and spurious features *down* instead of merely up-weighting the salient ones. The payoff is object-centric selectivity — less shortcut reliance, better out-of-distribution generalization on ImageNet-1k/COCO, and relevance maps that visibly tighten onto objects. It's a small change to the [attention](/articles/how-transformers-attention-works) primitive with an intuitive story: let attention say "no," not just "yes." Worth watching whether the same trick helps language models, where softmax's positivity is just as baked in.

## ViCo3D: Empowering LiDAR-based Collaborative 3D Object Detection with Vision Foundation Models

- arXiv: 2607.12959v1 — [abs](https://arxiv.org/abs/2607.12959) · [pdf](https://arxiv.org/pdf/2607.12959) · [html](https://arxiv.org/html/2607.12959v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.12959)
- authors: Haojie Ren, Songrui Luo, Lingfeng Wang, Yan Xia, Yao Li, Jing Li, Lu Zhang, Jiajun Deng, Yanyong Zhang
- categories: cs.CV

**Abstract.** LiDAR-based collaborative 3D perception in Vehicle-to-Everything (V2X) systems typically relies on fusing bird's-eye-view (BEV) features across agents. However, current BEV representations, typically extracted by LiDAR backbones trained from scratch, are geometry-dominated and lack general semantic priors, inherently limiting feature-level collaboration. Vision foundation models (VFMs) pretrained on large-scale image data learn general-purpose visual representations and could enhance agent-wise LiDAR BEV features, but adapting them is hard due to the image-point-cloud modality gap. ViCo3D projects point clouds onto the BEV plane as three-channel images so DINOv2 can extract BEV-space visual features from LiDAR inputs, introduces a multi-scale BEV fusion module to integrate these with LiDAR geometric features, and adopts an ego-centric cross-agent fusion strategy. On DAIR-V2X and V2XSet it achieves state-of-the-art 3D detection, with up to 1.8x greater collaborative gains than prior methods on DAIR-V2X.

**Take.** Collaborative V2X perception fuses bird's-eye-view features across vehicles, but those BEV features come from LiDAR backbones trained from scratch — geometry-rich, semantics-poor. ViCo3D's move is to render the point cloud as a three-channel BEV image so a frozen DINOv2 can pull general semantic priors out of it, then fuse those with the raw geometric features before sharing across agents. It reports state-of-the-art on DAIR-V2X/V2XSet and, more tellingly, up to 1.8x larger *collaborative* gains — the vision-foundation semantics are what make cross-agent fusion actually pay off. A nice bridge between the point-cloud world of [FAST-LIO2](/articles/fast-lio2-lidar-inertial-odometry) and the 2D foundation-model world.