# arXiv digest — 2026-07-10

> Satyajit Ghana — Head of Engineering @ Inkers Technology
> canonical: https://ai.thesatyajit.com/arxiv/2026-07-10
> papers: 6
## ★ DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding

- arXiv: 2607.08642v1 — [abs](https://arxiv.org/abs/2607.08642) · [pdf](https://arxiv.org/pdf/2607.08642) · [html](https://arxiv.org/html/2607.08642v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.08642)
- authors: Saw S. Lin, Jyh-Shing Roger Jang
- categories: cs.CL

**Abstract.** Speculative decoding accelerates LLM inference by drafting several tokens and verifying them in parallel. Block-diffusion drafters such as DFlash produce a draft block in one pass but model only per-position marginals; best-first tree methods such as DDTree expand candidate trees from those marginals. The released Domino drafter adds a GRU-based causal correction that makes each draft token's distribution path-dependent, a structure DDTree's factorized formulation cannot represent. We introduce DominoTree, a training-free best-first draft tree scored by Domino's conditional, non-factorized correction along each root-to-node path, made practical by restricting the per-node correction to a candidate top-M. On Qwen3-4B across eight benchmarks, DominoTree reaches up to 6.6x speedup over autoregressive decoding and the highest mean accept length of any evaluated method, up to 10.7 tokens per round, at every temperature we test. DominoTree constructs its tree with a GPU-native, CUDA-graph builder that is bit-identical to a reference Python implementation, so acceptance is unchanged, while keeping per-round tree construction cheap.

**Take.** We walked the mechanics of speculative decoding in the [DeepSeek dSpark piece](/articles/deepseek-dspark) — draft cheap, verify the whole block in one target pass. DominoTree's twist is that the draft *tree* is scored by a conditional, path-dependent correction (Domino's GRU head), so each root-to-node path carries its own distribution instead of the factorized per-position marginals a tree method like DDTree assumes. Training-free, with a CUDA-graph builder that's bit-identical to the reference so acceptance is unchanged, and up to 6.6x over autoregressive on Qwen3-4B at a mean accept length of 10.7 tokens/round. Honest read: the throughput edge over prior tree methods is decisive at T=0 but narrows to a tie (and a small loss) at high temperature — the win is real, not universal.

## ★ The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs

- arXiv: 2607.08734v1 — [abs](https://arxiv.org/abs/2607.08734) · [pdf](https://arxiv.org/pdf/2607.08734) · [html](https://arxiv.org/html/2607.08734v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.08734)
- authors: Baha Rababah, Cuneyt Gurcan Akcora, Carson K. Leung
- categories: cs.AI

**Abstract.** Post-training quantization is widely used to deploy large language models in resource-constrained settings, yet its evaluation relies almost exclusively on accuracy and perplexity. We show that these metrics fail to capture behavioral changes induced by quantization. We introduce correctness agreement, a decision-level metric that measures overlap in correct predictions between a base model and its quantized variants, independent of absolute accuracy. Across multiple models and quantization schemes from 8-bit to 2-bit, we find that behavioral divergence emerges under moderate quantization even when task performance appears preserved. To explain this effect, we analyze quantization as a structural operator on attention weights and quantify layer-wise distortions using statistical and distributional measures. Our results reveal non-linear breakpoints at low bit-widths and show that query and key projections are consistently more sensitive than value and output projections.

**Take.** This is the paper the quantization hype needs. Accuracy and perplexity say an INT4 model "matches" its base — this shows that's an illusion: introduce *correctness agreement* (do the two models get the same items right?) and behavioral divergence appears under even moderate quantization while the headline metrics look preserved. It localizes the damage, too — query and key projections are consistently more sensitive than value/output, with non-linear breakpoints at low bit-width. It's exactly the caveat we kept flagging around [native FP4 training](/articles/nemotron-nvfp4) and [rotation-based KV quant](/articles/turboquant-kv-cache): a matched loss or accuracy number is not behavioral parity, and you have to measure the behavior to know.

## BiSCo-LLM: Lookup-Free Binary Spherical Coding for Extreme Low-Bit Large Language Model Compression

- arXiv: 2607.08643v1 — [abs](https://arxiv.org/abs/2607.08643) · [pdf](https://arxiv.org/pdf/2607.08643) · [html](https://arxiv.org/html/2607.08643v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.08643)
- authors: Yuantian Shao, Peisong Wang, Zhilei Liu, Chuangyi Li, Yuanteng Chen, Pengcheng Xie, Yiwu Yao, Zhihui Wei, Jian Cheng
- categories: cs.LG

**Abstract.** Large language models are increasingly constrained by memory capacity, weight bandwidth, and checkpoint storage during deployment. Scalar or group-wise quantization is simple and compatible with efficient low-precision kernels, but its representation capacity becomes limited when the target budget approaches 2 bits per weight. Vector-quantized weight compression provides a richer block-level representation, but usually introduces explicit codebooks, index lookup, and additional storage. BiSCo-LLM is a codebook-free binary spherical coding framework: local weight chunks are mapped onto a unit hypersphere and binarized into compact spherical codes, so the main payload is a bit-packed sign stream rather than explicit VQ centroids; a residual stage encodes the reconstruction error without stored codebooks; and category-wise recovery distillation reduces the mismatch between local reconstruction and assembled model behavior. A small 8-bit protected-channel path stabilizes sensitive channels and is counted separately.

**Take.** Vector quantization gives you rich sub-2-bit weights but drags in explicit codebooks and index lookups; scalar/group quant is kernel-friendly but runs out of representation near 2 bits. BiSCo-LLM threads it — map weight chunks onto a unit hypersphere and binarize to a bit-packed sign stream (a *codebook-free* spherical code), then a residual stage buys back rate-distortion without stored centroids. Same "normalize into a nicer basis, then quantize" instinct as [TurboVec](/articles/turbovec). Watch the fine print though: the honest storage budget also counts the neural decoders, an 8-bit protected-channel path, and LoRA adapters — which is exactly where extreme-low-bit claims tend to hide the weight they saved.

## OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators

- arXiv: 2607.08766v1 — [abs](https://arxiv.org/abs/2607.08766) · [pdf](https://arxiv.org/pdf/2607.08766) · [html](https://arxiv.org/html/2607.08766v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.08766)
- authors: Hongyu Liu, Chun Wang, Feng Gao, Xuanhua He, Yue Ma, Ziyu Wan, Yong Zhang, Xiaoming Wei, Qifeng Chen
- categories: cs.CV

**Abstract.** We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout. OPSD-V reduces long-horizon degradation while preserving the original few-step inference path. The student follows the exact inference-time rollout, generating each chunk conditioned on its own previously generated KV cache; in parallel, the teacher is evaluated at the same student-visited denoising states but uses a cleaner AR-consistent temporal cache in which older history can be replaced by real-video context. This provides dense denoising-level corrective targets under on-policy AR cache dynamics, without changing the sampler, number of denoising steps, or inference-time cache mechanism. A user study prefers OPSD-V over the base models in 66.0% of overall-preference judgments.

**Take.** Few-step autoregressive video generators are fast but drift — error accumulates and motion goes limp over a long rollout. OPSD-V fixes it without touching the inference path: the student rolls out exactly as it will at test time (conditioned on its own KV cache), while a teacher is evaluated at the same denoising states but allowed a cleaner cache seeded with *real* video, giving dense corrective targets. It's the on-policy, cache-aware cousin of the training-free acceleration tricks in [MrFlow](/articles/mrflow-diffusion-acceleration) — and refreshingly, the win is reported as a preference study (66% overall) rather than one cherry-picked metric.

## Track2Map: Online Deformable SLAM with Motion-Aware Pose Optimization in Robotic Surgery

- arXiv: 2607.08408v1 — [abs](https://arxiv.org/abs/2607.08408) · [pdf](https://arxiv.org/pdf/2607.08408) · [html](https://arxiv.org/html/2607.08408v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.08408)
- authors: Tianyi Song, Sierra Bonilla, Xinwei Ju, Evangelos Mazomenos, Danail Stoyanov, Adam Schmidt, Omid Mohareri, Sophia Bano, Francisco Vasconcelos
- categories: cs.CV, cs.AI

**Abstract.** Gaussian splatting is the current state-of-the-art for dense, deformable 3D anatomy reconstruction in robot-assisted minimally invasive surgery; however, most pipelines are offline and depend on accurate camera trajectory priors (often from robotic kinematics), limiting applicability when priors are missing or noisy. Track2Map is an online 3D Gaussian Splatting pipeline that jointly optimizes camera trajectory and 3D deformable scene representation directly from surgical video, and due to its online nature effectively works as a SLAM method. To stabilize optimization under tissue motion and ambiguous visual cues, it introduces a track-anchored deformation initialization using dense 2D point tracks, and uses track statistics to disentangle camera motion from scene deformation by detecting static camera periods and reducing drift during incremental mapping. Experiments on StereoMIS improve reconstruction quality and camera trajectory over competing SLAM methods.

**Take.** Most deformable-anatomy reconstruction is offline and leans on a camera-trajectory prior from robot kinematics. Track2Map drops the prior and does it online — jointly optimizing camera pose *and* a deformable 3D Gaussian scene straight from surgical video, which makes it a genuine SLAM system. The bit that keeps it from diverging under tissue motion is the same problem [FAST-LIO2](/articles/fast-lio2-lidar-inertial-odometry) fights: it leans on dense 2D point tracks to initialize deformation and to detect static-camera periods, disentangling camera motion from scene deformation to cut drift. Gaussian-splat SLAM in a squishy, prior-free scene is a genuinely hard setting.

## On Exploring Input Resolution Scaling For Anytime LiDAR Object Detection

- arXiv: 2607.08391v1 — [abs](https://arxiv.org/abs/2607.08391) · [pdf](https://arxiv.org/pdf/2607.08391) · [html](https://arxiv.org/html/2607.08391v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2607.08391)
- authors: Ahmet Soyyigit, Shuochao Yao, Heechul Yun
- categories: cs.RO, cs.LG

**Abstract.** Making tradeoffs between execution latency and result utility (anytime computing) has been shown to enhance the performance of cyber-physical systems. We enable anytime computing for DNNs that process LiDAR point clouds for 3D object detection: a method that enables multi-resolution inference for models that process point clouds as pillars or voxels, allowing the input to be dynamically scaled and processed at the resolution needed to meet timing requirements. The memory-efficient approach requires deploying only a single DNN model rather than one per resolution. A deadline-aware scheduler selects the highest possible resolution for each input by predicting the execution time for all resolutions at runtime, which is challenging due to the irregularity of LiDAR point clouds. On nuScenes it significantly outperforms existing anytime approaches, and in a simulated autonomous driving system it enables collision-free navigation while avoiding unnecessary stalls.

**Take.** A tidy systems idea for real-time perception: instead of shipping N models trained at N resolutions, train one point-cloud detector that can be *run* at any resolution, then add a deadline-aware scheduler that predicts each resolution's runtime and picks the highest one that fits the time budget. Predicting runtime is the hard part, because LiDAR point clouds are irregular so cost isn't a clean function of input size. It's the anytime-computing counterpart to the latency discipline that matters in the [FAST-LIO2](/articles/fast-lio2-lidar-inertial-odometry) stack — trade a little accuracy to never blow the frame deadline.