# arXiv digest — 2026-07-01

> Satyajit Ghana — Head of Engineering @ Inkers Technology
> canonical: https://ai.thesatyajit.com/arxiv/2026-07-01
> papers: 7
Two threads dominate today. **On-policy distillation** keeps compounding — GR2 states
outright that SFT "collapses at industrial scale" and reaches for OPD instead, echoing
Agents-A1, MOPD, and DOPD from earlier this week; Cross-Space Distillation and browser
skill distillation attack the same teacher→student interface from the vision and agent
sides. And **long-horizon agents** get a rigorous, training-free way to vet their
intermediate-reward signals (QVal) — which promptly finds that simple prompting beats most
of the literature. The through-line: the leverage is in the interface and the verifier,
not the parameter count.

## ★ QVal: Cheaply Evaluating Dense Supervision Signals for Long-Horizon LLM Agents

- arXiv: 2606.32034v1 — [abs](https://arxiv.org/abs/2606.32034) · [pdf](https://arxiv.org/pdf/2606.32034) · [html](https://arxiv.org/html/2606.32034v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.32034)
- authors: Sergio Hernández-Gutiérrez, Matteo Merler, Ilze Amanda Auzina, Joschka Strüber, Ameya Prabhu, Matthias Bethge
- categories: cs.LG, cs.AI, cs.CL

**Abstract.** LLM agents increasingly act over long horizons, where a single trajectory can contain hundreds or thousands of actions. In these settings, outcome-only rewards provide too sparse guidance, failing to inform the model about the goodness of intermediate actions. Dense supervision methods aim to solve this problem by scoring intermediate steps, from intrinsic confidence to self-distillation and embedding similarities. However, it is common practice to evaluate them by measuring the downstream performance of a training pipeline that integrates them. This is expensive, conflates supervision quality with training engineering confounders, and renders different methodological families requiring distinct training setups incomparable. We introduce QVal, a training-free testbed for directly evaluating dense supervision signals. Given a state-action pair, QVal measures how well a method's score is Q-aligned: whether it orders actions according to the Q-values of a strong reference-policy. We instantiate QVal as QVal-v1.0, benchmarking 21 dense supervision methods across four diverse environments and seven methodological families, with over 1.2K evaluation experiments across six open-weight model backbones. We find that simple prompting baselines consistently outperform recent dense supervision methods from the literature, and that performance clusters strongly by family.

**Take.** Yesterday's [Agents-A1](/articles/agents-a1) made the case that verified intermediate steps — not outcome-only rewards — are what a long-horizon agent learns from. QVal asks the sharp follow-up: how do you know your step-scoring signal is any good *before* you spend a training run on it? Their answer is clean — score a state-action pair, then check whether the ordering matches the Q-values of a strong reference policy. Training-free, so you separate signal quality from training-pipeline luck. The result is the kind of finding that only falls out of an honest common-ground benchmark: across 21 methods and 1.2K experiments, plain prompting baselines beat most of the fancy dense-supervision machinery. A testbed that lets you kill bad ideas before the GPU bill.

## ★ Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers

- arXiv: 2606.32020v1 — [abs](https://arxiv.org/abs/2606.32020) · [pdf](https://arxiv.org/pdf/2606.32020) · [html](https://arxiv.org/html/2606.32020v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.32020)
- authors: Anh Nguyen, Ngan Nguyen, Duc Vu, Trung Dao, Viet Nguyen, Quan Dao, Khoi Nguyen, Anh Tran
- categories: cs.CV

**Abstract.** Modern one-step diffusion models achieve impressive quality through distribution-based timestep distillation. Yet, they rely on a critical assumption: Teacher and Student must inhabit the same latent space. This Shared-Space constraint prevents knowledge transfer from modern high-capacity Teachers (e.g., SD 3.5 and Flux) into compact, deployment-friendly Students such as SD 1.5, whose latent resolution and VAE parameterization differ from the Teacher. We formalize this overlooked regime as Cross-Space Distillation, where Teacher and Student differ in both latent resolution and VAE space. To enable distillation under this mismatch, we introduce the Bridge, a lightweight latent interface that maps Student latents into the Teacher space without modifying the Student backbone. Bridge combines a frozen Student VAE decoder as a spatial prior with a compact learnable projector, and is trained with latent reconstruction and attention fidelity objectives for stable Teacher-space alignment. Across diverse modern Teachers, Bridge enables substantial gains for compact one-step Students; for example, it improves SD 1.5 from 5.4 to 9.4 HPSv3 while preserving one-step inference, low latency, and broad ecosystem compatibility.

**Take.** Distillation almost always assumes teacher and student speak the same latent language — same VAE, same resolution. That quietly locks you out of the most useful transfer of all: pouring a modern high-capacity teacher (SD 3.5, Flux) into the small, beloved, ecosystem-rich SD 1.5. The move is a lightweight "Bridge" that maps student latents into the teacher's space without touching the student backbone, so the student stays one-step and deployable while learning from a teacher it structurally couldn't before. 5.4 → 9.4 HPSv3 on SD 1.5 is a big jump for a frozen-backbone adapter. The general lesson keeps recurring this week: the interface between teacher and student is where the leverage is.

## GR2 Technical Report

- arXiv: 2606.31984v1 — [abs](https://arxiv.org/abs/2606.31984) · [pdf](https://arxiv.org/pdf/2606.31984) · [html](https://arxiv.org/html/2606.31984v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.31984)
- authors: Yufei Li, Zaiwei Zhang, Mingfu Liang, Kavosh Asadi, Jay Xu, Hamed Firooz, Luke Simon
- categories: cs.IR, cs.AI

**Abstract.** Industrial recommendation systems serve billions of users through a multi-stage funnel -- retrieval, early-stage ranking, and re-ranking -- where the final re-ranking step disproportionately shapes user engagement. Despite growing enthusiasm for LLMs in recommendation, three gaps hinder industrial adoption: most efforts target retrieval and ranking, leaving re-ranking underexplored; LLMs are typically deployed zero-shot or via SFT, underutilizing RL on verifiable rewards; and deployed catalogs index billions of items with non-semantic identifiers outside any base-LLM vocabulary. We present GR2 (Generative Reasoning Re-Ranker), an end-to-end framework that combines mid-training on semantic IDs with >=99% uniqueness, reasoning traces distilled from a stronger teacher via rejection sampling, and RL with verifiable rewards purpose-built for re-ranking. To make GR2 resource-viable, we introduce a context compressor, On-Policy Distillation (OPD) as a scalable alternative to SFT -- which we find collapses at industrial scale -- and reasoning distillation for low-latency serving. GR2 delivers +18.7% R@1, +7.1% R@3, and +9.6% N@3 over legacy baselines on industrial-scale traffic. We further find that LLMs often hack rewards by preserving the incoming order or exploiting position bias.

**Take.** Two things make this more than a recsys report. First: another independent data point that **on-policy distillation is eating SFT** — they state flatly that SFT "collapses at industrial scale" and reach for OPD instead, the same conclusion Agents-A1, MOPD, and DOPD landed on this week from entirely different directions. Second: the reward-hacking honesty. Their re-ranking LLM learns to game the metric by just preserving the incoming order or riding position bias — exactly the failure mode you'd predict, caught and named, and patched with conditional verifiable rewards. Applying LLM reasoning to the re-ranking stage (the one closest to the user) with billions of non-semantic item IDs is a real systems problem, handled as one.

## Generative Skill Composition for LLM Agents

- arXiv: 2606.32025v1 — [abs](https://arxiv.org/abs/2606.32025) · [pdf](https://arxiv.org/pdf/2606.32025) · [html](https://arxiv.org/html/2606.32025v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.32025)
- authors: Xinyu Zhao, Zhen Tan, Vaishnav Tadiparthi, Nakul Agarwal, Kwonjoon Lee, Tianlong Chen
- categories: cs.CL

**Abstract.** Recent LLM agents benefit from skills for solving complex tasks. As skill libraries grow and become reusable across tasks and domains, selecting an appropriate skill composition has emerged as a central bottleneck. Existing approaches either expose the agent's reasoning to the entire skill collection or perform skill retrieval via embeddings or LLM-based rerankers. Both miss the structural nature of skill composition, which is a joint decision over which skills, how many, and in what order -- three dimensions that cannot be decoupled. We formalize this as structured skill composition: given a task and a skill library, predict an executable skill plan that jointly specifies the activated subset, count, and execution order. We propose SkillComposer, which uses a constrained autoregressive decoder over skill identifiers, so subset, count, and order emerge jointly from a single decoding pass. On GPT-5.2-Codex and Gemini-3-Pro-Preview, SkillComposer raises the pass rate by +23.1 and +18.2pp over the no-skill baseline, surpassing top-3 retrieval and matching the gold-skill retrieval upper bound at lower prompt-token cost.

**Take.** The framing is the contribution: skill selection isn't retrieval, it's *composition* — which skills, how many, in what order — and those three can't be chosen independently. Treating it as constrained autoregressive decoding over skill IDs, so the subset/count/order fall out of one pass, is the right shape for a joint decision with dependencies between steps. Matching the gold-skill upper bound at lower token cost is the number that matters: it means the plan is as good as knowing the answer, without stuffing the whole library into context. As agents lean harder on skill libraries (the [Claude-style](/articles/agents-a1) procedural-package trend), the router over those skills becomes the bottleneck, and this is a clean take on it.

## Scalable Behaviour Cloning on Browser via Skill Distillation

- arXiv: 2606.32014v1 — [abs](https://arxiv.org/abs/2606.32014) · [pdf](https://arxiv.org/pdf/2606.32014) · [html](https://arxiv.org/html/2606.32014v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.32014)
- authors: Kaisen Yang, Zheng Jiang, Yuzhao Peng, Houde Qian, Boshi Zhang, Bingxiang He
- categories: cs.CL

**Abstract.** Internet users collectively perform an enormous range of skilled work through web browsers, from software development and document editing to search, forms, and enterprise workflows, making human browsing a highly scalable but under-exploited source of reusable browser skills. We argue that the bottleneck for browser agents is decision-making under incomplete information rather than low-level operation, and that the priors agents lack are already implicit in human interaction traces. We therefore study scalable behavior cloning for browser agents via skill distillation, converting user interaction trajectories into compact natural-language skills that agents can read, retrieve, reuse, and compose directly. We further organize the distilled skills into a skill graph so that growth proceeds through consolidation rather than unbounded accumulation.

**Take.** A nice reframing of where browser-agent capability actually comes from: not more hand-designed tasks, but the priors already latent in ordinary human browsing traces. Distilling those traces into compact, readable natural-language skills — then consolidating them into a skill *graph* so the library grows by merging rather than piling up — is the same "knowledge-action graph" instinct [Agents-A1](/articles/agents-a1) used for training data, pointed at browser automation. The claim that the bottleneck is decision-making under incomplete information, not clicking, rings true for anyone who's watched a browser agent fail on judgment rather than mechanics.

## PointSplat: Compact Gaussian Splatting via Human-Centric Prediction

- arXiv: 2606.32036v1 — [abs](https://arxiv.org/abs/2606.32036) · [pdf](https://arxiv.org/pdf/2606.32036) · [html](https://arxiv.org/html/2606.32036v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.32036)
- authors: Yujie Guo, Yudong Jin, Lingteng Qiu, Zehong Shen, Zhen Xu, Sida Peng, Xiaowei Zhou
- categories: cs.CV

**Abstract.** Producing 3D human representations from input views on the fly is essential for immersive live streaming systems, where representation compactness is as critical as high fidelity given limited computational power and transmission bandwidth. Although recent feed-forward reconstruction methods achieve impressive quality through the view-centric prediction of 3D representations, they repeatedly encode the same subject content across multiple views, leading to significant inter-view redundancy. Our key insight is to perform predictions directly in 3D space. We propose PointSplat, a human-centric approach that directly infers Gaussian primitives from an input point set. The method estimates a coarse geometric proxy and performs ray casting to prune redundant points and establish explicit 2D--3D correspondences, then employs a Point-Image Transformer to fuse appearance and geometry features, predicting Gaussian attributes in a single forward pass. This restricts predictions to foreground regions, substantially reducing the total number of Gaussians while improving novel-view rendering quality.

**Take.** The redundancy insight is the good part: view-centric feed-forward Gaussian predictors re-encode the same person once per input view, so the representation bloats with duplicated content. Moving the prediction into 3D space — infer Gaussians from a point set, ray-cast to prune and pin 2D–3D correspondences — cuts the primitive count while *improving* novel-view quality, which is the rare case where compression and fidelity move the same direction. For live-streamed volumetric humans, where bandwidth is the whole constraint, "fewer Gaussians, better render" is exactly the trade you want.

## FLORA: A deep learning approach to predict forest attributes from heterogeneous LiDAR data

- arXiv: 2606.32023v1 — [abs](https://arxiv.org/abs/2606.32023) · [pdf](https://arxiv.org/pdf/2606.32023) · [html](https://arxiv.org/html/2606.32023v1) · [ar5iv](https://ar5iv.labs.arxiv.org/html/2606.32023)
- authors: Emilie Vautier, Clément Mallet, Cédric Vega
- categories: cs.CV, cs.AI

**Abstract.** Forest attributes are essential for national-scale resource monitoring. Airborne LiDAR metrics are among the auxiliary variables most strongly correlated with forest attributes used in National Forest Inventory (NFI) estimates. However, producing wall-to-wall predictions remains challenging when LiDAR data are acquired under heterogeneous conditions -- variability in sensors, flight parameters, seasons, and scan angles limits the robustness of existing models. We present FLORA (Forest LiDAR Octree Regression with Auxiliary Data), a deep learning framework that predicts six forest attributes: dominant height, total volume, deciduous volume, coniferous volume, basal area, and stem density from heterogeneous LiDAR point clouds. FLORA combines an octree-based backbone with ecological and spatiotemporal auxiliary variables through a late-fusion gating mechanism. Trained and evaluated on 32,052 National Forest Inventory plots across mainland France, a single model trained on both leaf-on and leaf-off acquisitions outperforms season-specific models. FLORA achieves an rRMSE of about 12.3% (R2 = 0.88) for dominant height and 39% (R2 = 0.74) for total volume.

**Take.** A grounded reminder that LiDAR point clouds are a national-infrastructure data type, not just a robotics one. The hard part here is the same heterogeneity that bites any real deployment — different sensors, seasons, scan angles — and the fix is sensible: an octree backbone over the raw cloud plus a late-fusion gate that lets ecological and spatiotemporal side-variables in only where they help. The finding that one model trained across leaf-on and leaf-off beats season-specific models is the transferable bit — robustness to acquisition conditions beats bespoke calibration, which is precisely the wall-to-wall property a national forest inventory needs.