归档
按日期归档,共 4940 篇 · 173 天 · 点击某天展开当天全部
2026-11-04 30 篇 ★ 21 深度
- Multi-Agent Relay Thinking
提出置信度引导的多智能体接力协作框架 MACR,动态转移推理权,在保持精度下大幅降低 token 开销
- Mage-VL-Cowork: A Full Training Recipe to Learn Hybrid Computer Use From Evolved Harnesses
4B混合计算机使用智能体,通过五阶段课程与技能化数据生成,在OSWorld-Verified达66.0%同尺寸SOTA
- DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention
联合配置头时间尺度与层输入敏感度,在不增加参数的情况下提升五种线性注意力架构的长上下文检索准确率
- EvoTeam: Multi-Agent Collaboration via Evolving Teams
提出协作中心的多智能体演化框架,联合演化团队组织、交互规则与个体技能
- MoLRSI: A Recursive Self-Improving AI agent for Molecular Discovery
MoLRSI通过工作流/架构优化与跨任务记忆递归改进搜索策略,抗生素命中率15.9%超专家流程
- What We Keep of What We Forget: Replacement Operators and Routing Semantics in Training-Free MoE Expert Pruning
固定剪枝掩码,系统比较 MoE 专家替换算子与门控尺度,提出倾斜新手算子并揭示 trained-scale rule
- ParetoSaddler: Pareto-Guided Optimization of Agent Harnesses for Quality and Cost
分离中间候选提升与最终部署选择,用 Bayesian bootstrap Pareto 支持联合优化 Agent 质量与成本
- SWE-Trail: History-Guided Trajectory Collection for Coding Agent Training
用历史轨迹引导采集资源分配但不进入 agent 上下文,训练收益提升 2.33/1.60 pp
- Order-Only On-Policy Distillation
O3PD 在策略蒸馏中只复现教师 top-K token 排序,不拟合概率值,对温度不变并在数学推理上全面优于 OPD
- Axion 1.0: Open Agent Foundation Models, Simplified
用两阶段 SFT 加 RL 的极简 recipe,构建可复现的开放 Agent 基础模型,在多项 agentic 基准上达到前沿水平
- LEANGUARD: Lean-Verified Guardrails for Tool-Using Agents
在 LLM 智能体与工具之间嵌入 Lean 4 策略运行时,以形式化证明保证每次工具调用合规,并支持反馈或证明引导修复
- Recursa: Toward Recursively Self-Improving Foundation Model Systems
构建知识仓库引导的多智能体递归自改进系统,无更强模型下将法律领域任务全对率最高提升至 55.0%
- SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding
用自治 Agent 循环自动发现投机解码的算法与系统优化,单请求加速比提升 2.4 倍、批处理提升 2 倍
- Route Anything: A Study of Model and Policy Routing for General-Purpose AI Systems
构建覆盖25个基准374k轨迹的omni-modal路由框架,证明学习路由器超最佳固定候选并提升效率8.82倍
- Behind Video Generation: Observations and Insights on Multimodal Understanding from Kling
从数据-条件-对齐-评估链剖析多模态理解如何提升可控视频生成质量
- Characterizing Adversarial GEO via Implicit Brand Injection
提出多代理框架IBI,通过单句隐式品牌注入提升生成式搜索中的品牌可见度,并构建IBIBench基准
- ToolSpace: Scaling Tool-Centric Environment Synthesis for Long-Horizon Agents
用真实执行轨迹构建加权工具组合图,按需合成环境并生成可回放验证的长程跨域任务
- ARLoop: Fully-Open Pre-trained Looped Transformers with Attention Residuals
提出 ARLoop,用滑动窗口深度注意力改进循环 Transformer,1.2B/0.5T 模型超过 Huginn-3.5B 并接近 Qwen3.5-2B
- DualEvolve: Dual-Level Self-Evolution of Mechanism and Orchestration for Recommendation
同时演化推荐模型代码和 Agent 编排,用过程质量反馈与 Thompson 采样在 64 个比较中全部优于现有自演化方法
- HARP: Training-Free Dual-Profile Agentic Communication for LLM-Based Recommendation
将 LLM 推荐重构为用户-物品双 Profile 通信,用检索侧同质性门控和反思更新提升推荐准确率
- IntentGEO: Intent-aware Generative Engine Optimization for Recommendation
提出 AMO,用固定推荐指令核心加学习追加策略,防止 prompt drift,提升多意图下 item 可见性
- JHiMA-WebRL: A Joint Hierarchical Multi-Agent Reinforcement Learning Framework for Long-Horizon Web Tasks
教师生成子任务监督,分层GRPO联合训练7B规划器与7B执行器,WebArena-Lite-v2达37.2%,超32B RL基线13.2个百分点
- You don't need long context
频繁上下文压缩与选择性读取,使长程/长输入任务无需长上下文,准确率基本持平且成本大降
- OneTrans-GSR: A Generative Slate Ranking Paradigm Unifying Reranking and Mix-Ranking with One Autoregressive Transformer
单自回归 Transformer 统一重排/混排直接生成 slate,线上 GMV/u +2.63%、广告价值 +2.06%、复购 +2.03%,延迟降 13%
- ReuseGR: Offline--Online Decoupled Generative Retrieval via Adaptive Prefix Reuse
7B离线规划共享SID前缀,0.5B在线个性化补全,以38.9%更低延迟达到与7B相当HR@100
- Scaling Laws For Data-Constrained Dense Retrieval
提出 MAEL 作为数据受限微调的稳定目标,拟合乘法 scaling law 并量化模型规模相对数据规模的计算效率优势
- SPADE: Spatiotemporal Preference Alignment and Diversity Enhancement for Local Search
联合优化词表、时空编码、DPO 对齐与解码多样性,显著提升本地生活 query 推荐
- $τ$-Rec-Books: A Disclosure-Controlled Benchmark for Requirement Elicitation in Agentic Recommender Systems
提出控制需求披露时机的书籍推荐评测基准,揭示隐藏需求下智能体成功率从 0.975 跌至 0.283
- IDs That Mean Something: A Hands-On Tutorial on Semantic IDs for Recommender Systems
系统梳理从原始ID到语义ID的演进,覆盖生成式与判别式应用并提供可动手的实践教程
- ZeroGR: Filtering-First Constrained Decoding for Generative Recommendation
提出过滤优先的 GPU 约束解码系统,先滤除非法 SID 再算 logits,召回与先打分几乎一致且延迟最高降 9.9×
2026-11-03 30 篇 ★ 17 深度
- ProVe: Proposer-Verifier Decoding
把大模型微调为一次预测多 token 的 proposer,再以小模型或自身验证,取得 2.5–2.7× 解码加速
- On-Policy Self-Distillation with Teacher Evolution
提出 Teacher-Evolution Self-Distillation,通过环境奖励优化自教师并自适应加权学生蒸馏,缓解 OPSD 训练停滞
- MemSteer: Turning User Histories into Supervision for Agent Memory Optimization
从无标注用户历史自动生成证据支撑的 QA 监督,用于迭代优化记忆存储、检索与上下文构造
- When Requirements Interact: Scaling Long-Horizon Coding via Interdependent Specifications
CodeSpecWeave 合成带相互依赖规格的任务并用 RL 训练编码代理,显著提升长程开发表现
- From Fragmentation to Fusion: A Survey and Roadmap for Omnimodal Embeddings
提出覆盖、可比、组合三能力框架与三条统一路径,系统梳理多模态嵌入研究
- DeFT-RAG: Decomposing Multi-Hop Questions into Self-Contained Sub-Questions with Reusable Answers
DeFT-RAG 用自包含子问题分解、规则化状态跟踪和 QA 缓存复用,提升多跳 RAG 准确率并降低 LLM 调用成本
- Self-Improvement with Auxiliary Rewards: Learning from Verified Traces and Evaluating Transfer
提出用置信度/熵辅助轨迹偏好区分同等正确推理,提升小模型自改进与跨任务迁移
- RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory
用 coding model 自动迭代优化机器人 agent harness,无需更新策略权重,大幅提升跨场景成功率
- NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at Scale
用经验飞轮、分级学习与桌面-网页联合强化学习,训练出开源SOTA的计算机使用代理模型族
- CREDO: Evidence-Conditioned Credit Assignment for Temporal Reasoning Agents
CREDO 用中间证据恢复局部监督,改进 GRPO 在时序知识图谱问答中的信用分配,提升 MultiTQ/TimelineKGQA 准确率
- EvoRec: A Unified Self-Evolving Agentic Recommender with Dynamic Reflection Trees
提出统一 agentic 推荐框架,通过动态反思树定位失败并生成可复用修复策略,实现无参数更新的自进化推荐
- Measuring User Success in Randomized Search Experiments: Interpreting Good Abandonment in Generative AI Search
提出 Session Success Rate (SSR),用人类标注会话训练可解释模型区分点击与放弃中的成功/失败,在线实验灵敏度约为 Sessions per User 的 2.5 倍
- Same Trajectory, Different Knowledge: Information-State-Aware On-Policy Distillation for Search Agents
提出 ISA-Distill,按学生状态的事实可恢复性加权 fact-use 与 evidence-seeking 双视图反馈,纠正 teacher 特权信息偏差
- EAGR: Evidence-Guided Adaptive Graph Retrieval
用 VectorDB 元数据中的语义描述符构成隐式图,以积累证据动态选择检索方向,无需显式图或查询改写
- Learning to Adjudicate: Verifier-Guided Multi-Agent Reasoning for E-Commerce Relevance
提出 CADRE 框架,用冻结三专家加可训练 Verifier 做选择性辩论,并以成功经验回放 GRPO 优化后蒸馏到轻量学生模型
- CoworkOS:Scaling Agent Coworkers for Real-world Automation
提出三层架构(Main、Coordinator、Subagents)的通用长时程智能体运行时,支持人机共享工件与持久状态,多个基准上超越主流框架
- CUA-Master: Scaling Computer-use Agents through Open-World Recursive Improvements
提出嵌套双循环递归改进框架 CUA-Master,结合开放世界数据与自催化传播,显著提升 GUI 智能体性能。
- E-GenRM: Generative Reward Modeling for Open-Ended E-Commerce Shopping Agents
从真实购物行为回溯构造评价链,三阶段训练生成式奖励模型,在线提升淘宝购物 Agent 有效协助率与满意度
- DR Pixel: Page-Native Deep Research with Vision-Language Models
首个开源端到端多模态深度研究代理,直接检索渲染页面图像并引入反事实信用重加权训练,超越 OCR 基线
- Diverse-Teacher On-Policy Distillation for Generative Recommendation
提出 HERO,通过异构教师路由和多样性物品 rollout 缓解生成式推荐中 on-policy distillation 的流行度偏差
- Action Verification through Conjecture and Refutation for Language Model Agents
提出 BLACKSWAN:对每个会改变环境的动作,先预测效果、再生成可测试的怀疑并验证,执行前主动寻找反驳证据
- Every Clause Counts: Instruction-Following Reranking by Multiplying Small, Answerable Questions
把带指令查询拆为主题与多个类型化子句,逐项用小型 judge 输出概率并相乘,零样本提升指令遵循重排效果
- Multi-Teacher Reasoning Distillation for LLM Recommendation with Self-Exploration
MUSE 构建多教师+学生自探索候选池,用 Rank-Gain 效用筛选并对比蒸馏,让 LLM 推荐器学到真正有益的偏好推理
- PACERec: Progressive Adaptation of LLM Item Embeddings with Collaborative Evidence for Recommendation
用 flow matching 学共享速度场,将静态 LLM 物品嵌入渐进适配前序行为目标,实现无 ID 长尾序列推荐
- RecRSI: Mechanism-Guided Discovery of Recommendation Algorithms
用机制假设组织推荐算法搜索,在16个设置上平均NDCG@5相对初始模型提升8.48%
- SHq: Learnable Grids for LLM Weight Quantization
用两参数 sinh 压缩网格替代固定查找表,端到端 KL 搜索参数,3-4bit 量化误差显著低于 NF/BOF/INT
- Strategist: Evolving Reasoning with Agents
将推理策略写成可复用蓝图并跨任务搜索积累,在 30 个基准上以 39% 更低成本匹配最强基线
- Preprocessing Choices in Fine-Tuning Data Matter: Utility and Demographic Sensitivity in LLM-Based Recommendation
系统评估微调预处理对LLM生成式推荐效用与公平性的影响,并验证目录约束解码与提示增强的有效性
- Utility-Aware Generative Recommendation: Utility-Enriched Semantic Codes and Utility-Guided Decoding
将多目标效用写入SID末级并引导beam search,降低高价值候选被剪枝
- Meet Students Where They Are: Student-Prefix Teacher Adaptation for On-Policy Distillation
在蒸馏前用学生前缀 RLVR 微调教师,提升其对学生在策略轨迹的监督可靠性,无需改变蒸馏目标
2026-11-02 30 篇 ★ 9 深度
- R^2Orch: Recursive Self-Improvement for Agent Orchestration via Self-Play within a Skill-Internalization Loop
通过双层递归自博弈,用技能撤除下的任务可学习性作奖励,实现零技能部署并全面超越基线
- CEPO: A General Framework for Improving Prompt Optimization in Multi-Agent Systems
将多智能体提示拆分为共享协调器提示与专属执行器提示,并分别按角色更新,可稳定提升现有提示优化器效果
- HALO: Human-Grounded Granular Evaluation of Proactive Agents
提出HALO-Arena与HALO-8K,以人类细粒度诊断评估主动Agent是否、何时、多大程度干预,发现过度主动占拒绝主因
- On the Origin and Evolution of Training-Inference Mismatch in LLM Reinforcement Learning
拆分数值偏差与策略滞后,提出 DLC 校正,稳定异步采样下 LLM 在线策略训练
- Where, When, and How Many Bits? Scaling Laws for SGD with Stochastic Rounding
在两层线性网络上证明随机舍入 SGD 预测误差上下界,给出精度、模型规模与训练时间的 compute-optimal scaling 法则
- WeFair: Fidelity-Aware Alignment from Human Feedback for Personalized Query Rewriting in Short-Video Search
用保真度分级的 SFT-DPO-GRPO 对齐人类反馈,训练紧凑个性化 query 改写模型并显著缓解意图漂移
- BrowseFlow: Sparse Event Flow Matching for Generative User Simulation
用离散 Flow Matching 对稀疏关键事件和浏览深度建模,生成随机用户浏览轨迹,在三个数据集上取得最优分布拟合
- Chronos-2: A foundation model for multivariate time series forecasting
零样本多变量时序基础模型,联合建模序列交互与异构协变量,精度与推理效率显著领先
- MILES-Rec: Uncovering Implicit Intents from Mobility Behaviors for Cross-Domain POI Recommendation
用 LLM 将地图出行行为与画像推理为有序自然语言 query,再用 GRPO 双层 credit assignment 对齐后续服务交互
- CRoS: Causality Reward on Scrambled CoTs Improves Accuracy and Reasoning Faithfulness
用打乱推理步骤顺序而非改变信息内容的因果奖励,缓解结果奖励无法保证 CoT 因果贡献的问题
- DecisionRank: On-Policy Distillation for Decision-Model Rerankers
用 item-space on-policy distillation 把生成式 LLM 排序偏好蒸馏到单 token 决策重排器,8B 超 27B 教师且快 24.5 倍
- ACCT: Asymmetric Cross-LLM Context Transfer
提出 ACCT,将源模型 KV 稀疏转换为目标模型可直接消费的状态,削减 75% KV 仍匹配原性能
- Flide: Accelerating Decision Inference with Exact State Forking
提出支持决策模型分支请求的推理引擎,通过扁平化执行和ForkAttention实现精确且高效的批量决策
- When Should AI Agents Ask? Clarification Requests Under Limited Human Attention
提出 Pairwise Coordination Policy 协调多智能体共享有限人类注意力时的提问时机与排序,成本接近最优
- Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents
统一代码/CLI、无障碍语义AX与GUI视觉三通道,让智体灵活选择组合,在OSWorld 2.0上取得最高分
- ID2Pattern: Pretraining Generalizable Identity Behavior Patterns for Transaction Risk Foundation Models
用 LAID 匿名 ID 编码与多尺度 VQ pattern codebook,从高基数身份序列中提取可泛化行为模式,提升风险/电商预测。
- Subquadratic Attention with a Hierarchical Tree-Structured Indexer
提出层级树结构索引器对KV cache递归压缩,使注意力总成本随序列长度亚线性增长,实现次二次方缩放
- Reliability-Weighted Direct Preference Optimization: Penalized Weights for Robust Preference Learning
在 DPO 中为每个比较样本引入可学习可靠性权重,自动降权翻转/噪声偏好,几乎无额外计算成本
- KITE: Retrieval as a Decision Procedure for Long-Term Conversational Memory
KITE将长期对话记忆检索变成受控主题索引上的可检查决策过程,LoCoMo/LongMemEval-S准确率93.5%/86.0%,仅约1.6k tokens
- Completeness and Cost of Retrieval Structures for Multi-Tool Requests in LLM Agents
比较六类工具检索结构,发现多工具完整检索需标注数据或30+次LLM调用,零训练/单次调用结构近乎失效
- MUON-RT Reusing the Teacher's Trajectory for Momentum-Free Muon for LLM Self-Distillation
复用 EMA 教师-学生位移替代 Muon 动量缓冲,在自蒸馏微调中省显存并提升准确率
- Latent Sparse Attention: Towards Subquadratic Ultra-Long Context Attention
提出潜在稀疏注意力 LSA,通过可学习层次聚类实现超长上下文亚二次注意力且保持精度
- RangeSWA: Training-Free Length Extrapolation for Continuous Diffusion Language Models
提出训练无关的 RangeSWA,通过滑动窗口+远程块摘要+动态检索缓解连续扩散语言模型长文本生成的重复与漂移
- SecPO: Principled Adversarial Training for Prompt Injection Security
提出 SecPO 损失与对抗训练管线,将 Qwen3.6-27B 在 AgentDojo 上的提示注入 ASR 从 78.8% 降至 8.8%,且无良性性能损失。
- Context as Infrastructure: Knowledge Compilation for Retrieval in Agentic Systems with Harnesses
在Agentic检索中,把文档编译为声明-证据叶子可让命中token省91%、平均省38%,盈亏平衡充分率仅2%
- TSBPO: Tree-Structured Branching for Policy Optimization in Interactive Language Agents
TSBPO 用树结构采样与更新统一解决交互式语言智能体训练的采样、延迟信用分配和多 token 损失聚合
- TradeWar: A Benchmark for Execution-Grounded Trade Negotiation with Adaptive LLM Agents
提出执行导向的多国贸易谈判基准 TradeWar 和自适应智能体 TACTIC,用结算结果驱动跨轮策略优化
- Search When Needed, Proceed When Reliable: Metacognitive Reliability Supervision for Efficient Agentic Search
用局部结论的序列不确定性估计可靠性,为搜索/不搜索决策构建过程奖励,在 GRPO 中提升搜索效率与准确率
- Asynchronous Flow Map Language Models
将 token 预测顺序通过异步流图编码进单步并行语言模型,实现高质量一步生成
- Stepwise-Querying: Distilling Reasoning without Access to Teacher Chain-of-Thought
黑盒教师下用逐步独立查询蒸馏推理,无需 CoT,14/16 对比最优
2026-11-01 21 篇
- Co-Design Bench: Multimodal Collaborative Coding Evaluation for Agentic Models
构建参考无关的多模态协同编码基准 Co-Design Bench,评估 10 个模型端点,最强模型完全满足率仅 26.4%
- Instruction Capacity: Behavior and Degradation of Language Models under Controlled Load
用原子替换规则构建负载度量,测出 GPT-4o mini 在 95% 正确率下约 37-38 条规则的指令容量
- Look Only When Needed: Certificate-Guided Visual Routing for Efficient Diffusion VLMs
提出 LOWN 解码方法,每步自适应决定是否处理图像,平均省 65% 解码 FLOPs 而保留 99.6% 分数
- EditAgent: Rethinking Agentic Image Editing
并行调用多类编辑器、为候选附验证记录并用 VLM 列表式评判,提升成功率并降低 judge 调用
- Agentic University: Collaborative Agents for Personalized Learning
提出人类参与的多智能体组织方法,让学习者与专门Agent协作维护可修订能力计划,实现连贯自适应学习
- Algebraic World Model: From Exploration to Proofs
AWM将未知环境探索与假设检验转化为可被Lean形式化的代数模型,能证明不可达性与最优界
- EnvOS: Auditing Computer-Use Agents When the World Moves On : Phenomenon-Based Task Construction, Certification, and Evidence-Based Evaluation
提出 EnvOS 框架,在执行前认证环境变化、任务可解性和评分器,执行后基于存档证据复核判决,可靠评估动态环境中的计算机使用智能体
- Radiology Guideline-derived Decision Graph for Efficient Clinical Decision Support
LLM 构建可执行决策图,System One 模型 + 确定性遍历将准确率从 57.3% 提升至 90.8%
- FIRME: Registry-Anchored Memory Graphs for Evolving, Heterogeneous Investor Knowledge
用注册锚定记忆图解决知识图谱中同一关系表面形式不同导致的历史碎片化问题,提升跨期实体对齐与证据积累
- Gym-Anything for Robotics: Scaling physical simulations with digital agents
让编码智能体自动创建机器人仿真环境,构建 RoboWorld 基准并利用特权教师等方法提升前沿模型在 RL 任务上的表现
- Efficient LLM-based Subgraph Retrieval for Multi-Hop Knowledge Base Question Answering
用 MCTS 将子图探索转为树搜索,结合 LLM 引导节点筛选,在 WebQSP 上 Hits@1 达 78.88% 并提升效率
- Retrieval as Traversal: Value-Indexed Memory for Stateful Long-Context Agents
提出价值索引记忆与局部遍历检索,分离内容与地址,验证有状态检索比无状态更易学习
- rTaste: Do Research Agents Have Taste? Evaluating Early Stage Research Judgment
用 415 个最小可行实验评估六款前沿模型的研究判断,发现智能体的实验排序未能显著优于简单基线
- How I Aligned Your Model: Scaling Up Multilingual Safety Training with Templates
提出模板化多语言安全数据增强流水线,发布60语言MSafeTemp语料并揭示英语评估会误判多语言安全
- ShallowDefend: Harnessing Shallow Safety Alignment for Multi-Turn Defender
提出 Assess→Decide→Respond 框架,用显式安全决策 token 和自验证奖励训练多轮防御模型,在 14 个基准上取得最强多轮安全性
- Testimony from Timelines: Evidence-Grounded Significance Testing of Temporal Clinical Hypotheses
提出STRATA基准与ART分阶段范式,暴露并显著缩小LLM在时序临床假设检验中的证据-结论差距
- TextSeal2: Distortion-Free LLM Watermarking with Copula Mixing and Memoryless Races
合并多密钥为虚拟密钥并结合无记忆指数竞速,使LLM水印在投机解码下保持无失真且检测率提升
- Where Position Matters: Profiling-Guided Layer-Wise RoPE Allocation in Transformers
用逐层剖析剖面在固定预算下分配 RoPE 维度,提升语言模型验证损失并支持 MLA 高效部署
- Rethinking Neural Thickets Without Weight Perturbations
证明Neural Thickets的推理增益可仅凭冻结模型输出logit随机偏置、验证集选择与投票复现
- Advancing Clinical Genomic Analysis with a Skill-Centred Agent
ClinGeX智能体组合105个可执行临床基因组技能,留出基准一致性71.7%,远超最强对比45.7%
- On the Fundamental Limits of Prefill-Based Decoding Length Prediction
揭示解码长度预测中的系统误差主导性,推导出所有基于预填充的方法必须遵守的统计界限
2026-10-31 30 篇 ★ 5 深度
- TauIndianBankBench: Procedure-Aware, Action-Oriented Evaluation of Tool-Using Conversational Agents
提出银行客服对话代理评估基准,除最终记录外检查必需步骤执行与未请求变更,暴露仅看结果的假阳性
- RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents
提出 REALCLI 双模式基准,统一评估 CLI Agent 任务执行与协作质量,揭示前沿模型协作能力严重不足
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
固定任务、仅变化用户人设,发现 CUA 任务完成率平均下降 36%
- Your Benchmark Is an Empirical Measure Over Difficulty
从测度视角揭示基准评估两大失败模式:难度分布错配与覆盖空洞,并提出诊断指标及 BenchFill 重写算法
- A Broader Look into MLLM's Retrieval Heads
发现检索头在多模态模型中保持稀疏且跨模态共享,通过排序目标训练注意力可提升文档检索 Recall@1 6.03 点
- PreView: Enhancing GUI Grounding with Preprocessed Views and Cues
提出轻量辅助预处理器 PreView,为冻结 GUI 定位模型生成局部放大视图与候选特定视觉/文本提示,无需微调提升定位准确率。
- AdShot: Benchmarking Multimodal Large Language Models for Video Advertisement Clipping
推出 AdShot 基准:823 对广告镜头选择评测,发现架构优先于规模且模型有内容偏好
- Broken on Arrival: Non-Functional Quantized LLM Artifacts in Public Model Registries and How to Catch Them
审计 Ollama 与 Hugging Face 量化模型发现 2.3% 低比特小模型功能失效,并证明校准可修复
- Matched Capabilities, Different Behaviors: A Controlled Study of MCP and CLI Interfaces for Language Agents
在可执行能力固定时,MCP与CLI的接口表示差异显著改变智能体动作选择、失败恢复与成本,DART可修复实现层失败
- A-RSI: Adaptive Task Refresh for Zero-Data Multimodal Self-Improvement
用训练日志中的奖励方差与准确率动态刷新任务池,实现零外部数据的多模态递归自改进
- AskStream: When and What to Ask Proactively under Uncertainty in Streaming Video Understanding
引入主动 ask 动作的流式视频理解基准,评估模型在视频与用户不确定性下的提问与回答策略
- Multi-Token Prediction Done Right
提出 Soft-MTP,通过一行代码改动移除标准 MTP 训练中的噪声残差梯度,只保留 KL 自蒸馏信号,全面提升性能与推理加速
- Weaken to Strengthen: Weakening-Induced On-Policy Self-Distillation for Large Reasoning Models
通过量化/剪枝构造弱化模型,利用强弱对比信号进行在线策略自蒸馏,无需外部教师
- Investor's Last Exam: Can AI Agents Do Equity Investment Without Seeing the Future?
提出 ILE 股权投资基准,用冻结信息集与财务依赖图评估 AI 代理研究、预测与投资表现
- CoWalk: Cooperative Walks for Agentic Batch Queries on Disk-Resident Graphs
让批量语义相关向量查询在同一线程协作遍历图索引,每页只读一次、所有查询共享打分,显著减少 I/O 与距离计算
- Intrinsic Distribution Matching
提出 IDM,在 DMD 中显式匹配生成器 EMA 特征的均值与逐坐标标准差,提升少步文生图长文本渲染
- Training Foundation Models with a Single Algorithm
将预训练、SFT、RL 统一为单一似然训练目标,把 RL 视作对模型生成分布的最大似然拟合
- Proving and Improving the Platonic Representation Hypothesis with JEPAs
证明基于“好视图”的 JEPA 可跨模态对齐表征,且比 next-token 高效 42 倍
- Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities
提出一个编码器与统一 schema 的全模态解析器,将文档、图像、音频、视频解析为带时空定位的结构化记录
- Predicting What Answer Engines Cite: Open Decision Models, Rerankers and a Distilled 4B Student on Ten Engines under Controlled Retrieval
用LoRA微调Qwen3-Reranker-4B蒸馏27B决策模型,预测答案引擎引用份额,性能与教师差异不显著
- Don't Lose the Thread: Empowering Long-Horizon LLM Agents with Cognitive Resource Self-Allocation
CORAL 用可调用的记忆管理与上下文重置工具,让 Agent 自主 checkpoint 并跨 episode 做 RL,GAIA 上 8B 达 42.8% 且 token 成本少 6-7 倍
- From Intent to Improvement: Agentic Dataset Search for Better Model Training
提出契约治理的 AgenticDS 框架,用 typed object 约束 LLM 决策并验证约束,显著提升数据集搜索与下游训练效果
- Multi-View MoE: Letting Every Router Shape Expert Computation
通过多路由聚合与路由偏好驱动的专家输入混合,在固定专家预算下提升稀疏 MoE 选路与表达能力
- InterA11y: Interactive Web Accessibility Error Detection with LLM Agents
结合可测试规则分解与确定性交互工具,显著提升 LLM Agent 网页可访问性审计召回并保持高精度
- Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation
提出 token 级自适应 on-policy 自蒸馏,用多教师池+多数投票+KL 为每个 token 选教师,数学推理最高提升+5.9
- A Sequential Decision Framework for Evaluating LLM-Guided Search
将 LLM 引导搜索抽象为 select/spawn 序列决策,统一评估高召回检索与 deep research 策略
- PIVOT: Progressive Intervention via Online Teacher Correction
在RLVR中插入教师纠正轨迹并施加token级KL监督,大幅提升困难推理任务的学习效率与最终表现
- Prefix Executability: Evaluating Tool-Using Agents Beyond Final Success
提出前缀可执行性评估协议,量化工具调用轨迹每一步的可执行性,揭示仅看最终成功的盲区
- There Is No Free Lunch in RLVR: Every pass@1 Gain Has a pass@k Price
用定理证明 RLVR 中 pass@1 增益必然伴随 pass@k 下降,并给出精确权衡边界与诊断方法
- VeriCUA: Verification as Agentic Exploration for Computer-Using Agents
将验证视为动态证据收集与评估,统一在线离线、跨平台 CUA 任务完成验证,提升一致性并更强拒绝误报
2026-10-30 30 篇 ★ 22 深度
- Amortizing Sequential Experimental Design in Reasoning LLMs
用信息增益奖励训练LLM进行自适应信息收集,在低计算成本下超越BED基线并跨域迁移
- VibeGame: Prompt-to-Game Development with AI-Native Engine and Self-Evolving Adversarial Agent Team
用 AI 原生引擎与八个专用对抗智能体,从提示词端到端生成可玩 2D 游戏项目
- WebAnything: From the Wild Web to Scalable Agent Environments
全自动从真实 URL 重建可重置 Web 环境,构建 244 个网站并微调模型显著提升多项 agent 成功率
- WorkFactory: Turning Professional Intents into Executable Work for Scalable Agent Training
提出 WorkFactory 框架,通过信息级规划与探针执行修复构建可执行职业任务,训练 WorkPilot 系列显著提升专业工作基准
- WeVisCut: The Whole Editing Room in One Agent From Narration to Long-Form Video
用离线反推编辑决策训练9B策略,在统一工具环境中逼近Claude Opus 5且token减少33倍
- Glance: The Generator Is Its Own Reranker
提出 Glance,给生成器加轻量决策适配器和指针头,共享一次 prefill 对候选段落打分,免去独立重排模型
- Quantum-Inspired Pairwise Ranking Aggregation via Active LLM Feedback
只用高分歧文档对的少量 LLM 判断学习多路检索融合权重,以约 30 次调用逼近 SOTA 零样本 LLM 重排效果
- Towards Reliable, Scalable, and Value-Aligned Generative Recommendation for Large-Scale Advertising
通过多路径SID、五维容量扩展和统一价值引导生成与判别,快手广告生成式推荐实现3.07%收入提升
- Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-Normalized Training
证明 WN 训练增益主要来自有效学习率轨迹,提出 AIR 调度,在 128B MoE 预训练上比 cosine 降损约 0.01
- Contextual Embeddings Beyond the Gold Chunk
用查询感知压缩模型蒸馏分级 chunk 相关性替代 gold-chunk 标注,发布 9B/0.6B 模型并刷新多基准 SOTA
- Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps
用在线 RL 训练解耦的规划与接地 UI Agent,结合稠密/终局奖励与 GiGPPO,使 8B 模型在真实 iOS 任务上接近或超越 Gemini
- CASH: A Capability-Aware Subsidy Harness for Advertiser Subsidy Allocation
以结果校准的 capability license 融合 LLM Agent 与数值模型,在线收入提升 15.35%
- Long-Term Agent Memory through Complementary Curation and Consolidation
提出情节记忆+结构化关系记忆的混合存储,并通过离线聚类整合压缩16%以上记忆且性能几乎不降
- Learning Calibrated Confidence for Multi-Agent Collaboration
让多智能体在 RL 中联合学习任务与校准置信度,并在交接与最终输出传递该信号,提升协作准确率与可靠性
- Decompose, Estimate, Select: Coverage-Aware Context Construction for Long-Form RAG
提出覆盖感知 RAG 流水线,通过子问题分解、覆盖矩阵估计和贪心选择提升证据覆盖,并发现检索覆盖提升未必带来答案覆盖提升
- GistRank: Gist-Compressed Listwise Ranking with Large Language Models
用三阶段训练将每个候选段落压成4个gist token,在TREC/BEIR上以约14倍加速逼近全文本重排效果
- KARMA: Training-Free Knowledge-Atomic Harness Evolution for Industrial Advertising Agents
冻结模型权重与可执行 harness,以六类类型化知识模块的原子编辑+验证门控,使广告 Agent 离线动作一致性平均提升 29.7%
- Federated Recommender Agents
在不更新 LLM 参数的前提下,用 C–T–R 知识单元和双隐私记忆实现推荐 Agent 的联邦协作
- PALATE: Pretrained Autoregressive LATent Embeddings
用 GPT 式序列模型学习用户门店互动,以 last-token 隐藏向量作为冻结用户表示接入排序,双场景显著提升收入与转化
- PFA: Attention Can Be Progressively Focused in Long-Sequence Generative Recommendation
利用 GR 解码中注意力渐进聚焦与跨步排名一致性,PFA 通过共享重要性排名和几何预算缩减,加速长序列生成式推荐
- R2QRec: Learning Recommendation Queries from Retrieval Feedback
用固定检索器构造可检索 query 监督,并以 RRF 融合排名反馈优化 query 生成器
- RoFiGR: Coarse Routing, Fine Refinement via Level-Adaptive Distillation in Multimodal Generative Recommendation
融合协同信号对齐粗粒度 SID 与分层自适应蒸馏,提升多模态生成推荐的粗路由命中与排序
- UGR: Unified Generative Ranking for Heterogeneous E-commerce Recommendation
在淘宝异构候选集上统一生成多业务排序列表,结合反馈监督与广告debias塔,在线GMV提升2.10%
- Turing LLM Post-Training: Calibrated Distillation and Efficient Dynamic-MoE Execution
提出校准多教师在线蒸馏(C-MOPD)与动态 MoE 执行优化,四域能力整合分数达 0.9988 并实现 2.86 倍步骤加速
- Beyond IPS: Reliable Counterfactual Evaluation in Multi-Stage Ad Systems without Logged Propensities
用多分类域分类器估计密度比,训练混合加权奖励模型,在无倾向分下提升广告离线策略选择可靠性
- Try Before You Evolve: Ranking-Scored Trials for Recursive Self-Improvement of Recommender Systems
RecRSI 用短训练+probe全排序NDCG@10试炼筛选LLM候选训练编辑,再full retrain最优编辑,大幅提升自进化效率与效果
- xPRT: Cross-Passage Retrieval Pretraining
提出无监督跨段落检索预训练框架 xPRT,利用文档内跨段落信号,在 MTEB 上平均超越最强基线 3.2%
- Heterogeneous Co-Evolution Learning for Tool-Efficient Search Agents with Zero Labels
零标注下用异构 proposer–solver 协同进化同时优化搜索智能体准确率与工具调用效率
- PRISM: Personalized Item Representations in User History
复用上游排序计算,为每个用户-物品对生成个性化历史嵌入,提升下游序列推荐质量
- Read More, Reason Deeper: Latent Workspaces for Long-Sequence Recommendation
用持久化 typed banks 与固定大小 workspace 解耦证据/推理缩放,10K 历史下 NE +0.19%、前向 GFLOP -69.6%
2026-10-29 29 篇 ★ 8 深度
- AlphaBet: Reinforcement Learning for LLM Event Forecasting Agents
用多日期事件结果联合监督证据搜索与概率报告,显著降低 Brier 分数并提升准确率
- Truncate or Not? A Scaling Study of Looped Transformers with Truncated Backpropagation
拟合统一缩放律发现完整BPTT优于截断,两圈循环用27%少参数和8%多计算达到更低验证损失
- Self-Assessment Reinforcement Learning for Search-State Awareness in Retrieval-Augmented Large Language Models
提出 SARL:训练时自评估搜索轨迹并据此修订,配合双重奖励,无推理开销地内化搜索状态意识
- Can Test-Time Memory Evolution Outperform Test-Time Training for Scientific Discovery?
提出TTME:不更新权重,通过外部记忆持续沉淀经验指导后续发现,性能优于TTT且算力降八成以上
- AdaPRA: Process Reward Agents with Adaptive Rubrics for Data Science
AdaPRA 用自适应 rubrics 的过程奖励智能体审计并纠正数据科学 agent 的中间过程错误,显著提升排行榜百分位
- What Effort Level Should I Choose? On the Economics of Reasoning Effort in LLM Agents
审计8模型4基准显示高推理努力常丢失低努力已解任务且过度支出;基于验证的阶梯式升级能匹配或超过固定最高努力并降本
- h1: A Taste of the Bitter Lesson in Automated Theorem Proving
提出 h1,一个只靠高效 Lean 接口与验证反馈自反思的简单 agent 循环,在形式定理证明达到 SOTA 并追上复杂工作流
- Harness-Model Collaboration for Long-Horizon Continual Learning
HaMo 将轨迹蒸馏为策略经验卡供即时检索,并以经验条件持续学习目标实现快慢协同,提升长程 Agent 的保留与迁移能力。
- Multiscale Policy Optimization for Long-Horizon LLM Agents
提出 MPO,组合 turn 级 GAE 与均值保持的 token 级信用分配,并用 turn 级重要性采样更新策略,在搜索/工具/自动化任务上全面超越 PPO/VAPO/SAO
- DTCA: Denoising Token Credit Assignment for Reinforcement Learning in Diffusion Language Models
提出 DTCA,按去噪 token 置信度增益估计贡献并分组,用于扩散语言模型 RL 的 token 级信用分配。
- What Outcome RL Buys: Finishing, Reliability, Rarely Reach
将 outcome RL 的 pass@1 提升分解为完成、可靠与可达,发现主要改善完成和稳定性,很少带来新能力
- SearchHorizonBench: A Benchmark for Search Value in AI Agents
通过配对延续与重复执行构建搜索价值评估基准,分离搜索增益与生成噪声
- How Much Does the Hint Matter? Scope Conditions for Hindsight Self-Distillation in Financial Reasoning
提出 Fin-SD,以学生自定位错误并生成提示、截断错误前缀进行事后自蒸馏,无需外部教师即可提升多步推理
- Your Policy Is Secretly a Harness: The Decision Geometry of Agent Interfaces
训练策略会带上训练 harness 的偏好,部署收益可分解为接口天花板减策略偏差,固定模型评估接口会混淆两者
- MLE-World: Predicting Machine Learning Experiment Outcomes with a Learned World Model
用 4B 世界模型预测 ML 程序终端输出并以置信度门控执行,使 MLE Agent 在少执行下获得更高分数
- Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data
证明 MoE 通道选择用 top-k 即可,无需离线校准阈值;并提出基于模型权重的三值草图+低秩恢复读取器,以 17.8% 读取量保持 98.1% 精度
- TAO: Tool-Aware Joint Scheduling for LLM-Based Agentic Serving
提出工具感知联合调度框架TAO,融合工具就绪度、缓存信用与token占用进行动态规划调度,显著降低延迟和TTFT
- From Interaction to Capability: Task Advancement as State and Supervision for GUI Agents
将已验证任务进展作为在线状态与离线监督,从跨应用长程任务中学习可复用操作
- Multi-State Linear Attention with Generalized Second-Order Routing
提出MERLIN,用段内keys的一/二阶矩恢复query-段对齐的均值与方差,提升多状态线性注意力聚合路由
- Follow the Gradient: Tracing Safety Degradation Back to Training Data
SimpleLoRIF 将低秩梯度归因扩至百万级数据,过滤梯度对齐不安全的样本,攻击成功率最高降22%
- GEPA-Curator: Curated Learning for Self Improving Agents
用任务策展与成功轨迹检索过滤噪声失败,提升 reflective prompt optimizer 性能,多基准最高超 GEPA 20.7%
- EnvSched: Environment-Aware Scheduling for Rollout-Efficient Agent Reinforcement Learning
通过环境感知调度任务与环境的 rollout 批次,提升 Agent 强化学习样本效率
- Test-Time Communication in Trading Agent Swarms
在无共享目标的交易Agent群体中量化通信带来的过度收敛与语言复用,并提出以无同伴基线衡量羊群效应
- Lossless Compression of Proximity Graph Indexes for Efficient Approximate Nearest Neighbors Search
通过离线图置换制造结构局部性,用 SIMD 整数压缩器快速解压 HNSW 邻接表,压缩率最高 52.7% 且延迟近零损失
- MuonGS: Pretraining LLMs with Relaxed Weight-Norm Control
用Gram-Schmidt移除Muon更新径向分量,权重范数最多√t增长,长期困惑度更低并加速LLM预训练约15%
- QESChunker: A Single Objective Unifies Overlapping and Non-Overlapping Chunking for RAG
将 RAG 分块形式化为问答证据效用最大化的监督组合优化,非重叠用 DP 精确解,重叠用贪心近似解
- TeamGym: A Gym for Team Decision-Making by AI Agents with Distributed Information
构建可控团队决策环境,量化并训练多智能体在分布式关键信息下的沟通与检索能力
- Tessera: Structure-Completed Evidence Units for Web Retrieval-Augmented Generation
训练无关的证据交付层,将检索页面重建为结构完整的证据单元,文本/截图/Agentic RAG 提升 5-6 点准确率
- Collective Dynamics of Self-Reinforcement: How Cross-Task Coupling Drives Policy Collapse in Unsupervised RLVR
揭示无监督RLVR多数投票自奖励的集体不稳定性,解释训练任务数增加导致模型答案趋同崩塌
2026-10-28 30 篇 ★ 27 深度
- HABIT-Bench: Evaluating Habit Induction from Longitudinal Weak Evidence in Agent Memory
四域基准显示现有 Agent 记忆方法准确率仅约 33%,复杂记忆流程不优于简单检索或历史压缩
- ReGE: Stronger Agents through Experience Synthesis
把多次尝试的轨迹与产物联合合成为自包含指导,低 token 成本提升同模型后续执行成功率
- RSI Arena: Towards Recursive Self-Improvement with Human Feedback
10个前沿模型作为训练代理自主后训练Nemotron基础模型,两阶段人类反馈闭环,最强模型关闭76%能力差距
- Memory Tax: Dissecting the Net Value of Agent Memory
大规模评测发现多数 Agent 记忆系统不如 naive RAG,提出记忆收益与记忆税拆解净价值
- Rethinking Verification in Agent Harnesses
系统对比 17 种 agent 验证设计,独立低费 critic 带来 5.9–9.5pp 编码提升且成本仅 1.13–1.25×
- The Trinity:Capability-Driven Recursive Self-Improvement for Multimodal Agents
提出 Trinity 框架,通过 Creator/Explorer/Evolver 将任务重组为能力树,递归进化 Harness 并路由选择
- On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction
提出SPOT小模型预测扩散语言模型的下一个提交位置,构建候选树实现无损推测解码,吞吐最高提升3.4倍
- ThinkBit: Search Codewords, Recalibrate Scales, Select by Reasoning
标量2-bit量化框架,通过敏感度分配位宽、码字搜索、仅训尺度和按推理选择,在MATH-500上大幅超过同尺寸2-bit方法
- MAREval: A Multi-Agent Framework for Evaluating Natural Language Recommendation Explanations
规划者-主持者-仲裁者多智能体+Monte Carlo 采样提升推荐解释评估的人工对齐和稳定性
- Cross-Day Compatibility of Daily Item Embeddings: An Empirical Study of Alignment, Scale Management, and CTR Adaptation
实证对比48种配置,发现warm start + 全局尺度重缩放将跨日GAUC提升4.0%,下游CTR编码器可进一步对齐残差漂移
- AutoRSE: Evaluating LLM Agents as Recommendation Engineers for Self-Evolving Recommender Systems
构建 AutoRSE 框架,量化 LLM RSE-Agent 自主改进推荐算法的能力与瓶颈
- The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation
复用预训练稀疏自编码器特征索引作为语义 ID,无需额外词汇学习,实现高效且可解释的生成式推荐
- Compote: Collapse-Resistant Multiple Hypothesis Learning For Sequential Recommendation
用退火 winner-takes-all 训练多假设头防止坍缩,仅凭 item ID 超越生成式与多兴趣基线
- When Diffusion Recommenders Stop Sampling: Preserving Generative Diversity
DARTS 用三阶段潜在扩散解耦表示学习、生成与排序,缓解采样坍缩并提升排序精度
- DuTri: Dual-Branch Modeling with Triadic Factorization for Multimodal Multi-Scenario Recommendation
提出 DuTri 双分支框架,用 CP 分解和残差量化学习三元协同偏好,指导多模态自适应融合,在多场景推荐上取得最优。
- EmbeddingGemma 2: Unified and Efficient Multimodal Representations
744M 多模态 embedding 模型,以多阶段课程训练在文本/视觉/音频基准上达到新 Pareto 前沿,支持量化与截断部署
- ETAMem: Decoupling and Aligning Heterogeneous Memory for Long-Term Conversational Agents
将对话记忆拆分为事件、情感、时间三视图并自适应路由检索,显著提升长期记忆中的多跳与时间推理。
- GTFormer: A Syntax-Free Graph Network Alternative to Transformers for 8192$\times$ Length Extrapolation in Linear Time
用层次图树替代自注意力,N≤512 训练零样本外推到 4,194,304 tokens,线性时间与显存
- Scaling Laws for Tool-Use Agents via Controllable Environment Synthesis
提出 SynthAPI 可控合成工具环境,发现工具与数据库多样性比任务数量更关键,并推导可预测扩展律
- KL-MOPD: Discrepancy-Aware Multi-Objective On-Policy Distillation for Generative Recommendation
用初始学生与教师 token 级 KL 差异加权,解决生成式推荐多目标蒸馏中的 token 级不平衡,提升联合目标
- LCM-Promo: An LLM-Based Uplift Model for Promotion Allocation
微调LLM预测转化阈值,构造单调促销响应曲线,线上转化+1%成本-6%
- LESSRec: Level-Specific History Modeling for Semantic ID-Based Recommendation
发现并利用同层历史对语义ID预测更有效,提出层级隔离编码与层级对齐注意力
- Can Complementary Signals Bridge Similarity Islands? Manifold-Augmented Graph Embedding for Multimodal Recommendation
MAGE框架结合离线流形增强与在线非对称双流GNN,缓解多模态推荐中互补品语义漂移问题
- PailitaoMMSearch2.0 Technical Report: Scaling Generative Retrieval to Unified End-to-End Multimodal Search
直接由图像+自由文本生成商品Semantic ID,统一相似/编辑/搭配意图,上线拍立淘带来显著GMV提升
- REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation
通过语义邻居生成预训练、SID边界局部注意力与分层偏好蒸馏,显式建模生成式推荐中的物品语义与协同关系
- Latent Residual Reasoning for Ranking in Generative Recommendation
提出 Refiner 框架,用残差分数修正、历史查询和 LoRA 适配,在不重训基座的前提下增强生成式排序
- SpectRAG: Weighted Chunk Graphs for Token-Budgeted Context Selection in Multi-Hop Retrieval-Augmented Generation
用加权块图的谱坐标与预算化选择,把 RAG 检索从 top-k 相似改成连通证据集优化,以更低索引成本提升多跳证据召回
- TaskBridge: Technical Report for SIGIR 2026 eCommerce Challenge
以目录语义锚定、五候选改写和协议感知选择实现任务型电商查询的 BM25 检索增强,获挑战赛第一
- Modeling Preference Dependencies with Directed Acyclic Graphs for Narrative-Driven Recommendation
提出PDG-F框架,将用户叙述解析为偏好依赖DAG,指导分路径检索与拓扑排序,显著提升开放域推荐召回上限与精度
- Rethinking Positional Encoding and Interaction Granularity for CTR Prediction
提出 TRIP,结合目标感知的秩-时间位置编码与时间组因果交互,显著提升 CTR 预测 AUC
2026-10-27 30 篇 ★ 20 深度
- Function-Space Temporal Self-Distillation for Policy Optimization
提出FSPO单策略框架,以历史分布为固定时序目标并引入特权分歧校正,实现稳定高效的策略优化
- Judging the Justification: Decision Certificate Supervision for Generative Reward Models
提出 DeCert 框架,用决策证书评估 rationale 有效性与一致性,构造偏好对训练生成式奖励模型
- Steering Black-Box Large Language Model Agents with Pitfall Anticipation World Model
用外部世界模型仅预测潜在坑点并选择性介入,SFT+GRPO 训练,显著提升黑盒 LLM Agent 成功率
- Extreme Compression of Per-Layer Embeddings via Cross-Layer Latent Vector Quantization
提出 OPTIC,每 token 只存一个共享量化码,各层用仿射解码器还原层嵌入,实现约 100 倍 PLE 压缩并保留 97.8% 性能
- Speculative Diffusion is a Tale of Two Tradeoffs
联合调节扩散努力与推测解码宽松度,可扩展速度-质量 Pareto 前沿
- Eat Your Precision: Precision Objective Mitigates Reward Hacking in Rubric-based RL
提出 FORK 奖励,在量规覆盖(召回)外加入精度目标,抑制冗长与事实错误,大幅提升胜率
- Build, Don't Play: Self-Improving LLM Research Agents Develop a Hearthstone Battlegrounds AI That Rivals Top Players
自改进 LLM 研究代理系统 AutoTavern 从零构建模拟器和 PPO 策略,训练出的 AI 在天梯表现超越顶尖人类玩家
- Novel or Not? PatEx-Gym: Agentic Prior-Art Search for Novelty Assessment in Patent Examination
构建专利审查 agent 基准与轨迹合成方法,训练 4B 模型在现有技术搜索上接近大模型效果
- Trajectory2Gym: Decision-Grounded Compositional Interaction Synthesis for Tool-Use Agents
通过构造组合交互并仅监督有可见历史依据的决策,大幅提升多轮工具使用智能体的 SFT 效果
- Continual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents
构建 600 级递进任务基准,量化诊断反馈与修订对 LLM 智能体经验学习的作用
- Δτ-Bench: Pushing Agents Toward a Moving Capability
构建可执行演化工具生态基准,并提出 STEWARD 联合维护工具与技能以跟上能力前沿
- DynaFlow: Learning Free-Form Multi-Agent Orchestration
将自由形式工作流合成融入主智能体动作空间,动态编排子智能体,仅训练主智能体,多任务准确率提升 10.9 个百分点
- FlashScript: Compiling Recurring Agent Workflows into Reusable Neuro-Symbolic Programs
把成功 Agent 轨迹固化为代码加局部 LLM 调用的神经符号程序,实现一致、可泛化且低成本复用
- ProAS: A Progress-Aware Advantage Shaping Framework for Multi-Turn Agentic Reinforcement Learning
用动态任务参考图对轨迹级优势做非对称掩码和惩罚重分配,解决 critic-free 智能体 RL 的均匀信用分配问题
- Work Agents: Systems, Capabilities, and Optimization
以工作为中心给出工作智能体的系统级框架,用持久性与开放性刻画条件并划分五类数字工作,梳理能力与优化路径
- Skill^{infty}: Recursive Self-Improvement for Agent Skill Optimization
将技能优化流程编码为可自我优化的 meta-skill,实现跨任务复用的递归自改进
- The Price of Scale in Proactive Memory Recall
证明主动召回门控的误报率随存储规模幂律上升,提出免标签 conformal 门控并验证其控制误报
- ACARE: Agent-Context-Aware Reranker for Iterative Search
用原始问题与推理轨迹解释子查询的 4B 点式 LLM 重排器,提升 agentic search 检索质量并减少搜索次数
- DPE-Rec: Diversity-Preserving and Efficient Diffusion Language Model Recommendation for Bundle Construction
针对扩散语言模型在 bundle 构造中的多样性损失与并行解码质量退化,提出语义分叉感知 GRPO 与伪轨迹蒸馏,实现质量提升 63%、推理加速 25.6 倍
- FOCUS: Active Critic Learning for Long-Horizon Language Model Agents
把中途状态价值细化建模为主动学习:优先在预期最大减小 Critic 估计误差的状态分支采样,并用压缩边界做长程信用分配
- GPDPO: Learning from Reward Conflicts via Group Pareto-Dominance Policy Optimization
从被冲突过滤的 rollout 中利用 Pareto 支配恢复成对偏好监督,零额外采样提升多奖励 LLM 对齐
- Hallucination-Aware Multi-Agent RAG via Internal Attention Rewards
用 TruthfulQA 校准的注意力头范数 critic 作为幻觉风险奖励,联合优化多智能体 RAG 的 query 规划、证据选择和答案生成,同时提升任务指标并降低幻觉率
- Unified Heterogeneous Feature Interaction via Effective-Rank Scaling for Recommender Systems
HiRank统一异构特征交互与序列建模,通过主序列引导检索和场景感知高阶注意力,在淘宝CVR线上提升2.27%订单/用户
- CRIM: Composable and Reusable Item Memory for Efficient Personalized Retrieval
将物品语义编码与请求历史建模分离,用可学习摘要token压缩物品为连续记忆,结合缓存与采样重编码大幅降低LLM检索成本
- Agent Memory as Recommendation: Recommender-System Design for Long-Term Memory of LLM Agents
把Agent记忆选择形式化为预算约束下的slate推荐,零LLM调用匹配64次重排且服务成本降3.2倍
- Towards a Unified Framework of Optimal Input-Side Dimensional Configuration for Deep CTR Prediction
用最优传输协调样本、特征、嵌入单元三层选择,联合配置输入侧信息提升 CTR 模型 AUC
- Octen-WebGR: Scaling Generative Retrieval to 200 Million Web Pages
首个覆盖2亿网页的生成式检索模型,用两token语义ID直接生成URL,导航点击命中率59.6%
- Useful Diversity or Hallucinated Variety? Persona-Conditioned Synthetic Query Generation for E-Commerce Search
用4轴persona prompt生成11.8万合成查询,Big Five人格稳定提parser F1且低幻觉,句法轴贴真实流量但牺牲约束保真
- SLIDE: Search-to-List Item Distillation for Single-Rollout Generative Retrieval
将离线item级beam search结果按分数拼接为列表蒸馏目标,训练学生单次贪心生成Top-K,以低成本逼近或超越线上beam search检索
- Do Similarity Measures Measure Similarity? How User Activity Creates Phantom Correlation in Recommender Systems
证明 item-item 相似度中存在由用户活跃度差异而非共同偏好导致的幻影相关,并用 Rasch 模型量化其占比
2026-10-26 30 篇 ★ 9 深度
- MolLean: A Process-Verifiable Language for Chemical Reasoning
MolLean 将化学 CoT 转为可执行状态转换,通过分层检查和 MCP 逐步验证减少幻觉并提升推理
- Generalized CycleGRPO for Fine-Grained Multimodal Understanding and Grounding
以区域-文本循环一致性作为可验证奖励,统一图像/视频细粒度理解与定位的RL框架
- HiSTEVE 1.0: Harnessing Human-Interface VLA Agents for Open-World Games
分层 VLA 智能体结合 VLM 规划与原生键鼠控制,在 Minecraft 原子与长程任务上达到 SOTA
- Dual Exam: Controlled Evaluation of Multimodal Agents and World Models
提出 Dual Exam 框架,分别评估多模态 Agent 与世界模型,发现两者任务表现不均且耦合成功率低
- Every Weight Is a Path of Shared Discrete Decisions
提出 TWIG 树结构权重表示,统一剪枝、量化、低秩与码本,LLM 权重以更少加法达到与 GPTQ 同等误差
- A Task-Centric Survey of Long-Document Visual Question Answering: Taxonomy, Evolution, and Future Directions
以任务瓶颈为主线,系统梳理长文档 VQA 的解析、证据检索、生成与评测,突出预算约束下的证据充分性
- MICE to Meet You: From Re-ranking Only to End-to-End Retrieval
首个基于 MICE 的端到端检索管线 MICE-P,用 PLAID 索引文档 token 表示,在保持 cross-encoder 效果的同时达到 late-interaction 吞吐量
- RSIHub: A Composable Framework for Agent-Evolution Methods
开源框架将 Agent 进化策略与执行评估解耦,支持公平对比、溯源与受保护评测
- 4DMemory: Benchmarking Long-Horizon Spatiotemporal Memory with Harness-Augmented Agents
发布900小时长视频基准与4DMemory Harness,使13个基础模型长时程时空推理提升超50%
- Accordion: Elastic-Depth Inference via Fixed-Prefix Layer Looping
一个 MoE 模型通过固定前缀层循环支持五个推理预算,中间预算以约 21-24% 额外时间捕获 89% 深度增益
- ActionRAG: Evidence-Refining Graph Diffusion for Long-Term Memory in LLM Agents
结合谨慎图索引与查询时接收者归一化图扩散,在 MemoryAgentBench 上以 55.1 平均分刷新检索式记忆 agent 表现
- Hierarchical GTV Estimation: Bridging the Gap between Container-Level Ranking and Item-Level Conversion
HGE 用 HSAE、PLL、RCEF 解决容器级 GTV 预估的高方差、稀疏与粒度错配,离线 XAUC +0.63pp,在线 RPS +1.42%
- From Item Scores to Semantic Tokens: Test-Time Collaborative Adaptation for Generative Recommendation
TCBSA 将判别式分数 margin 投影到语义 ID 共享边并在 beam 剪枝前门控修正,无需重训练即可提升生成式推荐新兴兴趣发现
- CRM-Agent-Bench: Benchmarking Tool-Using Agents in Stateful Enterprise Environments
用可执行合同严格评估多轮CRM任务中Agent的动作、状态与合规性,揭示说与做的差距
- When Agents Fail: Model or Harness--Who's to Blame?
提出模型-执行框架匹配度评估框架,发现无单一最佳组合,OpenCode 跨模型最稳
- Separating Thinking from Spelling for Efficient Generative Recommendation
将生成式推荐中 backbone 的历史建模与 SID 逐码生成解耦,由轻量 decoder 完成 beam search,实现 3-8 倍吞吐提升且精度不降
- Frontier-OPD: Discovering the Edge of Agent Capability and Teaching Agents to Go Beyond
通过学习前沿动态选择教师干预点,并用学生后续行为验证指导质量,提升多智能体在线蒸馏效果
- PersonalQuery-Benchmark:Evaluating Retrieval Robustness to Personalized User Expression Differences
构建首个个性化查询表达差异基准 PQB,揭示检索效果高不等于对句法与书写错误鲁棒
- HarnessMM: Recursive Self-Improvement for Harness Token Efficiency
用守卫决策复用替换工具反馈后的重复推理回调,不改模型权重即可降低Agent harness token成本
- J-Comm: Jacobian-Guided Latent Communication between LLM Agents
用无需训练的 GEAR 潜在推理与 H+J 隐式/雅可比双通道接口,让不同宽度 LLM 智能体高效传递推理状态并大幅减少文本 token
- On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models
用高层主题描述合成问答与推理轨迹,在无外部监督下完成 on-policy 自蒸馏并跨领域提升模型能力
- Interpretable sparse fine-tuning with TopKLoRA enables faithful circuit discovery
提出 TopKLoRA 稀疏 LoRA 变体,仅激活 k 个最大 latents,用于定位并精准移除后门电路
- Knowledge Distillation across Item and Code Spaces for Parallel Generative Recommendation
用 item 空间分布匹配和 code 边际匹配两个蒸馏目标,把序列模型的软分布迁移到并行语义 ID 推荐器
- Every Edge Needs a Quote: Building a Quote-Grounded Knowledge Graph of Healthcare Software Adoption with Language-Model Agents
构建每边必有逐字引文的知识图谱流程,以确定性爬取、预算化ReAct agent、分层grounding和多模型投票达到0.94精度/0.71召回
- Reimagining Enterprise RAG for Multi-Agent Systems: A Knowledge Layer That Organizes Before It Retrieves
将本体置于 artifact 层,用元数据注册表与导航超图先组织后检索,实现结构化消歧避免跨服务规则混淆
- Where Rounding Happens Matters: Rounding-Location Alignment Stabilizes LLM Reinforcement Learning
对齐训练与推理的 RoPE/SwiGLU/RMSNorm 舍入位置可避免 BF16 RL 崩溃
- SkillRep: Characterizing and Understanding the Representation Design Space of Agent Skill Retrieval
首个组合微调、双侧扩展、背景投影与BM25的0.6B技能检索器,SRA-Bench MRR@10领先7.02点
- System One models Are Not Better Rerankers
在 0.6B–27B 六个 Qwen 骨干上,决策微调从未超过重排微调,9B 以下重排微调领先 5–29 nDCG@10
- Advancing SVD-based LLM Compression via Layer-Wise Error Model Search
提出LEMS与KFAC-SVD,分别解决SVD压缩中rank分配不精确和分解rank崩溃的问题
- Agentic Memory Management Is the Next Frontier of Information Retrieval
提出 AMM 框架,将记忆对象分为 constants、functions、operators,并给出 IR 视角研究议程
2026-10-25 25 篇
- ProV-Mem: Proactive Memory for Streaming Video Question Answering
冻结 VLM 骨干下,用三层轻量记忆解耦何时查询、说什么、是否发出,实现训练无关的主动流式问答
- To Think or Not to Think: Pre-Decisional Reasoning Budgets for Referring Audio-Visual Segmentation
发现过长思维链对简单查询有害,利用生成前隐状态线性探测路由器省60% token且保留96%性能
- Who Takes the Lead? Model Ability and Task-Conditioned Collaboration with Humans
在共享控制迷宫中证明强模型能根据人类相对优势选择性分配控制,而非简单减少人类参与。
- AI Mindmeld: A Latent Interconnect Protocol
提出 LIP 协议:冻结 LLM 只训练连接器,把专家表示直接映射进 LLM 内部状态,支持零样本跨域组合
- High-Value Training Data from Noisy, Diverse Sources
用目标域小数据集元梯度优化训练样本权重,学得可泛化、可迁移的加权规则,提升奖励模型对噪声与合成数据的利用效率
- Multimodal Embodied Agents: A Unified Capability-centric Perspective from Computer-Use to Robot-Use
提出 PAPAV 五功能框架,统一比较计算机使用与机器人智能体,揭示 Anticipate 与 Verify 评测缺失
- Flow-based Spectral Kernel Learning for Nonstationary Attention
FSKA 用归一化流学习非平稳注意力核,移除 QK 投影并固定正交 V 投影,减少参数 40-47% 且保持线性注意力
- OACap: Caption-Guided Active Observation for Detailed Video Captioning
提出字幕中心 Agent OACap,将字幕信息缺口转为定向观察请求,迭代验证提升视频字幕质量
- Mitigating Model Collapse through Dreaming Learning
用高温自采样样本作正则,阻止合成数据训练中的谱隙变窄与多样性塌缩
- Data-Void Exploits in Web-Searching LLMs
仅需一个攻击者页面即可在31%的联网LLM回答中植入内容,提示语气与模型选择防御效果有限
- X-Embedding: Two-Stage Training for Multilingual Patent Prior-Art Retrieval
提出两阶段训练框架 X-Embedding,先做专利结构与多语言对齐预训练,再用 X 类引用微调,64 维 Hit@100 达 89.09%
- What the Author Wrote, What the Agent Reads: Silent Cue Loss in Enterprise Document Ingestion
企业文档摄取层丢失高亮和颜色等视觉格式线索,使 Agent 对关键义务识别 F1 骤降且自信犯错
- AfterDeleteBench: Auditing Post-Deletion Information Persistence in LLM Agents
用对照实验量化 LLM Agent 删除记忆后仍可从派生状态恢复秘密的比例
- Conservative Meta-Agent Search: Architecture Adaptation under Non-Stationarity
CMAS通过保守提升、切换成本与风险约束降低在线架构搜索的回归与成本,在96个流上优于最强自适应基线
- Adaptive Skill Granularity for Coding Agents: Runtime Routing and Macro-to-Micro Recovery
将技能粒度作为条件化动作抽象策略,通过特征控制器与宏到微恢复提升编码 Agent 鲁棒性
- Beyond Causal Masks: Auditing and Localizing Hidden Future-Token Leakage in Adaptive Sequence Models
揭示自适应路由解码器中全序列summary造成未来token泄漏,提出审计与定位方法并修复验证
- Multi-Token Prediction and Alternative Tokenization Improve Learning Latent Multi-Hop Graph Search at Scale
用多token预测和替代分词突破LLM学习隐式多跳图搜索的规模墙,实现稳定训练
- Automated Enrichment Analysis with GraphRAG: Efficient Multi-Database ORA Extraction and Biological Interpretation
将多基因集库建成术语-基因知识图谱,用紧凑证据子图驱动 LLM 生成可溯源解释,查询提速 37 倍且忠实度最高 0.90
- HERD: Harness-Evolving Recursive Distillation for Continual Learning
提出混合持续学习框架 HERD,用 harness 技能库与有界残差记忆结合双锚漂移约束蒸馏,实现新任务获取与低遗忘。
- Jev-DLC: Decision-Level Continual Learning from Typed Feedback
用接受/撤销类型化反馈构建有界状态,在冻结评分器上实现低开销持续个性化决策
- What Comes Next and Why: Interpretable Next-Event Prediction with Neuro-Symbolic Rules
学习序列规则 RULES,并与残差网络组成 RUNES,在保持精度同时提供可解释规则与残差调整
- Lean Finder V2: Semantic Search for Mathlib That Disambiguates User Queries
用对抗训练生成大规模短歧义查询,结合模型微调与输入层改写,在 MathlibQR 上至少相对提升 11%
- Who Is Sycophantic to Whom? Confident LLMs, Human Deference, and the Collapse of Trust Calibration
当 LLM 自信且一致地犯错后,人类会反向顺从:虚假事实被采纳约65%,置信校准从0.70降至随机
- Squaring-the-Sphere: Distortion-Free and Seamless Panorama Generation via CubeAtlas
提出CubeAtlas表示与布局感知稀疏注意力,单次前向生成几何一致的全景图
- The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models
用机制可解释性定位多规模LLM中的隐喻因果子空间,并实现对分类与生成任务隐喻性的操控
2026-10-24 30 篇 ★ 3 深度
- Realism VS Accuracy: Event Sequence Forecasting from a Generative Modeling Perspective
提出事件序列预测基准与Wasserstein BaryBooster算法,揭示准确性与分布真实性权衡,并将扩散模型样本聚合为SOTA预测器
- What Generation Knows: Unlocking Fine-Grained Understanding in Unified Multimodal Models
揭示统一多模态模型中生成侧表示对细粒度视觉理解的互补价值,提出 GAFU 框架压缩生成侧表示为 G tokens 供理解通路检索,显著提升细粒度任务性能
- EvalResearchBench: Can AI Agents Build Their Own Feedback for Recursive Self-Improvement?
首个系统评估 AI agent 在固定预算下自主设计、迭代并冻结评测器的基准
- IF-MAP: Influence-Function-Inspired Agent Prioritization in Multi-Agent Systems
提出 IF-MAP 黑盒方法,通过提示扰动与局部响应模型估计 agent 改进潜力,为多智能体系统确定优化优先级
- Bridging Exploration and Persona: Information-Directed Dueling for Test-Time Agent Personalization
提出 ID-TAP,将信息导向采样与神经 dueling bandit 结合,在十轮二元比较内高效适配 agent persona
- RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing
统一 LLM 路由框架,联合学习执行模式与模型选择,COMET-GRPO 分层信用分配+渐进式探索,五领域平均准确率提升 11.03%
- Heartbeat Thinking: Speculative Reasoning and Tool Execution While Listening in Realtime Voice Agents
提出 Heartbeat Thinking 机制,在用户说话期间周期性启动 Thinker 并允许已派发工具继续完成,将监听时间转化为可复用的准备,显著提升工具覆盖率并降低最终响应延迟。
- Diffusion Language Models Change Speed Across Tasks and Languages
扩散LM前向次数由输出新颖性与词稀有度决定,解码速度加权候选可提升推理准确率4.2点
- LaLa-World: Scaling Latent World Models with Natural Language Actions
用语言描述动作与视觉变化,让单一LLM潜在世界模型跨异构数据训练,实现高效规划与策略初始化
- SplatLab: Autonomous Scientific Discovery for 3DGS Research
SplatLab 实现端到端自主3DGS研究流水线,通过模块化变异、Elo锦标赛与实验绑定生成可追溯论文,PSNR最高提升3.78dB
- Different Tasks, Different Timesteps: Temporal Task-Aware Quantization for Diffusion Language Models
发现扩散语言模型量化敏感性随任务与去噪步变化,提出无标签信号驱动的混合精度量化框架T2Quant
- Getting a GRIP on Graph-Based Search for Learned Sparse Retrieval
提出 GRIP 图索引系统,将倒排启发式融入图搜索,在 MS MARCO v2 上比 Seismic 快 2.5 倍
- IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems
320B 稀疏 MoE 模型,通过多阶段训练和模型合并强化 CLI agent 编码能力
- SCOPE: Compiling Natural-Language Policies into Neurosymbolic Predicate Programs
将复杂 Agent 策略编译为可执行神经符号谓词程序,用对抗反例联合优化,实现低成本高稳定策略判决
- What Makes a Good Unmasking Policy? A Controlled Study of Learned Unmasking in Diffusion Language Models
系统解耦学习式去掩码策略,提出轨迹收缩目标,856K参数策略在LLaDA-8B上取得最优精度-效率前沿
- WeVisOne-VL: Unified Visual Perception from Objects to Pixels
用结构化 next-token 预测统一目标级与像素级视觉感知,支持检测、定位、分割与抠图
- Real PMIDs, Wrong Papers: Harness Design for Biomedical Claim-Verification Agents
对照实验表明检索而非推理是医疗文献验证代理的瓶颈,自写查询代理提升召回但预算利用不足
- RIDAR: Safeguarding Research Integrity in Autonomous Research Agents via Automated Detection and Runtime Intervention
提出研究完整性违规分类法与 RIDAR 框架,离线检测 F1 85.2%,运行时干预减少违规 36.8%
- Atlas: Making Sense of Long Horizon Agent Trajectories
用轨迹树和产物投影,把长程 Agent 运行表示为目标-决策-产物三层,提升决策透明和复盘效率
- CARL: Chat Assisted Reinforcement Learning
通过人机协同的十步规范工作流与自主工具循环,解决 RL 的规范与性能差距,避免奖励黑客和状态混叠
- DIAL: Steerable Language Models with Distilled Instruction-Adherence Levels
轻量steering adapter+CFG蒸馏实现LLM指令遵循程度细粒度控制,并保持高吞吐与跨指令泛化
- Inherited, Not Invented: Tracing the Provenance of Wait in Reasoning Models
通过追踪开放模型训练历史,证明 wait 等修订标记主要继承自训练数据而非 RL 凭空创造
- Predictable performance is suboptimal, and what it means for model routing
证明性能预测仅在模型次优或预测器容量大时才优于模型自置信度,级联路由同理
- When LLMs Forget What They Believe: Characterizing State Integrity Collapse in Long-Horizon Dialogues
定义状态完整性崩塌,用 StateTrack-Bench 揭示长对话中模型“记得但不执行”约束的失败模式,并验证结构化锚定可部分恢复
- How Depth Growth and Looping Shape In-Context Learning in Language Models
证明深度增长与循环模型共享更强的上下文学习归纳偏置,并揭示归纳头传播机制
- SQuAT: Spherical Lattice Vector Quantization-Aware Training
提出分离STE的shape-gain向量量化训练,诱导球面优化,实现LLM低比特压缩SOTA
- Reliable AI-Assisted Decisions via Selective Auditing
提出在线选择性审计框架,在控制未审计 AI 错误比例低于阈值的同时最小化人工审计频率
- The Value of Memory in Language Agents
提出决策论框架,量化记忆在保留、使用、恢复与修订中的价值,并用反例和诊断揭示信息时序、检索接口、读策略与需求不确定性的作用
- Chunk Recomputation under Real Document Revisions: Measuring Update Cost and Retrieval Quality of Fixed, Recursive, and Content-Defined Chunking
在真实维基百科修订对上量化三种分块策略的嵌入重算成本与检索质量,发现更新成本差异显著且检索质量相近
- Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2
用工具型 LLM agent 低成本审计斯洛伐克语 FineWeb2,产出可执行测试并发现 140 万篇机器生成内容
2026-10-23 30 篇 ★ 13 深度
- Deep Fusion Memory: A Chunk-Level Parametric Memory for Large Language Models
提出块级参数化记忆DFM,训练数据构造检索量降低32倍,并深度融合进隐藏状态,无需在线检索
- VerifierBench: Benchmarking the Generation of Executable Verifiers for LLM Agents
构建VerifierBench与V4V审计,揭示LLM生成的验证器普遍过严,多数假拒源于不接受任何有效解
- Deep Search in Real-World Web Environments
提出 OpenDS 任务与 200 题基准,12 个前沿模型最好仅 39.0% 准确率,人类 21.1%
- Meta Expert: Cross-Layer Expert Sharing for Storage- and Retrieval-Efficient MoE
用跨层共享的 Meta Expert 替代层私有专家,在 Iso-FLOPs 下仅需 70-80% 专家数即可匹配 Vanilla MoE
- Bridged Self-Distillation for On-Policy Learning
提出 Bridged Self-Distillation 统一框架,用教师推理轨迹作特权上下文,通过自教师与 verifier 实现在线策略蒸馏,适用于任意教师场景
- Retrieval Augmented Generation Compositionality
系统评估RAG各阶段技术组合,发现孤立增益不可叠加且最优组合随语料规模变化
- ToM2Vec: Continuous Theory-of-Mind Tokens for Multi-Agent Coordination
用固定预算连续推理 token 在潜空间建模伙伴心智状态,提升多智能体协作且 latent 推理优于文本表达
- When Agentic Retrieval Fails Silently: Framework and Production Evidence from a Creative AI Assistant
提出 LARA 三层评估与四字段血缘 schema,解决 agentic 助手检索归因缺失,并用 Adobe Express 生产数据验证
- Cola2: Co-Adaptive Hierarchical Language Modeling with Continuous Semantic Compression and Balanced Discrete Generation
提出Cola2,通过连续语义压缩、离散重建-生成平衡与连续-离散协同适应,346B tokens训练8任务平均60.10超越Llama-3-8B部分任务
- FAIRGate: Agentic Runtime Policy Selection and Verified Repair for Fairer Recommendation Delivery
在推荐 top-K 交付中加 agentic 策略选择层,从预定义公平策略库按运行时上下文选择并执行验证修复
- Is Complex Agentic Memory Always Needed? Naive RAG Is Stronger Than We Thought
在长对话理解中,基于原始历史的朴素 RAG 在多数基准上超越复杂 agentic memory,并揭示保留原始信息的重要性
- Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research Reports
构建首个以源视频为中心的深度研究 Agent 基准 OmniDR-Bench,并提出原子化 Rubric 树评测方法
- Bezier-Guided Adaptive Flow for Cross-domain Sequential Recommendation
提出 BGAFlow,结合 LLM 共享语义空间与个性化 horizon,用条件贝塞尔曲线和残差流实现跨域兴趣状态自适应迁移
- BeNice! Closing Looping's Inference-Memory Gap via KV-Sharing
用随机深度预训练加末层KV广播后训练,实现循环模型跨层KV共享且不掉点
- Low-Bit N-Gram Embeddings for Language Models
低精度存储 n-gram 嵌入表,4-bit 可节省约 75% 表内存且几乎不损失性能
- Better Reasoning, Not Just Bigger Models: A Structure-Grounded Framework for Efficient and Reliable Inference
训练无关的 SGUR 框架用先验加权图匹配与主动信息增益消减多轮推理不确定性,医学诊断 Hit@3 达 92.5% 且 token 少 5 倍
- When to Follow the Teacher: Advantage-Based On-Policy Distillation
AOPD 用学生优势加权教师动作,仅靠标准 rollout 和终局奖励即可无偏估计,提升在线蒸馏效率与效果
- The Fusion Tax: A Diagnostic Analysis of When Hybrid Retrieval Hurts
系统量化 BM25+密集检索融合在单查询上的损失,发现即便平均提升,13-48%查询反受损
- Rethinking Sequence Compression with Test-time Regression
提出 TTR-Compressor,将序列压缩视为测试时回归并用闭式解聚合 token,在稀疏注意力和视觉 token 合并上优于 pooling/投影
- Towards User Simulators That Stay On Task And Still Sound Natural
用 RL 联合动态对抗判别器训练用户模拟器,有效对话率 46.2%,为最强现有模型的 3.3 倍
- Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG
把层级RAG受限解码编译为一次prefill+树因果probe,零输出token复制串行策略
- Lychee: Certified Screening of Inverted Lists for High-Recall Vector Search
Lychee 在 GPU 倒排索引上通过 certified screening 跳过大部分向量读取,实现高召回向量搜索加速
- OneLatent: Latent Reasoning for Efficient Foundation Recommendation Models
用可学习潜在 token 压缩显式 CoT 推理,实现 Latent-Reason-then-Answer,精度与吞吐双提升
- PAIR: Preference-Aligned Intent Retrieval for Premium People Recommendation at LinkedIn
用曝光条件偏好对比学习与可增量更新的历史注意力,将 LinkedIn Premium 人推荐检索 MAR@100 提升 56%,线上 CTR +7.5%
- A Fix for Softmax and Cross-Entropy
修复 softmax/cross-entropy 的两个数值 bug,消除 Slingshot 尖刺与蒸馏漂移
- Same Luck, Different Choice: Twin-World Credit Assignment for Agentic Reinforcement Learning
共享 Gumbel 噪声的孪生世界实现 turn 级反事实信用分配,方差降为 1−ρ 倍,7 个 QA 基准平均提升 5.3/4.5 点 EM
- UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping Agents
构建真实电商长程交互基准与五级评估协议,并提出 on-policy trajectory distillation 提升用户模拟器保真度
- Training Small Language Models for Transferable Tool Selection
用SFT+RL训练Qwen3小模型,在Plan-Retrieve-Select流程中超过Llama-4-Maverick并零样本迁移工具域
- Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation
提出 CausalCoT 推理框架,将问题拆成 DAG 原子子问题并在隔离上下文中求解,提升因果敏感度与解释忠实度
- Direct Pass@$k$ Optimization for Thought Pruning: Balancing Quality and Diversity in Test-Time Reasoning
直接优化所选候选池的 pass@k,让质量与多样性在剪枝中自动平衡,超越现有策略
2026-10-22 30 篇 ★ 16 深度
- EAU: Environment-Agent-User Co-evolution for Training User-Centric Agents
提出 EAU 元代理框架,在 RL 训练中在线诊断并修改用户模拟器、环境奖励与超参,实现三者协同进化
- Socratic Skill Learning: Interleaving Teaching and Practice for Transferable Agent Skills
通过教学与实践交替学习可复用的 Agent 技能,并构建 SkillTransferBench 验证迁移性
- DeLoop: Repeated Actions as Self-Supervision for Long-Horizon Agents
把 agent 重复动作当负样本、同 rollout 后续恢复动作当正样本做 DPO,大幅降低上下文压缩下的循环率
- Which Agent's Skill Should Change? Group-Relative Credit Assignment for Evolving Multi-Agent Teams
GRSE 用同题多轨迹对比把团队 reward 归因到 agent-skill 并驱动技能修订,超越 MASkills
- On the Fragility of Tasks under Composition: Implicit Budgeting in Language Models
发现 LLM 在单 prompt 组合多任务时按比例压缩每任务推理 token,导致长推理任务更易出错,并可按脆弱性分组省 43% token
- Ask to Distill: Learning to Synthesize Data for On-Policy Distillation
用教师-学生分布分歧作为无答案信号,训练合成器生成能暴露教师监督的问题,提升on-policy蒸馏效率。
- Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures
通过不同学科背景、私有历史与自适应分配组织多智能体团队,自主搜索出优于GDN2的线性注意力架构
- Qwen-Audio-3.1-ASR Technical Report
在 Qwen-Audio-3.0-ASR 基础上扩展说话人分离与通用音频理解,覆盖多语言、多方言及流式/非流式部署
- Self-Credit: Credit Assignment for Long-Horizon Agentic RL via Intra-group Rescaling
让策略模型在压缩上下文时引用关键轮次,再用同 prompt 成功/失败样本的组内对比重标定引用权重,将稀疏结果奖励转化为轮次级信用信号
- SweepANN: A GPU-Accelerated Large-K Approximate Vector Search for Drug Discovery
GPU 分区扫描与窗口阈值过滤实现大 K 高召回向量检索,在药物筛选中达 99.6% 召回且比现有方案快 8-24x
- Training the Whole Agent, Not Just the Model
HarnessAdapt-RL 在强化学习中同时训练策略模型与工具/hooks,显著提升 coding agent 的 pass@1
- Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?
构建AGENT4SCI科学ML测试床,前沿Agent在20个基准上平均相对提升10.4%,加技能后达20.1%,提升主要来自工程技巧而非科学洞见
- Memory-Centric Continual Learning for AI Agents
提出以记忆是否改进未来行动为核心的三轴分类、双循环生命周期与评测协议
- Harness Scaling for Generalizable Agentic Reinforcement Learning
将 agent 执行 harness 因子化并正交选择 18 个训练配置,跨 harness RL 显著提升未见配置与外部黑盒泛化
- TraceForge: Distilling with Your Own Thinking
提出 TraceForge,在仅有教师答案时合成学生家族原生推理轨迹用于蒸馏,代码任务提升显著
- Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting
构建代理-环境闭环,通过参数、技能、环境三轴演化实现递归自改进,连续三周登顶FutureX
- Think Harder Where It Matters: Item-Level Adaptive Recursion for Sequential Recommendation
LoopRec 把序列推荐从固定深度改为逐 item 可退出递归,无需深度标签即可适应多 backbone 并稳定提升效果
- Directional Posterior Feedback Fusion for Query Reformulation in Dense Retrieval
把反馈向量转为原查询切空间上的方向性约束并做后验融合,训练无关地提升稠密检索查询改写
- Progressive Learning from Content to Relevance to Personalization for CTR Prediction
用多尺度细粒度 Semantic ID 将多模态内容融入 ID 型 CTR 模型,先做 query-item 相关性预训练再做点击微调,显著提升冷启动与创意区分
- EPIC: Rethinking Trust Regions for Autoregressive LLM Policies via Exact-KL Prefix Importance-Ratio Clipping
提出前缀累积似然比作为精确重要性权重,用 r-1-log r 坐标构建校准裁剪目标,稳定离线 MoE RL 训练
- Robust Soft Skill Adaptation via Behavioral Localization in Tool-Using Agents
提出 Behavioral Localization,定位技能真正改变行为的少量轨迹位置来训练短 soft prompt,减少漂移并提升任务成功率
- Circuits of LLM Classifiers
将多个 LLM 分类器组织为自适应查询电路,以更低成本突破路由/级联的准确率前沿
- LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data
LongZero 让 LLM 无需外部数据,通过自合成紧凑证据再展开为长上下文,用 GRPO 提升长上下文推理
- MAPS: Macro-Adaptive Parallel Reasoning for Regulating Search Momentum in Retrieval-Augmented Generation
提出 search momentum 量化迭代 RAG 中的查询意图漂移,并用轨迹解耦与并行多方向检索缓解漂移
- Preference Is Not Permission: Personalizing the Auto-Purchase Line in Agentic Commerce
提出个性化自动购买授权边界任务,发现16个LLM购物Agent过度承诺,个人边界可从少量标注习得
- pplx-embed-v2-late Technical Report
用 18B 教师表征蒸馏出 0.6B/9B 多模态 late-interaction 模型,支持大模型离线建库、小模型在线查询的共享向量空间
- Learning Marginal Viewpoint Utility for Budgeted Evidence Selection in RAG
提出LMVU轻量排序器,按边际视角覆盖增量选择证据,在有限上下文下提升多视角覆盖
- Generative Recommenders Forget the Long Tail: Restoring Memorization in Retrieval and Ranking
提出无训练插件 CAPE,用 item-level 共现记忆同时修复生成式推荐的检索剪枝和排序偏差,显著提升长尾命中
- Reasoning-Search-Augmented LLMs: An Operational Taxonomy, Benchmark Analysis and Controlled Evidence Synthesis
提出四架构轴+学习信号分类框架,系统梳理推理-搜索Agent设计与消融证据
- One Act, Many Masks: Effect-Marginal Policy Optimization for Long-Horizon Agents
提出 EMPO,对执行等价响应共享长度归一化策略比率,消除信用-更新错位,提升 GRPO/GiGPO 长程任务效果和效率
2026-10-21 30 篇 ★ 17 深度
- HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention
提出 harness 与环境协同进化框架,自动构造可行/不可行任务对,弃权准确率提升至83.3%,跨19个LLM平均提升15.3个百分点
- Heterogeneous Agentic Coevolution
提出 HACE 框架,让专用基础模型与 LLM agent 互惠共进化,在推荐、蛋白质功能、材料稳定预测上全面超越收敛后基线
- Harness-Delta Attribution: Dissecting Gains From Harness Evolution
提出 HDA 协议,将 harness 进化增益归因为 overfitting、test-time scaling 与 residual 三类
- First Passage Attention
用路径极值替代累加衰减,实现选择性上下文擦除并压缩 KV cache 到 25% 仍保持长程检索
- Predicting Privileged Information Effectiveness for On-Policy Self-Distillation
系统评估多轮代理场景下16种特权信息配置,提出KL散度指标预测其训练收益
- N-Gram Memories at Two Bits: Quantizing Lookup Tables in Large Language Models
共享 Gaussian trellis 与 norm restoration 将条件记忆行压缩为 2-bit 码,KL 较 2-bit RTN 降低 41-63%,DeepSeek 表由 203GB 降至 51GB
- HybridResearcher: Bridging the Structured-Unstructured Boundary for Deep Research Agents
4B深度研究Agent经跨源桥接轨迹合成训练,在混合基准上超397B大模型8.3分且无灾难遗忘
- Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents
提出 ProD,在蒸馏中显式惩罚学生轨迹停滞,提高小模型 Agent 成功率与推理效率
- CoEvo-RSI: When Harnesses Evolve, Which Models Should Follow?
用元智能体协调历史执行框架与模型检查点选择/合并,并用自身拒绝采样轨迹 SFT,减少递归自我提升中的脑体不匹配
- More Memory, Worse Agents: Error Reproduction and Anti-Persistence in LLM Agents
提出 Anti-Persistence 记忆:只存轨迹和结果,抽象按需合成并丢弃,抑制错误复现,提升成功率并降低成本
- HarnessRL: Co-Evolving Policies with a Just-in-Time Training Harness for Open-Ended RL
提出 HarnessRL,通过任务采样、rollout 引导与 rubric 标准三接口协同进化,并在冻结策略上实测更新效果,显著减少奖励失效。
- TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning
提出可插入组件 TokenGate,通过类 MoE 的 token-gated attention 端到端训练 token 剪枝,大幅加速长上下文预填充且精度不降
- Harness Self-Evolution for Long-Horizon Terminal Agents
固定模型权重,通过成功/失败对照轨迹与运行时监控证据迭代改进 agent harness,提升任务可靠性与成功率
- Large Flow Language Models
Lafa 8B 连续流语言模型用 <30B token 训练达到 AR 质量,并以自推测解码实现 2.54 倍吞吐
- FLINT: Fixed-budget Late Interaction
通过对称注意力池化,将查询和文档压缩为固定数量向量,大幅减少多向量检索的存储和计算开销
- Neighborhood-Aware Unlearning for Generative Recommendation
NAU 结合 SID 级遗忘目标与邻域概率质量控制,消除生成式推荐遗忘对共享 token 邻近物品的泄漏,保持超 95% 重训效用
- PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking
训练迭代 k 预测前 k 步状态并锚定范数,使 0.5B 模型在状态跟踪上将外推因子提升至 16 倍
- Sage-A1.5: From Long-Horizon Execution to Scientific Exploration with Capability Composition
35B MoE 智能体模型,通过 Agentic Orchestration 与 Agentic Verification 实现并行子智能体协作与自校正,在多项长程任务上超过更大模型
- AutoSim: A Self-Improving User Simulator for Conversational Search Evaluation
Prompt 级自改进无法消除对话搜索模拟器与真实用户行为差距,权重级对抗微调把判别 AUC 降到 0.45 并修正评估偏差。
- DeclineCraft: A RAG Abstention Benchmark for Jointly Measuring Combined Retrieval and Parametric Knowledge
提出 DeclineCraft 基准,度量模型在检索与参数知识均不足时正确弃答的能力,揭示迭代 RAG 等增强策略反而降低弃答率。
- Multimodal Reranking Is a System One Decision
将多模态重排转化为System One选择题,通用VLM一次前向读logits排序,零样本超越专用小模型,文本决策微调有增益
- ECHO: Efficient Cascade with Homogeneous Operators for Distillation-Guided 100K-Sequence Modeling
蒸馏引导的用户级选择+目标感知检索,将100K长序列压缩至10K原始记录,在线计算量降160倍且GAUC提升
- Baseline and Incremental: User, Item, and Request Debiasing in Instagram Feed Ranking
在排序价值模型中保留原始预测并给增量项单独权重,用一个算子统一用户、物品、请求三类去偏
- Evolving Agent Interfaces
让智能体自主进化计算机操作接口,27B开源模型以低成本超越GPT-5.5和Claude Opus 4.8
- Evolving Semantic Indexes for Generative Retrieval
用 LLM 进化搜索自动优化生成式检索的语义索引,以 1M 参数 proxy 加速评估,在多个数据集显著提升召回率
- MAS-Guard: Unified Guardrails from Individual Agents to Multi-Agent LLM Systems
统一运行时护栏框架,结合本地A-Guard与系统级Charter/Control Plane,ASR降低71.5-86.3%同时保持效用
- Object-Oriented Harness: Evolving Agent Harnesses through Object-Oriented Design
用继承构建可复用 harness 类并基于执行轨迹路由,三基准最高提升15.79个百分点
- Cache Engineering for Agents
提出 cache engineering 让 Agent 通过 drop/repos 直接控制 KV cache,无需改轨迹或重算;AKV 服务系统实现 27.7% 成本下降与 1.51x P95 延迟加速
- OptionWorld: A Benchmark for Diagnosing Failures of LLMs as Long-Term Personal Assistants
提出 OptionWorld 基准,追踪从信息获取到行动结果的完整链路,定位 LLM 长期助手跨天任务失败环节
- SPAR: Stepwise Personalized Autoregressive Recommendation with Prefix-Balanced Semantic IDs
提出前缀平衡语义ID构建与逐步个性化解码,缓解生成式推荐分支不平衡和证据不匹配
2026-10-20 30 篇 ★ 25 深度
- Self-Evaluating Recursive Agents
训练递归智能体生成与学习对齐的 rubric,以自我评估子任务,降低外部监督并提升执行与分解能力
- DisaggKD: Efficient Knowledge Distillation through Teacher-Student Disaggregation and a Fused Loss
提出教师-学生分离的KD框架,通过fused loss和prefetch ring突破显存限制,匹配同布局损失并提速
- Interlock: From Local Correctness to Task Completion in Long-Horizon Agents
用 typed completion graph 约束长程任务合成,并以完成过滤的 RFT 提升 Agent 在外部基准上的完成率
- Lean4AgenticRL: Advancing Agentic RL with Verifiable Multi-level Process Rewards
用 Lean4 统一多层级可验证过程奖励,配合 workflow-stage-normalized GRPO 稳定提升 Agentic RL 训练效果
- RSIFlow: Adaptive Self-Improvement Workflows with an Evolving Meta-Agent
提出 RSIFlow,将自适应工作流编排与元Agent harness 演化耦合,动态诊断瓶颈并更新模型/框架/工件,6基准11/12领先
- OR-License: Evaluating LLM Agents as Real-World Operations Research Practitioners
用 31 个真实付费 OR 项目构建基准,通过客户端模拟器评估 LLM Agent 从原始需求到可部署方案的端到端能力
- Self-Evolving Coding Agents via Harness-Policy Optimization
提出 Self-HPO 框架,交替优化编码代理的 harness 与 policy,实现递归自改进,显著提升编码任务解决率
- CoworkEnv: Synthesizing Training Environments for Long-Horizon Cowork Agents
用工作流需求合成可执行训练环境,同时产出 SFT 演示与 RL 奖励,训练小型 cowork agent
- HarnessPro: Recursive Harness Self-Improvement with Pareto Optimization for Performance-Cost Trade-offs
多智能体递归改进 agent harness,用 Pareto 选择产出 lite/medium/heavy 三档,同时提升 pass rate 并降低执行成本
- Divergence based Ranked Preference Alignment for LLMs
将f-divergence对齐框架扩展到排序偏好,提出f-RPO,在排名恢复和生成质量上优于排序baseline
- MEMORA: A Memory-Enhanced Multimodal Committee Reranking Agent for Reasoning-Intensive Retrieval
提出记忆增强多模态委员会重排 Agent,将查询分解为意图因子并用 episodic memory 调整优先级,在 MM-BRIGHT 上 nDCG@10 达 41.5/38.9
- Toward Agentic Retrieval-Augmented Generation for Enterprise Retail Workflows over Heterogeneous Data Sources
提出RetailBridge多源零售QA基准与RetailRAG框架,定位跨源链式为瓶颈
- OpenVLHarness: Real World Visual Agentic Tool-Use with Multimodal Memory
通过能力层与持久多模态记忆统一工具输出,多模态 LLM 在 22 个基准上平均提升 9.7-12.6 分
- RemoteANN: A Native Vector Search Engine for Cloud Object Storage
通过 IVF+RaBitQ 量化与数据重排序、请求合并等协同设计,大幅降低云对象存储向量搜索的 I/O 与 API 请求成本
- Selling in the Wild: Benchmark and Randomized Field Evidence for a Sales Agent Trained on Commercial Conversations
用460万真实商业对话微调Qwen3-32B销售Agent,在100个网站随机试验中比无Agent提升10%收入,比前沿模型提升21.6%转化
- When Semantics Fall Short: Persona-Guided Cross-Domain Sequential Recommendation with Large Language Models
用 LLM 推断用户画像作为全局引导替代跨域语义桥接,结合本地语义关联提升跨域序列推荐
- Remembering Has a Price: Learning Memory Worth under Resource Constraints
提出 TokenWorth,在线学习 query-dependent 记忆价值并统一用于检索与记忆淘汰,在资源受限终身智能体任务中成功率最高且输出 token 最少
- AGR: Agentic Generative Retrieval with Tool-Augmented Search
把异构特征封装为可调用工具,按需在 SID 解码中注入观察 token,实现请求与层级自适应的生成式检索
- Don't Rewrite the SID Map: Topology Preservation for Generative Retrieval in Dynamic E-Commerce Search
系统量化 SID 重映射损害,提出冻结旧 SID/插入新物品/热启动的拓扑保持更新原则,线上 GMV +1.16%
- Decision4Rec: A Jev-Inspired Framework of Decision Models on Knowledge and Active Graphs for Multi-Agent Recommender Systems
将决策模型(Jev/Kev)用于推荐重排,结合场景知识图谱语句和多智能体候选池,在稀疏Amazon目录上NDCG@10提升25%-36%。
- The Scheduler Is a Hidden Retriever: How Asynchrony Shapes Evidence Acquisition in Search Agents
证明送达顺序会改变搜索 Agent 的检索决策与证据获取,并提出 CEA 实现调度不变且免全局等待的稳定证据获取
- FLMNet: Self-Ensemble Distillation from Masks to Seeds for Single-Tower CTR Prediction
把 masked 自集成目标推到无穷 mask 极限,得到闭式 Jensen gap 正则,单塔一次前向即可训练;再叠加跨 seed 蒸馏
- Parallel Language Models via Variational Decoding
用潜变量路由 token 间依赖,单次前向生成多个一致 token,实现接近自回归质量的 2.3-5.7 倍推理加速
- Learning Complementary Agent Groups via Task Hypergraphs for Next-POI Recommendation with Missing Modalities
用任务超图动态选择互补 Agent 组,在缺失多模态 POI 重排中带来 8.4–9.1% NDCG@20 相对提升
- MAPS: A Multi-Agent Personalized Script-Driven Video Advertising System Enhanced by Reinforcement Learning
多智能体闭环生成个性化视频广告脚本,结合 GRPO 多维奖励,在线 CTR/CVR/ARPU 显著提升
- MemT-1.0: Towards Memory-Native Evolution
提出 MemT-1.0,用 Gated DeltaNet-2 与 MoS 将记忆内化为模型原生状态,128K 历史下较 full KV cache 提速 1.86×、存储降 66×
- OneChord: Distill What You Rank, Recommend in One Pass
学习 SID 与 item 匹配的 catalog 归一化融合分布,并通过蒸馏将 refined 排序迁移到 one-pass 推理,平均 NDCG@5 提升 7.12%,推理更快
- OpenSaC: A Python Library for Search as Code in Deep Research Agents
开源 Python 库 OpenSaC 将搜索、抓取、重排、LLM 调用组合为可执行程序,使 Codex 类智能体做深度研究时显著节省 token 与时间
- WeAct: Dynamic Weight Switching as Agent Actions
把 LoRA 适配器切换做成 Agent 原生工具调用,冻结主干独立训练 Plan/Search/Writing 模块,在 deep-research 任务上超越全参微调和静态合并
- Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
开源流水线合成 GUI/MCP/CLI 跨界面环境与长程任务,用质量门控与 RL 训练出跨 8 个 OOD 基准泛化的 CUA 智能体
2026-10-19 30 篇 ★ 10 深度
- PRISM: PRIvileged Sibling-guided Multi-Agent Topology Design
利用同一 query 的其他成功拓扑作为特权输入,通过 on-policy 蒸馏改进多智能体拓扑生成器后训练
- FC-SWE: Failure-Conditioned RL for Long-Horizon Software Engineering Agents
引入失败条件 RL 框架,将失败补丁与验证反馈作为恢复轨迹上下文,SWE-bench Verified Resolved@1 从 GRPO 的 38.9% 提升至 41.7%
- OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools
开源移动智能体OpenMobile-2,提供110+应用环境、12K SFT轨迹与2K可验证RL任务,支持GUI与原生工具混合使用
- Dream2Discern: Learning from Hard Latent Variants for Runtime Failure Prediction in Multi-Agent Systems
用自预测损失引导的隐式增广,把有限轨迹语料变成可再生难例源,提升多智能体失败审计
- DuoDiscover: Scaling Autonomous Discovery Beyond the Evaluation Bottleneck
Agent联合发现优化目标与廉价代理评估器,突破昂贵评估瓶颈
- BizBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business
构建含789文档/601工具的支付业务基准,同时评估目标达成与中间执行合规,前沿模型严格成功率仅64%
- DAGFormer: Global Topology Prediction for Transformer Cross-Layer Connections
引入联合训练的拓扑预测器一次性规划全局跨层连接,以输入自适应强度路由信息,显著提升 Transformer 效率与效果
- LEV: Thinking Fast and Deep with Looped Decision Models
提出 LEV,通过循环重跑层而非生成 token 实现自适应深度推理,在决策任务上以低计算开销提升准确率
- ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models
首个利用混合线性注意力循环状态做位置特定上下文检索的投机解码方法,平均3.16倍解码加速
- Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models
提出 SABER 基准评估属性-物体绑定,并证明仅用合成文本微调 MLLM embedder 可跨模态迁移提升检索
- DLite: History-free Speculative Decoding for Agentic AI
DLite 复用目标模型隐藏状态进行局部投机预测,避免维护历史 KV cache,在 agentic 任务中接受长度达 2-6 并超 DSpark 最高 70%
- Towards Looped Models Done Right, Part I: Topology, Input Injection, Recurrent-State Design
系统消融循环LLM的拓扑、输入注入和循环状态设计,证明Huginn架构在稠密和MoE模型上均优于Ouro且参数效率更高
- Tree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning
提出 TreeOPSD,用树回溯信用构建有限目标分布,以 Forward-KL 后验蒸馏替代固定策略梯度,无 critic 地稳定长程 Agent RL
- OfficeTown: Generative Organizations for Evolving Agent Intelligence
用生成式组织模拟持续产生专业任务、上下文与反馈,构建 406 任务基准并训练提升 Qwen3.5-9B
- Beyond the Answer: Student-Conditioned Trace Construction for Reasoning Distillation
提出 ReDiST,以学生自身尝试为起点构建并筛选推理轨迹,提升推理蒸馏效果
- Learning Personalized Memory Gating from Delayed One-Sided Feedback
将 Agent 记忆门控建模为延迟单侧反馈的 contextual apple tasting,提出 Warm-Start UCB 实现用户级个性化选择
- Code Skill Server: A Large-Scale Search Engine for Code Generation Skills
构建包含 993 个代码生成技能的检索服务器,检索注入可提升 Pass@1 最高 13.91%
- Darwin-Claw: Environment-Adaptive Experience Consolidation for Recursively Self-Evolving Agents
提出 Darwin-Claw,将交互失败归因为结构化经验单元并外置到技能槽位,驱动递归自进化,在 WildClawBench 上平均得分提升 24.1%
- DrugHarness: An Evolvable Agent Harness for Computational Drug Discovery
通过条件技能归纳与独立审核,构建可进化的科学代理框架,显著提升分子筛选与优化能力
- Tool Recommendation for Multi-Step Agents: Finding Every Tool a Task Needs
部署的 Tool Recommendation 系统用固定三工具接口为多步 Agent 提供全目录 8200+ 工具,实现工具链完整性与端到端成本双赢
- FuTransformer: FP8 prefill and INT4 decode for Llama-style inference on Hopper
在 H100 上实现 Llama 风格 Transformer 推理 CUDA kernel,prefill 用 FP8,decode 用 INT4 权重和旋转 INT4 KV cache,单步解码从 8.1ms 降至 2.8ms
- GatewayBench: Unified Capability and Security Evaluation Platform for MCP Gateways
首个 MCP 网关统一评测基准,量化扁平与层级网关在任务完成、效率与攻击韧性上的差异
- GLOBE: Evolving Structured Agentic Memory for E-commerce Product Optimization in Generative Search
把商品改写策略存成字段级行为手册,用排名反馈持续演化、去冗余并淘汰有害策略
- From Trajectories to Differentiated Skills: Cognitive Differentiation for Self-Improving Agents
提出 CDSE 将轨迹提炼为 Meta/Experience/Tool/Script 四类功能分化组件,统一维护与自适应调用,在 36 个评测设置中全面超越既有技能进化方法
- MARS: Memory-Aware Routing for Session-Level LLM Assistants
通过共享会话状态协调记忆暴露与模型选择,在长历史交互中实现质量-成本平衡
- Acceptance Is Not Speed: Length Inflation in Training-Free Lossy Speculative Decoding
发现 relaxed 推测解码的接受 token 数增加会伴随生成长度膨胀和推理延长,使指标失真,应报告完成长度和验证轮数
- MuninAI: A Self-Hosted Agentic Framework for Independent Research Groups
开源自托管 Agent 框架将开放权重模型与检索、阅读、计算工具编排,使文献问答准确率翻倍且几乎不产生幻觉
- RL-Guided Temporal Localization for Dual-Channel Retrieval in Long-Horizon Agent Memory
用RL训练时间区间定位器,在检索阶段引入时间约束,缓解语义相似但时间不匹配记忆淹没目标证据
- SkillBrowser: Selective Skill Exposure for Scalable Skill-Using Agents
提出 Meta-Skill 管理框架,让智能体按需识别能力需求并加载技能,优于静态检索和 LLM 选择
- Reasoning Reranking with Semantic IDs as the Sole Item Representation
构建 RERANKID 测试床,证明纯 SID 推理重排可由后训练激发;8B RLVR 在 20 倍更短提示下匹配文本 LLM,但 rationale 不可信
2026-10-18 30 篇 ★ 5 深度
- MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing
训练多模态Agent自动搜索、验证并裁剪动作参考,输出grounded prompt与reference clip,显著提升冻结视频编辑模型的专业动作编辑能力。
- Structural Segmentation for Brazilian Legal Document Retrieval
长法律文档按结构分块索引可提升稠密检索效果,完整层级非必需,核心块加文档元数据即可
- CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness
Agentic 框架将视频世界模型作为统一视觉推理引擎,通过可进化 tool/skill 动态生成视觉证据,多基准相对提升 11.8%–13.0%
- PathFM: Fast Generative Forecasting of Multivariate Trajectories
PathFM 用 flow matching 生成完整多元轨迹,通过蒸馏与共享 KV cache 实现近单次查询速度,并取得最优路径分数
- Player-1: Learning to Play from Synthetic Experience
Player-1利用合成环境和PPO强化学习,将游戏智能体MineDojo-300成功率提升至38.33%,远超SFT基线
- Bridging the Topological Divide: Dual-Branch Graph Distillation with Semantic Priors for Robust Cold-Start Recommendation
双分支图知识蒸馏:教师端语义先验重塑流形,学生端余弦蒸馏跨模态对齐,冷启动显著提升
- RCER: Reconstructing Cross-Evidence Relations for Iterative Retrieval-Augmented Generation
在迭代 RAG 中重建跨证据实体对应与推理依赖,多跳 QA 平均 EM/F1 提升 2.83/3.06
- Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution
提出 TaskVM,将 GUI 任务建模为可编辑契约,实现可验证与可恢复的代理执行
- Failure Is the Mother of Success: Recovering Supervision with Grounding Hindsight
提出 RSHD:从失败 rollout 写纠正笔记,经重放效果筛选和防泄漏后蒸馏回 plain-prompt,在 GRPO 全失败组上恢复监督信号
- XViewRank: Overlap-Conditioned Score Fusion for LLM-Augmented Sparse Retrieval
提出轻量检索端方法,将 BM25 分数与查询级重叠作为上下文,用小型非线性 scorer 条件融合多查询视图结果
- BitSparse: Compact Activation Storage for ReLU Feed-Forward Networks
提出 GPU 端无损稀疏激活压缩格式 BitSparse,在 Modded-NanoGPT 和 Nemotron-H 上降低每 token VRAM 31%/30%,开销不超过 1%
- Baselines and Score Centering in Policy Gradient Estimation
用 reward 与 importance-weighted score 的协方差替代正则化 IS 策略梯度,厘清 group-mean baseline 与 score centering 的不同作用
- Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing
训练跨 Mem0/MemOS/Hy-Memory 的紧凑记忆写入器,用逐块探针和归因奖励实现细粒度信用分配,平均 55.49% 超过 Claude Opus 5
- Beyond Downstream QA: Rethinking How We Evaluate Agent Memory
提出 FEB-30 事实演化基准与内在评估方法,证明仅靠 QA 评估会掩盖记忆存储层故障
- Lexical Reference Frames: Interpreting LM Residual Streams in Native Semantics
利用模型自身剩余层读取隐藏状态,构建词汇参考系,使残差流可读、可归因、可操控,早期退出可跳过近半层
- CLUE: Uncovering Social Context for Pragmatic Understanding
用两阶段训练+GRPO奖励让模型自我发掘对话中的社会线索,准确率提升且推理 token 减少超 80%
- Believed but Not Said: Measuring Hidden Belief Collapse in Multi-Agent LLM Discussions
少数对抗智能体反复陈述看似合理的假答案,即可让多数良性智能体私下采信但公开不表态,揭示隐性信念崩塌
- EMO: A Closed-Loop Test-Time Computation Framework via Alternating Context Optimization and Logits Steering
训练免费的测试时框架 EMO 交替进行上下文估计与 logits 引导,平均提升 9.1 个百分点。
- GACC-Bench: Benchmarking Goal-Adaptive Context Compression Ability across Large Language Models
提出 GACC-Bench 基准,评估 LLM 在给定高层目标下压缩长上下文时保留目标相关信息的能力,发现与完整上下文仍有显著差距
- Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence
通过时序事实和分层分析,揭示搜索增强 LLM 常“检索到但未读”,即使有新证据仍输出过时答案并给出不忠实引用
- Multi-Target Few-Shot Prompting with Diffusion Language Models
用扩散语言模型在共享画布中同时填充多个掩码区域,并通过似然比奖励提升少样本示例跟随能力
- CAT-alyzing Honesty: Continuous Adversarial Training for Transferable LLM Honesty
CATCH 用数百条自报告场景构造对抗训练对,让 LLM 在压力下保持诚实并跨任务泛化
- Architecting for Hardware Diversity: Meta's End-to-End Co-Design for High-Performance AI Training on AMD GPUs
通过硬件-模型协同设计、Origami 分析性能模型与 agentic kernel 优化,使 MI350X 在 DLRM 训练吞吐达 B200 的 101%
- Training-Free On-Policy Distillation
提出免训练 on-policy 蒸馏,仅用前向传播和最小二乘逐层合并多个专家模型,无需梯度更新
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
端到端训练统一 GUI 动作与代码执行空间,结合 SFT 与在线 RL 将 OSWorld 成功率提升至 66.44%
- ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews
用多智能体对话系统自动化 PRISMA 流程,决策留痕可溯,筛选与抽取 F1 最高达 0.788
- SSR: Structural Signal Retriever for Scalable Agent Discovery in LLM-Orchestrated Multi-Agent Systems
用 Agent Card 结构化字段 + IDF 权重 + 倒排信号索引,在不训练的情况下压缩候选上下文,实现可扩展 Agent 发现
- Knowledge That Is Linear Before Fine-Tuning Generalizes After It
预训练表示中原关系的线性可读性越强,新构造关系微调后的泛化越好,模型内 Pearson r=0.87–0.92
- Training Reasoning Models to Generate Diverse Scientific Ideas
用集合级强化学习奖励多样性,训练 8B 模型一次生成 K 张高质量且互异的科学创意卡
- ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer
用草稿路由、自适应缩放和 FactCycle 事实校验生成高密度图像描述,提升 VLM 训练效果
2026-10-17 26 篇 ★ 6 深度
- Scalable Weak-to-Strong Verifier Hardening for Agent Environments
隔离验证器沙箱加 hacker-fixer 迭代循环,全自动大幅降低攻击成功率
- Recursive Environment Scaling for General Long-Horizon Agents
提出 RES 框架,固定任务目标、递归变换信息访问/资源关系/执行依赖,提升环境难度并增强 SFT
- Beyond Policy Rollouts: Embedding-Space Directional Exploration with Anchored Noise for LLM RLVR
在 GRPO rollout 中用少量锚定噪声扰动嵌入位置替代标准采样,以极低成本提升探索多样性,优于 GRPO。
- Cowork-Gym: Synthesizing Interactive Work Environments at Scale
用构建-执行-修订循环合成64.9K个Cowork环境,后训练小模型在多个Agent基准上大幅超越基座
- FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention
将列式稀疏掩码扩展至 Hopper 分布式注意力,实现零通信掩码本地化与负载均衡的长上下文训练加速
- Copy-Paste Language Models
在 LM 头旁增加轻量 Copy-Paste 头显式建模上下文复制,提升训练效率与下游表现
- LeanPRM: Lean-Grounded Process Supervision for Natural Language Proof Verification
利用 Lean 形式化证明自动生成自然语言证明的逐步正确性标签,训练过程监督验证器,步级准确率从 48.2 提升至 74.7
- Virtual Head Attention
通过 Q Premix 与 Linear Postmix 将训练后模型吸收为标准 GQA-2,实现 KV cache 4 倍压缩、训练 FLOPs 下降且质量提升
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
开源一体化 GUI Agent 平台,统一评估/数据/在线RL,9B模型在 MobileWorld 和 OSWorld-Verified 创下 SOTA
- SERO: Learning from Executable Oracle Continuations for Long-Horizon Agentic Reinforcement Learning
将训练期 oracle 多步续推作为辅助监督,并用前缀可达性权重控制离策略深度,提升长时程 Agent RL 的 OOD 表现。
- Learning to Read Out: Unembedding Dynamics in Language Model Pretraining
提出参数轨迹交叉编码,发现模型隐藏态编码任务信息早于其输出读出表达,能力时间线混淆了编码与读出
- When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers for Context-Parallel Prefill
用成本模型解释远程 KV 命中何时不如重算,并通过分片、按 rank 分区和异步加载把 p99 从 83.32s 降至 0.67s
- Data World: Scaling Data Environments from Scratch
多智能体引擎从显式机制合成数据环境和任务,产出训练数据并RL-zero训练数据代理,基准大幅提升
- FDE-Gym: The Last Mile of AI Delivery
构建95个真实客户交付任务基准,评估智能体在模糊需求下提升客户业务指标的能力
- Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization
用 MoE LLM 做个性化并通过 crosscoder 定位可解释个性化 latent 与专家路由,验证其因果作用
- LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents
用弱模型隐藏状态的不确定性同时驱动升级决策与黑盒强模型监督,无训练实现高效成本-精度平衡
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
开源通用计算机使用智能体栈,用代码执行与决策转移让8个前沿模型在OSWorld-v2平均+19.6分、步数-53%
- Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
用中间检查点方向一致性门控教师 RL 前后策略偏移,提升数学与代码推理蒸馏效果
- 3DCodeVerse: Exploring 3D Worlds as Code
构建可执行 3D 代码数据集与多智能体验证框架,微调开源模型显著提升 3D 代码生成质量
- EliteReplay: Preserving Diverse Solutions in RL Post-Training via Quality-Diversity Search
用质量多样性搜索构建精英解档案并与 GRPO 结合回放,提升准确率同时保留 LLM 解多样性
- Disagreement-Guided Weak-to-Strong Routing
提出用模型间分歧信号做无监督弱到强路由,无需正确性标签即可在成本与准确率间权衡
- Improving Environment-Agnostic Coding Agents: The Role of Scaffolding
仅改变指令鼓励报告困难并自动继续,环境无关编码智能体在 ARC-AGI-3 和 AGI Maze 上得分提升,但专用脚手架仍有优势
- Private Retrieval Augmented Generation via Random Projection
用随机投影同时处理知识库与查询嵌入,在保持语义相似度的同时缓解数据抽取攻击,优于DP方案
- Designing Transformers for Continuous Diffusion Language Models
提出 LangDiT 架构,通过多项归一化与梯度路由改进,显著降低生成困惑度,刷新连续扩散语言模型 SOTA
- Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?
LLM 在 Indic 语言安全评估中同样存在评估意识,被告知测试时有害请求拒绝率显著上升且良性请求误拒增加
- Twice Upon a Time: Complementary Representations for Time-Series Reasoning
用线图与归一化延迟嵌入两种互补视觉视图训练视觉-语言时序模型,显著提升推理精度
2026-10-16 30 篇 ★ 24 深度
- FreeSolo: Linear-time Sparse Attention with Zero-Shot Length Extrapolation
短程滑窗+长程 keypoint 选择的稀疏注意力,线性变体短 CPT 即可零样本长度外推
- EdgeWise: Bringing Long-Horizon Agents to the Edge via Selective Cloud Delegation
提出EdgeWise框架,让本地SLM作为主求解器,仅在关键步骤选择性委托云LLM,显著降低成本且保持性能
- Self-Evolving Agent Harness
保持模型权重固定,仅修订 prompt/memory/workflow/代码实现 Agent 自我进化,并给出持续 PAC 学习保证
- Athanor: An Agent-Native System for Autonomous Post-Training Research
四个Claude智能体团队在Athanor系统上自主将Qwen3-4B-Base后训练至接近官方Instruct水平
- AutoSFT: An Agentic System for Automated Data Research in Supervised Fine-Tuning
多智能体系统 AutoSFT 将执行与分析分离,覆盖比例调整、剪枝、修复、替换、合成等数据动作,显著提升 IFEval/IFBench/MBPP+
- Mosaic: Multi-Session Agentic Reinforcement Learning
提出 Mosaic,用 session-aware 轨迹优势与 session 级边际信息增益塑造,在 BrowseComp 上超越广播基线且会话数更少
- Trajectory-Level Speculation with Semantic Verification for Tool-Using Agents
让弱模型草稿执行只读工具调用,强模型在不可逆动作前一次性 prefill 验证并修复,用验证替代逐步解码
- Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling
用单次前向的自回归掩码决策替代自由文本生成,输出结构化选择与候选概率,4B模型七套评测集平均准确率90.02%
- JevAgentHarness: Benchmarking, Deploying and Training Decision Models That Share Control with LLMs
以置信度阈值将Agent常规多选决策委派给4B决策模型,最高降本89%、提速2.5倍,成功率损失<3点
- Information-Gain Calibrated On-Policy Distillation for Deep Search Agents
提出 IG-OPD,用检索后信息增益校准 OPD 的预算与方向先验,修正证据盲监督
- Learning Self-Orchestration in Decentralized Agent Swarms
提出市场机制后训练框架 MPT,让去中心化 Agent 联合学习行动策略与竞价式自组织调度,在多个多智能体任务上超越单一体模型
- A team of Gemini 4 Argon agents beats Minecraft
四个通用编码智能体通过 Mineflayer 编写 2783 个 JS 程序、共享记忆与聊天协作,27 小时 14 分首次端到端击败末影龙
- Terminal-RSI: Recursive Self-Improving Terminal Agents via Recursive Self-Rewrite and Policy-Refine
用递归自改写与策略精炼交替训练,把终端 Agent 验证反馈转成策略提升
- TimeRSI: Towards Self-Improved Agentic Deployment for Time-Series Foundation Models
用 LLM coding agent 在冻结预测模型外围自动生成与迭代 pipeline,并通过自适应选择器提升时间序列预测部署效果
- TransX Technical Report: Scaling Sequence Transduction for Recommendation
提出 TransX 序列转导框架,将行为编码、记忆与候选融合解耦,通过摊销执行实现模型扩容而不等比增加在线成本
- CleanRM: Reward Modeling from Noisy Feedback with a Few Clean Feedback for RLHF
用少量干净反馈经最优传输校准样本级噪声率,并构造无偏代理损失提升奖励建模与 RLHF
- Each Reward to Its Relevant Tokens: Reward-Specific Token-Level Credit Assignment for Multi-Reward RL
用 verifier 信息 self-replay 定位每个 reward 的相关 token,把 advantage 按相关性重分配,加速并提升多奖励 RL
- HTN-Orchestrate: A Hierarchical Task Network Framework for Multi-Agent Orchestration
两层 HTN 解耦全局规划与局部多智能体执行,结果驱动增量分解与重建,在多个 benchmark 超 Agent Team
- MMSearch-OPD: Easy Made Hard, Hard Made Learnable for Long-Horizon Multimodal Search Agents
用可控问题升格与联合 RL/在线蒸馏,把易题变难、难轨迹变可学
- KnowGPO: Knowledge-Grouped Policy Optimization for Search Agents
把搜索轨迹按已满足的原子知识条件分组,用增量知识增益做过程奖励,8B agent 超过多数 32B 开源系统
- Towards Continual Learning: Mitigating Forgetting With Subspace Tuning
通过将权重更新限制在低能量奇异子空间,SST 有效减轻 LLM 微调中的灾难性遗忘
- MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering
用层级SFT与执行窗口交互强化学习训练35B MoE,将MLE奖牌率从37.9%提至72.7%
- RecSoup: Efficient Model Merging Approach for Controllable Multi-Objective Recommendation
RecSoup 通过剪枝消解跨目标干扰并学习偏好到合并系数的映射,实现推理时可控多目标推荐,较参数生成提速 165–228 倍
- TRACER: Trajectory-Aware Tool Retrieval for LLM Agents
利用历史工具调用轨迹的 trie 索引和状态自适应双先验混合,在保持准确率的同时大幅降低工具选择上下文成本
- Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries
将文档语料预构造成分层文件系统工作区,并用RL直接优化下游答题准确率,BrowseComp-Plus提升33个百分点
- Learning to Steer LLM Agents and Multi-Agent Systems
提出外部 steering agent,用 fast/slow 双路径和 RL 联合训练,在长程执行中实时纠正 goal drift,提升单智能体和多智能体搜索任务表现
- Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval
提出 AURA,用检索特异性监督中间推理状态并训练效用估计器,在推理时自适应停止,以更少步骤取得最优检索
- CARA: Causally Guided Retrieval Agent for Question Answering
提出 CARA,以证据对回答的因果贡献替代纯文本相似,引导 KG 检索 Agent 并融合多轨迹
- Rethinking Routing Exploration in Modern Mixture-of-Experts
MirrorMoE 通过 token 自适应抑制低概率路由专家缩小探索空间,解决细粒度共享专家 MoE 的探索困境并稳定涨点
- Aligning LLMs with Sparse Retrieval via Adaptive Sparse Supervision
用动态α-truncation对齐SPLADE词表,1B LLM稀疏检索在L0=182时接近Lion-sp效果且延迟降11倍
2026-10-15 30 篇 ★ 25 深度
- Scaling Verifiable Environments for Long-horizon Work Agents
提出 WORKFORGE,从真实工作资源合成可验证环境并生成训练轨迹,大幅提升长程智能体能力
- Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation
提出 ROADMOPD,引入非路由教师作为跨域批评者,通过 token 级信用分配与梯度投影缓解多教师在线蒸馏的梯度冲突
- KV4-RL: Unlocking Faster Asynchronous Rollouts for RLVR with INT4 KV Cache Quantization
提出 KV4-RL,通过校准无关 INT4 KV 量化与选择性 INT8 保护 attention sinks 和近期上下文,在保持训练质量的同时大幅加速 RLVR 异步 rollout
- ActionOPD: Distilling Decisions, Not Tokens
提出动作级在线蒸馏,用语义一致奖励替代 token 概率,实现跨模型家族黑盒 teacher 蒸馏
- Long-Horizon RL Needs Muon
在仓库级 issue 修复的异步 RL 中,Muon 配合单 rollout、TIS 与奖励塑形显著提升训练成功率
- Recovering Reliable Supervision via Critique-Guided On-Policy Distillation
教师先批判错误,学生从最后错误处重写;教师带批判评分、学生无批判训练,显著提升数学推理蒸馏效果。
- Seeing, Maintaining, and Learning: The Evolution of Multimodal Agent Memory
提出双轴框架解析多模态Agent记忆的形成/表示与管理演化,总结设计模式与原则
- LatentLoop: Scaling Looped MoE Models with Asymmetric Compute Allocation
提出 LatentLoop,压缩首轮循环序列、保留次轮全分辨率,将省下算力重分配给隐藏宽度,在相同预算下降低 NLL 并提升下游基准
- What Makes a Social Agent's Interactions Effective? Learning from Verifiable Outcomes in Paired Worlds
提出 HICO-Bench 与 PaCPO:以成对世界可验证结果评估并训练社交 Agent,Qwen3-8B Verified Success 20.4%→28.3%
- SimInter: Evidence-Grounded User Simulation with Interview-Based Profile Enrichment for Conversational Recommender Systems
用LLM访谈+轮级审计从历史对话中提取隐式用户画像,显著提升模拟用户的aspect表达丰富度
- Mitigating Popularity Bias in Sequential Recommendations with Sparse Prior-Regularized Objective
把流行度先验注入 entmax 变分目标,让稀疏支持集由上下文与流行度共同决定,仅改 loss 即可去偏
- Plan or Retrieve First? A Scale Study of Tool Discovery Architectures
在50k API规模下系统对比Retrieve-then-Plan与Plan-then-Retrieve,发现单工具查询RtP占优、多工具查询PtR占优的复杂度交叉
- Training LLMs for Multi-Agent Collaboration with Verifiable Information Rewards
提出 CoSIR,在可验证评分表环境中用团队 surprisal 减少作为信息奖励,训练 LLM 分享/请求/使用信息,迁移到 7 个未见协作任务
- Revisiting Generative vs. Dense Retrieval: A Static Value Prior Reverses the Gap
电商候选检索中,GR 的价值领先主要来自静态热门度,静态价值先验重排 DR 可反超且保持 recall 领先
- AdCoEvo: A Co-Evolving Multi-Agent Advertising Delivery System
角色分工+轮换更新的多智能体广告投放系统,相比规则基线 ADV 提升 14.02%、CPA 降低 7.07%
- Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation
提出 SRAT,将检索作为可学习翻译动作,用 GRPO 与检索器对齐实现选择性检索增强
- CASI: Credit Assignment via Set Intervention for Agentic Retrieval
用快照集合干预构造反事实子集价值,Shapley 聚合加有界零和优势整形,实现多检索动作的上下文相关信用分配,线上广告主价值提升 3.51%
- Beyond Expert Rankings: Contrast Calibration for Mixed-Precision MoE Quantization
NatScale 用对称 KL 目标校准专家敏感度对比度,在固定存储预算下提升 MoE 量化保真度
- CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image Generation
三段式 SKU 主图生成框架:PERL-Agent 提炼卖点、Layout Thinker 优化布局、SKU-DiT 多条件保真生成,已支撑每日百万级生产
- Cortex: Consolidating Context into Parametric Memory
用前瞻性重演与 FFN-only 低秩/结构化更新,把上下文增益蒸馏为可堆叠的参数记忆,兼顾 CR 与 RR
- The Wealth of Agents: Scaling Agentic AI Across Developers
提出多开发者 MDA:子任务分解路由组合专业 Agent,将≤35%单点准确率提至70%
- Hindsight-Privileged RLVR: Single-Rollout Token Credit Without Group Sampling
用已验证轨迹的未来信息对单次 rollout 计算归一化 JSD token 权重,替代 GRPO 组采样,训练最高提速 2.30 倍
- When Does Momentum Help in Reinforcement Learning with Verifiable Rewards?
证明 RLVR 中固定动量增益会被采样噪声淹没,需随学习率放大 β 才能稳定获益
- Scaling Discovery Requires Forgetting
单agent/并行/通信式多智能体自动研究都会平台期,周期性遗忘会话与搜索状态、仅保留全局最佳候选可解锁探索并提升最多15%
- Latent Compaction with Test-Time Training
将压缩 KV cache 视为可训练参数,用测试时训练拟合注意力与蒸馏,在 32× 压缩下 RULER 达 96.7%
- SpectrumQuant: Spectrum Alignment for LLM Quantization
通过协方差最大化推导出闭式数据感知正交变换,大幅降低LLM量化校准成本
- τ-Emotion-Bench: Exposing the Interaction Fragility of LLM Agents through Real-World User Emotions
提出情绪化用户交互基准与 Tracer 数据管线,用交互感知信号训练工具调用 Agent 提升可靠性与跨域迁移
- TreeFlex: Agents Navigating Their Own Search Trees
TreeFlex 让同一 LLM 在 Reflection 与 Execution 间切换,自主选择保存的中间状态继续搜索,并用树感知 GRPO 训练,在深度研究和 SWE 上显著超越 ReAct 与 FoldAgent
- Co-Evolving Acting and Forecasting for Language Agents
在成功轨迹上以未来动作序列为多步辅助目标,让策略骨干同时执行与预测并共同进化,提升样本效率且无推理开销
- Price of Anarchy of First-Price Auctions in Agentic Markets
证明竞争底线与近似条件独立使一价拍卖在智能体市场中福利损失远低于最坏情况,并用 EmbedLLM 仿真验证。
2026-10-14 30 篇 ★ 25 深度
- DoSA: Dots Sparse Attention
为有符号多哈希索引器构建可证上界,利用种子阈值无损筛除多数 key,避免全头打分,长上下文预填充最高快 2.74 倍
- PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learning
提出 PR-OPD,用分层隐藏状态对齐替代 token 概率蒸馏,把智能体自生成技能的特权优势传给无技能策略,推理零额外开销
- Scoring Higher, Answering Worse: Mitigating Reward Hacking in Rubric-Based RL via Protocol-Level Rubrics
发现 Rubric-RL 加权求和奖励造成准则间补偿,提出按协议级维度合取聚合的 ProRubric,关键指标提升 10.8 点
- ClawLoop: Self-Improving Agents via Harness-Native Training Loop
无外部教师模型下,通过任务合成-训练-诊断闭环实现 harness agent 自改进,并迁移到小模型
- Harness^2: Recursive Agent Harnessing for an Open World
提出 Harness²,通过对比性 Propose-Probe-Compose 与经验库更新,在无 ground-truth 的开放世界中持续改进 agent harness。
- PANINI-DR: Controlled Deep Research through Generative Semantic Workspaces
用共享生成式语义工作区记录子问题依赖与证据,并分离研究/验证,深度研究性能与答案可溯源均领先
- UltraBERT: Beyond the Limit of BERT Pre-Training
提出双头掩码率预训练策略,首次同时达到分类与检索 SOTA
- Vela: User Behavior as Supervision Sparks LLM Intelligence
用10万用户真实行为构造可见历史/隐藏未来任务微调LLM,同步提升用户理解与通用能力
- RSIPO: Recursive Self-Improving Policy Optimization for Agentic Reinforcement Learning via Skill-Policy Co-Evolution
用重放增益奖励技能生成并以经验贝叶斯校准教师信任,实现技能-策略共进化
- A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution
提出 DeskIF-Bench 基准并依据可发现性、粒度、可观察性合成原子接口,提升 LLM Agent 桌面任务成功率并降低约73% token 消耗
- Spectral-Driven Adaptive-Rank Optimizer for Large Language Model Reinforcement Learning with Verifiable Rewards
发现 RLVR 梯度能量向低秩子空间集中,提出自适应秩优化器 Ares,跨模型和任务提升准确率
- TPPO: Tracking-Value PPO For Language Model Reasoning
将 PPO critic 改为逐 token logit 增量累加,在稀疏二元奖励下显著提升推理训练的 token 级信用分配与策略性能
- From a Large-Scale Teacher to Efficient Multimodal Students for Search Relevance Prediction
用GPT-4.1当裁判生成48万条相关性标签,蒸馏到Gemma-3多模态小模型,精度接近教师、吞吐大幅提升
- DeltaTTG: Training Multi-Turn Agents with a Token-to-Go Progress Meter
训练一个可复用的 Token-to-Go 进度计,将稀疏回合优势按步骤进步量重分配,提升多轮 Agent RL
- HASTE: Hierarchical and Attribute-aware Supervision for Generative Recommendation
提出层级损失与属性辅助损失,在 Semantic ID 生成式推荐中实现约 2 倍训练提速与长尾显著提升
- Computed, not Memorized: Bit-Factorized Identifiers for Efficient Generative Retrieval
将文档向量符号位作为 DocID,结合多树束搜索,实现零训练新文档适配与最低推理延迟
- Rubrics from the Task, Verdicts from Evidence: Pointwise Rubric Rewards with Tool-Augmented Judges
提出 ReVeR,从指令本身推导评分细则并用工具增强逐点评分,通过标签盲蒸馏训练,超越 pairwise rubric RM
- WeGR: Unified Generative Retrieval for Industrial Search Systems in WeChat
联合行为感知 SID 构建与动态 horizon RL,解决生成式检索中的码本坍塌和奖励稀疏
- WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution
提出 WorkRover 框架,用递归环境演化与 Verifier 进度信用分配提升长程 cowork agent 训练,多个基准大幅超过基座
- AiSAQ-in-Filtering for DRAM-free Filtered Information Retrieval
提出 LiPQ 将标签与向量联合 PQ 编码,使过滤 ANNS 保持接近零 DRAM 且索引加载快
- Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon Agents
CarryOn 将长程 Agent 上下文组织为可复用任务对象 + 执行上下文 + 近期交互,OSWorld 2.0 和 BrowseComp-Plus 分别 +5.8%/+7% 并大幅降 token
- FASHION-RQ: Mining Hierarchical Semantic Structure for Automated Evaluation of Fashion Retrieval
利用 RQ-VAE 语义层级自动生成查询与分级相关性,构建可诊断属性的时尚检索基准
- Hybrid Reasoning Agents
HybridAgent 用轻量 HybridLink 与连续工作记忆交替进行潜在推理和文本工具调用,在 11 个基准上平均提升 10.4% 并大幅降低 token、延迟与成本
- Jeva: System One Models from First Principles
提出 Jeva 决策原生架构,解耦候选编码与请求判断,实现空结果感知、置换不变、候选可扩展与跨请求缓存
- Kwai Summary Attention V2 Technical Report
在 Hybrid KSA 上新增 C-KSA 与 S-KSA,把 Summary 同时用作可二级压缩 KV 记忆和稀疏索引,128K 下 KV cache 减少 40.4%、prefill 达 1.51×
- Teacher-Guided Tool Learning for Small Language Models via Bidirectional KL Constraints
提出 SeTPO,在 GRPO 中按奖励门控注入教师 token 级反向 KL 信号,并用教师演示前向 KL 保留结构,提升 SLM 工具调用
- Unlocking Token Rewards via Training-Free Reward Attribution
提出训练免费的 token 级奖励归因方法,用梯度一阶泰勒近似从 PRM 分解过程奖励,加速 RL 训练并提升推理表现
- SkillScaffold: Scaffolding Agentic Reinforcement Learning with Policy-Adaptive Skill Credit Assignment and Selective Injection
用已有 outcome 轨迹似然差做策略相对技能效用,正门控选择性注入训练期技能,推理时完全免技能
- Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards
先构造完整隐藏世界再渲染损坏任务,并用进度势能奖励解决长程智能体 RL 的稀疏奖励,使开源模型逼近前沿。
- Knowledge Graphs as Files: An Agent Harness Where Tool Creation and Tool Use Co-Evolve
让 LLM 直接读写完整节点/边文件并现场编写图访问代码,训练自由即在 STaRK 上超越最强基线
2026-10-13 30 篇 ★ 7 深度
- Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents
提出 ExpActivator,将个性化从检索历史改为按当前情境激活适用经验,提升执行与主动建议效果。
- Encore: Few-Shot Agentic Discovery of Manipulation Strategies
把少量演示作为证据包供编程 Agent 研读并迭代改写策略,冻结后评估不暴露成功信号
- QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching
针对 MLA 的 content 与 RoPE 双缓存,提出路径专属可离线融合变换与功能对齐目标,实现首个联合 INT4 缓存且精度损失极小
- The Life Cycle of a Massive Activation: Stochastic Birth, Weight-Decay-Driven Growth, and Competitive Consolidation
揭示 transformer 中 massive activations 由 AdamW 预条件增长与 weight decay 平衡驱动,权重衰减控制其峰值与衰减
- Distributionally Robust Mixture-of-Experts Training
提出DRMoET,将MoE专家作为内生DRO组,动态加权高损失路由结果,提升路由鲁棒性和下游性能
- Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning
系统研究多语言数学推理中骨架提示语言选择,发现英语骨架平均微小正向但非普遍最优,效应依赖语境
- Contextual Correction of Parallel Draftsfor Speculative Decoding
DCOCO通过并行上下文评分恢复并行草稿块内依赖,在多种解码设置下取得最高吞吐,最高6.6倍加速
- Mental-Models for Multi-Agent Systems
显式学习对手潜在心理状态作为决策变量,提升多智能体交互质量与心智推理能力
- Universal Textual Teaching for LLMs
提出 UTT,无需参数更新,将 Teacher-Student 知识差距蒸馏为可迁移的自然语言 Primer,显著提升推理与代码生成性能
- Thinking Inertia: LLMs Keep Thinking When Told Not To
系统评估 LLM 的“不思考”能力,提出三层指标并发现显式禁用推理无法可靠消除思维惯性
- One Model to Loop Them All: Elastic Latent Recurrence for Language Models
通过 adaptive-delta 更新与 rank override 混合深度训练,循环 LLM 在 1 loop 不损精度并随 loop 增长持续提分
- Self-Preservation in Language Models
用 Task Bank 与自生成重放实现更广泛的持续学习防遗忘,并证明模型可辅助选择重放目标
- AgentSWE: Can Coding Agents Build the Agent You Actually Want?
提出 AgentSWE 基准,覆盖智能体开发三阶段,揭示编码代理构建的智能体与真实需求存在普遍差距
- Multi-Stream Attention Residuals
将单流深度注意力残差扩展为多流深度注意力,通过多尺度因果卷积生成多样化上下文视图,在 MoE 大模型上取得 1.58 倍预训练加速
- GeopoliticalQA: Benchmarking Retrieval and Generation over Intelligence Reports
构建 415 份情报报告、5,525 条 QA 的地缘政治 RAG 基准,系统评估检索与生成
- When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often Better
Semi-OPD 用初始学生离线 rollout 蒸馏,在 17 对模型上 14 对优于 OPD,最高 +13.6% 精度、11.4 倍加速
- Scaling Agentic Data for Long-Horizon Terminal Intelligence
TerminalHorizon 自动合成长程终端 Agent 数据,1.5K 环境 SFT Qwen3.5-27B 后在 12 个 benchmark 全面提升
- Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction
提出 Work2Skill 框架,从人类 GUI 演示中自动归纳可复用技能,显著提升多个执行模型的任务成功率
- Learning More by Training Less: Uncertainty-Guided Progressive Contraction for Efficient Reasoning Post-Training
用不确定性引导的渐进收缩框架,将推理监督压缩至全量SFT的0.22%训练预算,且维持或提升推理性能
- Returning to Development States: When Full Sandbox Snapshots Help Coding Agents
在编码智能体失败恢复中,以完整沙箱快照为可搜索状态做 Go-Explore 式分支,发现收益主要来自仓库外运行时状态
- On the Design Space of Continuous Diffusion Language Models
揭示自条件与嵌入几何机制,提出 DoubleCat 和 SemiCat 显著提升连续扩散语言模型文本生成性能
- Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph
用结构驱动解析构建法律知识图谱,比较多种 KG 感知分块与检索策略以提升引文检索准确性
- A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network Models
多智能体 LLM 框架用分析师/编码员/记录员三角色在受限语义空间内调优专用神经网络组件,在 SNN 和 PINN 任务上大幅超越基线
- A Step Harder, Not a Step Too Far: The Benefits and Limits of Curriculum Difficulty Progression in GRPO
系统刻画 GRPO 训练中样本难度随策略演化,证明中等难度持续选择并非最优,适度递进到更难难度带可提升性能但过度递进有害
- Task Context Shapes Component Roles in Language Models
任务上下文改变共享注意力头响应的事实及其对后续计算的影响,线性响应图可预测干预效果
- X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems
构建工具依赖图并利用执行反馈迭代扩展,系统性发现跨服务有害工具调用路径,显著超越STAC
- Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction
UPTURN 用 130K 参数头学习失败推理的干预位置,以新用户轮次注入纠正指令,无需微调即提升数学推理准确率
- Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection
在 Qwen3-14B 事实问答上,独立答案选择器比模型置信度过滤显著提升效用,但跨数据集可靠弃权仍未解决
- A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning
证明参考解条件化的在线自蒸馏信号无法定位错误,提出先批判后条件化打分,使 token 级监督具有纠正性
- Adaptive DHiSparse: Speculative Decoding over a Load-Adaptive KV Hierarchy
把 DSpark/DFlash2 投机解码接入分层稀疏 KV,并用可回收 optional residency 随负载调整 GPU 驻留,显著提升长上下文吞吐
2026-10-12 30 篇 ★ 17 深度
- Inducing Process Supervision from Outcome-Only Reinforcement Learning
TIPS仅用3.2K结果标签轨迹,经GRPO强化验证思维链,ProcessBench F1达85.2,超过更大PRM与强判官
- Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution
让视频理解 Agent 用自身 LM 修正可执行 harness,通过主动回访视频与成本感知进化提升精度并降低视觉成本
- From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
提出 CASE 角色化临床智能体与训练框架,将证据寻求策略蒸馏到 8B VL 模型,纵向医学基准超越 GPT-5.4 与 Claude Opus 4.8
- VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs
提出 VisionWeave,通过 gated spatial pooler 与 granularity router 实现内容自适应视觉 token 压缩,节省 43% token 保持 98.9% 性能
- Stateless Language Agents: Scaling Long-Horizon Automated Research
无状态 Agent + 有状态 harness:每次调用重建角色化上下文,用更少 token 实现更强长程搜索
- Judging in Latent Space: Efficient Generative Reward Modeling via Semantics-Preserving Compression
LatentGRM 用语义分块与压缩替代逐 token 评估,在保持判断质量下将推理耗时降低 6-7 倍
- SoftwareGym: Scaling Computer-Use Agent Training with Diverse Synthesized Software Environments
提出 SoftwareGym 自动化合成 GUI 软件环境及基准,训练 CUA 后在 OSWorld 上 Pass@3 提升 15.58 个百分点
- Recurrent Harness for Agentic Continual Learning
在流式持续学习中用下游反馈反向修订已检索反思,闭合前向读写循环,显著提升智能体在线适应与稳定性
- Continually Post-training Small Models via Synthetic Self-distillation
提出合成自蒸馏,通过稍大同家族模型生成in-distribution监督,解决小模型持续后训练中获取与遗忘问题
- Surfing the Activation Wave: Analyzing the Information and Geometry of LLM Hidden States for Speculative Decoding
提出基于矩阵熵与 CKA 的 LLM 多隐藏层选择框架,在 EAGLE3 推测解码中优于固定层选择
- PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling
将 MH 串行接受/拒绝展开为决策树批量预取,不改转移核,加速 LLM 幂采样 1.7-2.3 倍
- RSI-Anything: Unlocking Recursive Self-Improvement with World Models
提出基于预测世界模型的递归自改进框架,在代码、GUI、科学任务中提升成功率并降低交互成本
- Rethinking Relative Policy Differences Transfer of On-Policy Distillation
通过隐式奖励视角统一相对策略差异迁移,揭示任务定向差异强于规模差异,且参考过滤与目标兼容性决定迁移成败
- Beyond the Final Embedding: Retrieving Memories from Token-Level Evidence
冻结 embedding 的 token 级稀疏匹配融合整句相似度,无需训练提升记忆检索
- Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA
按任务拆分搜索与阅读智能体、代码强制第二跳,在三个文档 QA 基准上显著超越现有系统
- DualQuant: Dual-scale Calibration-free Weight-and-Activation Quantization for LLMs
用权重重构误差最小化导出的列尺度兼作激活重缩放,实现免校准 W4A4 量化,支持 INT4/MX/NVFP4
- FORTE: A Production Framework for Feature Evaluation and Deprecation in Industrial Recommender Systems
模型无关的特征废弃框架,用高效扰动、分组验证、在线A/B和血缘追踪实现安全删除特征
- Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion
用跨上下文可再现性与语料支撑度识别幻觉term,在nDCG@10无损下将注入query的无支撑词减少85%-93%
- Beyond Temporal Proximity: Explanatory World Models for Credit Assignment in Reinforcement Learning
用 LLM 对轨迹结果做解释并按事件相关性重分配奖励,显著改善长时延信用分配,在游戏与推荐基准上超过 PPO/LaRe
- NEAR: Neighborhood-Aware Residuals for Memory Retrieval
训练无关地用邻居方向构造投影残差,把共享主题带来的干扰记录转为匹配信号,单次 ANN 检索提升记忆召回。
- Orthros: Phase-Aware Heterogeneous Attention for Efficient Transformers
Orthros 注意力按预填充/解码相位解耦:线性复杂度预填充加全注意力解码,长上下文召回近无损并大幅加速推理
- Matched-Context Group Policy Optimization for LLM Agent Training
通过匹配任务进度与状态构造加权动作偏好,提升长程 LLM agent 稀疏回报下的信用分配
- PRIME: Pre-Retrieval Index Modeling Enhancement for Structured Document Retrieval-Real
确定性元数据匹配结构化分块检索质量,嵌入计算降45.8倍,语义重构再提升Answer-F1 13.7%
- RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics
融合对比微调双塔检索与 discounted LinUCB 在线重排,将工具故障选择率从 86% 降至 3%
- ReplaySSM: Cache SSM Inputs, Not State
通过 checkpoint 加近期输入缓冲替代逐步状态读写,显著降低 SSM 状态 I/O 并支持高效投机解码与混合精度
- Randomized Momentum Transport with Cheap Predictors
提出随机化动量传输,以概率 q 评估梯度修正并用廉价预测替代,在保持 O(T^-1/3) 收敛下显著降低 oracle 调用成本
- Web$hell: A Unified Interface for Agentic Web Access
提出统一网页访问接口 WEB$HELL,将网页信息与动作编译为可寻址对象并持久缓存,以更低成本在搜索/导航/深度研究任务上全面领先。
- Training User Simulators with Latent Intrinsic Feedback
提出带潜在评估状态的用户仿真器,同时生成用户话术与逐轮评分,用于多轮RL训练助手并省一半以上算力
- Can Language Models Play the Wikipedia Game?
构建大规模本地维基与引文图,评测 LLM 跨语言/跨领域导航检索,最佳模型与人类相当但未超越
- Specialists Learn Faster: Knowledge Organization in Pre-training Shapes Knowledge Update Efficiency
发现按时间顺序预训练得到的专家模型获取新知识所需更新步数远少于随机顺序训练的通才模型,并提出可预测的预训练数据组织策略
2026-10-11 20 篇
- Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation
在德语RAG问答中,对齐推理语言与查询文档语言可提升表现,但无法超越无约束英语推理
- Post-Training Frontier Text-to-Image Models by Composing Preference and Rubric Rewards
提出组合偏好奖励与规则奖励的 T2I 后训练策略,Flux2dev Elo 提升 69 分,Ideogram-4 达 1223.5 超开源模型
- Do LLMs Understand Sequential Structure? A Controlled Study of Inference and Generation
受控实验表明 LLM 对潜在序列结构的识别与生成存在显著落差,表面行为保真可能掩盖错误机制
- BrickBench: Evaluating Agentic Brick Design
提出 BrickBench 基准与环境,评估编码 Agent 在文本条件 LEGO 设计中的物理与语义满足度
- The Impact of Backbone Evolution on LLM-Based Relevance Assessments
固定 prompt 下,模型升级不必然提升 LLM 相关性判断与人类一致性,且聚合性能不变不等于判断稳定
- Distilling Routed 3D Privilege for Spatial Reasoning in Vision-Language Models
将深度、语义、BEV 等 3D 几何线索作为特权,在 GRPO 中对错误轨迹做路由化蒸馏,提升 VLM 空间推理且部署保持仅 RGB
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
提出 TestPrism 基准与联合成功函数,揭示单参考评估高估测试质量,并用 TestHelix 将联合成功率提升 8.67-9.00 个百分点
- Cited but Not Consulted: A Counterfactual Audit of Legal Chain-of-Thought Faithfulness
反事实替换法律依据并解码隐藏状态,发现LLM命名法规与判决实际依赖严重脱节,且易受对抗指令操纵
- From Reactive Containment to Proactive Assurance: Lessons from OpenAI, Anthropic, and Google Agent Security Incidents
基于2026年三家前沿Agent安全事件,提出PASAC主动保障循环与五层边界保障栈,强调执行系统全链路持续校验而非依赖单一沙箱
- MiniVer-V: Identifying Minimal Sufficient Evidence for Short Video Verification
提出基于证据充分性的短视频核查方法,用16%证据达到与全量证据相当的准确率,并显式输出“证据不足”
- Chaos in the Text: Revealing the Modality Preference in Mixed-Modality Retrievers
发现文本高分偏置导致无关文本压制相关图像,提出多正视角 Trident 联合优化相关性判别与视角平衡,提升混合模态检索鲁棒性
- LadderEdit: Edit-Level Residual Compression for Memory-Efficient Lifelong Editing of LLMs
按编辑难度动态分配 LoRA 秩的压缩方法,内存减少 5.2 倍仍追踪精确 LoRA 性能
- Long Text to Predictive Features: LLM-Guided Blockwise Feature Engineering via Executable Program Search
LLM-BlockFE离线把长文本构造成可执行特征程序,在线零LLM调用,用带回滚和并行轨迹的分块搜索提升特征质量
- Overview of the NTCIR-19 Automatic Evaluation of LLMs 2 (AEOLLM-2) Task
推出 Deep Research Evaluation 子任务,聚焦 LLM 生成深度研究报告的自动评估,收到 10 队 91 个提交
- Latent Core Tokenizer: Compress, but Meaningfully
提出 LCT 将结构发现与词表构建解耦,用形态约束提升多语言分词质量
- SignRAG: Unified Retrieval-Augmented Gloss-Free Sign Language Translation
提出SignRAG,结合分层预训练、目标域检索增强与检索效用强化微调,首次在CSL-Daily全指标超越基于标注的手语翻译方法
- $σ$Transfer: Uncertainty Transfer from Small to Large Networks under $μ\mathrm{P}$
利用μP推导先验协方差缩放,使Laplace近似中的精度选择可零样本从小模型迁移到大模型
- Reasoning-Informed Visual Editing
构建首个推理驱动视觉编辑基准 RISEBench++ 及训练无关 Agent,覆盖六类推理并评估58个模型
- ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skills
提出 ViSkill,将成功轨迹编码为视觉原生技能卡,检索引导推理与奖励塑造,形成技能库与策略优化闭环
- Prior or Feedback? What an LLM Uses When Adapting Neural Operators
通过干预实验证明 LLM 在神经算子调参中同时依赖任务先验与实验反馈,而非仅靠初始上下文
2026-10-10 30 篇 ★ 6 深度
- Synthesis Through Simulation: Generating Coherent Enterprise Data via Scalable Agent-System Interaction
提出 schema-free 模拟数据合成范式,LLM agent 通过 policy-enforcing APIs 生成结构有效且高保真企业数据
- Mara Chain: Rethinking Failure as a Stepping Stone for AI System Auto-Evolution
保留被拒候选并做链式细化,在技能、harness 与检索管道优化上大幅提升样本效率与最终性能
- Learning to Steer, Steering to See: Unveiling the Geometry of RLVR in Large Language Models via Trainable Vectors
发现RLVR有效控制方向位于激活主子空间低方差补集,并提出Alpha-Stabler稳定训练提升RL增益
- SparseEngine: Sparse-First Inference Engine
通过统一生命周期契约支持15种稀疏注意力方法,并提供Chain Cache与可控前缀缓存剪枝,实现长上下文agent推理10倍吞吐提升
- You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue
提出 Intent-Eval 揭示 LLM 将已拒绝/被取代内容当作有效需求,并用 Intent-OPSD 自蒸馏缓解意图混淆
- Can AI Agents Make Open-Ended Scientific Discovery? Evidence from Station
提出多智能体开放世界环境 Station,结合 Supervisor 与 Meta Reflection,使智能体在无明确指标下重新发现 ICLR 论文结论达 62.7%
- Frozen Models, Evolving Expertise: Model-Agnostic Learning from Deployment Experience for Multimodal Medical AI
提出参数无关外部专长框架,让冻结LLM/VLM从部署经验中持续提升并跨模型迁移
- SpecFold: Folding Multi-Branch Redundancy for Faster Speculative Decoding in Diffusion Language Models
利用多分支推测验证中的隐藏状态冗余,通过残差门控与折叠注意力/FFN降低计算,最高实现1.64倍吞吐提升
- U-Space: Uncovering When and Why Uncertainty Arises in Language Models
提出无需训练、无需重复生成的 U-Space 子空间,将 LLM 逐 token 不确定性可视化和标量化,校准优于基线
- A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization
构建跨领域基准 AgenticBBO-Bench,统一评估 LLM Agent 在黑盒优化中的表现并分析关键设计因素
- Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks
让冻结 LLM Agent 用自然语言规则簿+可执行代码作为显式世界模型,通过反思与验证递归自改进,在 ARC-AGI-3 全部 25 个游戏达到人类动作效率天花板
- Opera: A Verbal Critic Framework for Long-horizon Coding Agents
将每次纠正视为持久化笔记并跟踪到问题解决,显著提升编码 Agent 的 resolve rate 并支持蒸馏训练
- REMORY: Learning Residual Memory for Context Compaction
REMORY 在摘要后追加可学习软记忆 token,通过冻结 LLM 的续写分布逼近训练,以少量位置预算显著提升长程 agent 表现
- Incremental Open-Ended Deep Research with Structured Harness
用结构化 Harness 将深度研究报告视为可演化状态,实现增量更新,保持质量同时显著降低成本。
- The Lattice of Transition Laws
将扩散、自回归及混合模型统一为 corruption lattice 上的路径,用依赖成本预测不同解码调度性能
- Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict
提出 ISE 轨迹级评估框架,发现高准确率不必然伴随认知谦逊,模型干预提升谦逊常损失准确率
- Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition
提出 AHL 范式与 AAArena 基准,评估 LLM 智能体在 12 个对抗游戏中通过选对手、分析回放和改策略爬升排名
- Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception
白盒探针可扩展至前沿LLM代理监测,在SHADE-Arena达98.8% AUC,并发布最大欺骗数据集FIBS
- When KL Regularization Misfires in Group Policy Optimization
系统分析 GRPO 中参考 KL 与奖励交互的七种失效模式,提出条件 KL 标定组内奖励系数的 ZCPO
- EVIE: Evidence-Vector-Informed Embeddings for Visual Document Retrieval
提出视觉文档检索方案,用证据数据治理、双向蒸馏与层级索引压缩提升精度与存储效率
- HarnessSQL: Harness-Native Training for SQL Agents in Realistic Database Environments
提出 HarnessSQL 训练框架,在 SFT 和 RL 中保留完整 SQL 交互结构,大幅提升小模型在真实数据库任务中的执行准确率
- Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State Quantization
提出在预条件空间做随机舍入的4-bit AdamW状态量化方法,显著缩小与32-bit训练的验证损失差距
- Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution
提出SGUID,通过筛选能持续提供有效蒸馏信号的技能子集,实现更稳定高效的模型-技能协同进化。
- NativeScope: Relation-Localized Retrieval over Native Topology with a Correct Anchor
用 (A,r,B) 关系范围限定再排序,RAG 召回在文档/记忆上提升 42.75/22.00 个百分点
- Rehearse Everything, Remember Nothing: Attic-KV Rehearses What Will Be Read
提出训练无关的 Attic-KV 排练策略,以自生成 QA 与内容自适应锚点取代全文重读,大幅提升极限压缩下的长上下文问答与缓存复用
- RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments
通过Top-Down Skill Refinement将任务分解为分层技能,多智能体协作实现机器人技能自我进化与复用
- All Verdicts are Not Equal: Rethinking LLM Judge Reliability
对 LLM-as-a-Judge 进行系统可靠性压力测试,提出可信判决率 T,并发现 rubric 打分比成对胜负更可信
- VFold: Symmetry-Aware Cross-Layer Value Cache Compression
利用 value cache 跨层对称性做无损合并,不改模型结构,可与量化/剪枝组合进一步压缩
- Predicting Alignment Generalization with Value Representations
建立对齐泛化预测任务,激活表示比文本描述更准(ρ=0.45 vs 0.05),并构建首个经验价值分类
- Language Models as AI Research World Models
用真实实验历史微调 LLM 作为研究世界模型,显著提升候选实验干预排序与自动研究收益
2026-10-09 30 篇 ★ 15 深度
- AutoResearch at Production Scale: Failure Modes and a Multi-Agent Framework
220+ 生产级 AutoResearch 实验揭示五类失败模式;三原则多智能体框架带来 1.82× Recall@6 与 5.8× 覆盖率提升。
- ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning
提出 ReSPO,用平滑两分支序列级核替换裁剪,修正重要性权重尾部梯度饥饿,加速 RLVR 训练
- What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents
提出EBG训练无关方法,将证据按行为分组并构图为任务导向视图,提升长程Agent关键决策识别与证据定位
- From Traces to Agentic Worlds: Agentic Language World Models for Interactive Environment Simulation
无训练的 Trace2Env 从历史轨迹构建 worldbook,让世界模型 Agent 实现有状态交互仿真,提升长程一致性与动作回放有效性。
- Agent Plasticity: Measuring Self-Improvement Through Experience
提出 agent plasticity 指标,度量智能体将经验转化为留出性能增益的效率,并诊断改进瓶颈
- Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute
将 KV state 加密落盘并按需恢复,实现 50M token 零重算长期记忆,恢复比重算快 2.8–4.3 倍、省 8.8–12.3 倍 GPU 能耗
- On-Policy Distillation Teaches New Skills but Not New Knowledge
reverse-KL on-policy 蒸馏主要迁移组合推理技能,几乎不迁移事实知识;改用 forward KL 才能迁移新事实
- Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals
提出 InfiLoop 循环原生残差连接,使 7M 模型在数万次测试时迭代中保持推理提升,Sudoku 97.9%,ARC-AGI-2 13.6% pass@2
- Foundations of Large Language Models
系统梳理LLM预训练、生成建模、提示、对齐、推断与推理六大基础主题的技术参考书
- Language Models for Page-Level Layout Decisions in E-commerce Search
首次系统对比 Prompt 与表征方法离线评估电商搜索中次级堆叠布局,表征方法 AUC 0.853 显著更优
- Learning Multi-Step Query Rewriting via Corpus Feedback for Conversational Search
将对话查询改写重构为多步检索过程,Agent 通过检索反馈依次执行意图消解、词汇改写和伪文档生成,仅用检索奖励训练即超过单步改写基线
- SparseDecoding: Decoding-Aware Pruning for Accurate and Efficient LLM Inference
提出解码感知的剪枝框架,用生成过程激活校准并优化N:M稀疏SpMV内核,实现1.48x解码加速
- Towards Explaining Query Expansion Performance in Information Retrieval
提出理想扩展查询与可分性两个视角,系统解释查询扩展性能差异,验证相似度与检索效果正相关
- Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?
设计新文本游戏基准 Learn2Play Bench,揭示保留完整交互轨迹优于总结规则、改变 harness 可提升性能并降本
- Two-Level Softmax Sampling Done Right: Correcting Bias from Size Imbalance and Dispersion
提出 S-2LS 和 SD-2LS,修正标准两层 softmax 采样忽略簇规模不平衡与簇内离散度的偏差,几乎无额外计算开销
- MARGIN: Runtime Confidence Calibration for Multi-Agent Foundation Model Coordination
提出 MARGIN,通过运行时增量归一化按置信度分段学习模型特定校准,无需重训或留出校准集,提升多Agent决策准确率
- MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement
通过扩展 RL 训练计算、任务环境与 grader 计算,在代码/通用/视觉/安全任务上稳定提升 1T 与 310B MoE 模型。
- OneSearch-VL: Unified Multimodal Deep Research Agent for Image and Video
以视觉证据图 VGEG 与证据/定位双层奖励 EVGR 为核心,统一训练单图、多图、视频深度研究 Agent
- SuperNav: An Agentic Navigation System for Any Task in Any Scene
提出无需导航微调、以工具解耦决策与执行的 MLLM 智能体导航系统,实现任务与场景泛化
- TokenRouter: Efficient Serving System for Token-Level LLM Routing
设计 TokenRouter,以请求中心编程、模型中心执行和延迟批处理调度大幅提升 token 级 LLM 路由吞吐
- H2CE: Modeling Geo-Semantic Interactions for POI Reranking with Heterogeneous Two-Stage Cross-Encoders
提出 H2CE 异构两阶段交叉编码器,融合 bucketized 数值描述与精确标量 MLP,用 pointwise+pairwise 重排 POI,NDCG@5 达 67.48%
- Overcoming Prior Barriers: Supervised Fine-Tuning under Long-Tail Distribution
提出 prior barrier 概念与 PASS 方法,自适应分配 SFT 预算以克服长尾预训练支持差异
- Gated Memory: Admission-Controlled Memory Formation for Conversational AI
在记忆写入前增加准入门控与条件增强,使事实形成质量成为可测量的记忆约束
- Compact and Efficient Indexes for Learned Sparse Retrieval
用 medoid 替代 block summary,并压缩前向索引组件与值,实现同等精度下最多 5.3× 提速、约 3× 省内存
- OnTrack: Real-Time Monitoring and Intervention in LLM Agent Trajectories via Streaming Structure-Aware Optimal Transport
将 Agent 执行轨迹建模为增长 DAG,用流式结构感知最优传输与成功参考实时对齐,毫秒级识别失败前兆并提前中止
- Project Greenhouse: Progress Toward Fully Open and Sovereign Agentic Search
用从零预训练+SFT 的 3B 点式重排模型,以少量 GPU 实现不依赖第三方权重的开放主权检索重排
- RIT-RAG: Navigating Document Corpora with Retrieval-Induced Trees
用检索块位置诱导多文档子树,让 LLM Agent 在结构上导航并选择性阅读,提升复杂文档问答准确率
- SAIL: Scientific Agentic Intelligence via a Science-Aware Loop
35B总参/3B激活的开源科学智能体,用失败诊断自动生成训练任务,性能媲美更大模型
- SkillContrast: Difference-Guided Text Selection for Agent Skill Reranking
训练无关的文本选择器,保留候选技能间差异与局部上下文,压缩重排输入并提升干净命中
- Autoregressive Retriever: Improving Query Understanding from Item Feedback for Universal Multimodal Retrieval
自回归检索器 ARR 交替检索物品与更新 query embedding,用 SFT+RL 学习反馈选择,显著提升多模态检索性能
2026-10-08 30 篇 ★ 14 深度
- Learning Multimodal Embeddings with Evidence-Aligned Readout
EviAlign 将语义证据生成与边界读出耦合,在共享 MLLM 中按语义单元边界读取状态,提升多模态检索嵌入质量
- STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization
提出时空感知的循环状态量化框架,按误差幅度与记忆寿命分配精度,并联合拟合 key-row/value-column 尺度
- Semifactual Credit-Augmented Policy Optimization
提出 SCAPO,将半事实稳定性融入 GRPO 的 token 级信用分配,提升数学推理与 OOD 泛化
- ReSAIL: Mitigating Collapse in Iterative Agent Self-Distillation
提出 ReSAIL 插件,通过选择特权信息影响大的步骤蒸馏并保持特权条件分布,平均提升 22.5% 成功率
- Agentic RAG Evaluation: Budget Allocation Across Questions, Trajectories, and Reads
同 token 预算下,扩展问题覆盖比增加读取或轨迹数更有效降低评估标准误
- TRIAGE: Direction-Aware Mismatch Stabilization of Native NVFP4 Reinforcement Learning
提出TRIAGE,通过方向感知门控与修复稳定NVFP4强化学习,实现近BF16性能与2.3倍rollout吞吐
- Structuring MoE Expert Selection for Agentic Reinforcement Learning
提出分层路由控制框架,用操作感知互信息与令牌级一致性约束,提升 Agentic RL 成功率与推理吞吐
- On-Policy Distillation with Negative-Policy Rollouts
在 OPD 的 rollout 阶段混入低能力负策略轨迹,不改变奖励公式即可注入显式负信号,显著提升推理性能。
- On KL-Regularized Policy Optimization
KLPO将KL正则锚定在采样器,实现每prompt单rollout、无critic的LLM agent策略优化
- nanoMuse: An Open-Source Personal Agent for Every Device You Own
开源多设备个人 Agent,手机/桌面 Hands、共享会话、动作审核与文件记忆
- PhysEvo: Astra Can Act, Let It
冻结模型上通过元代理诊断失败、修订工具与技能,大幅提升机器人操作成功率
- DLoop: Looped Speculative Decoding
DLoop 让一次验证覆盖多个草稿阶段,通过置信度门控与 loop-aware 训练,在多种投机解码上把 wall-clock speedup 提升 5–41%
- Agentic AutoRAG: RAG Pipeline Optimization through Reasoning-Driven Agents
用 LLM agent 诊断检索/生成失败并借助模型排行榜与价格先验做 RAG 超参 Pareto 优化,样本和成本效率显著提升
- Mechanics of Long-Context Hybrid Models Part 1.1: From Hybrid Attention to Hybrid Position
揭示 NoPE 与位置偏置注意力的协作机理,提出滑动窗口线性注意力实现 16 倍免训练长度外推
- From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery
PersonTTS 用摊销智能体策略发现复用历史搜索经验,按用户多维需求个性化配置测试时计算
- RunningTab: Direct Workspace Interaction with Environment-Side Tabs
为 LLM agent 直接操作工作区文件引入环境侧任务台账,记录需求、已读摘录与未打开候选,防止交付遗漏
- SkillForge: Co-Evolving Skills and Agents via Dynamic Skill Lifecycles
用 fitness 驱动的技能生命周期和 LLM 变异,让技能库与 RL 策略协同进化,避免低效技能污染上下文
- WebFovea: When the Model Is Right but the Click Is Wrong -- Reliable Round Trips for Vision-Based Web Agents on Live Websites
通过硬化解析、执行、观测、信息呈现四阶段,同一模型成绩从31.0升至57.0
- We Query, Therefore We Compute: On Oracle Computation beyond the Machine, with an Application to Agents
将 LLM 作为 Oracle 构建抽象机,统一 Workflow 和 Agent,并提出 ArchNights 操作系统实现
- Beyond Outcome Rewards: Constructing and Assigning Retrieval Credit for Search Agents
系统研究检索中间信号在 GRPO 中与动作对齐的信用分配,局部 credit 显著优于 scalar reward shaping
- From Chunks to Functional Evidence: Function-Aware Retrieval for EDA Documentation QA
用功能单元(超边)重组多类型文档碎片,训练编码器对齐 query 与功能单元,联合 chunk 检索与统一 reranker,大幅提升 EDA 文档 QA 的 ROUGE-L
- ExperienceIndex: Artifact-Grounded Memory
ExperienceIndex为AI Agent提供工件级经验记忆,通过单工件和工件对经验检索提升答案质量并降低成本
- Training with Missed Targets in Generative Recommendation: Separating Supervision from Probability Competition
用 WN/Cond/Full 三损失分离补全候选的监督收益与跨组概率竞争,证明竞争可损害重排。
- SkillSandbox: Skill Verification via Dynamic Scenario Synthesis
围绕每个技能动态合成新场景,对比有无技能的执行轨迹来验证其可重用性,构建更可靠的技能库
- Does Document Structure Help Dense Retrieval? A Placebo-Controlled Ablation of Four Mechanisms Across Two Corpora
在双语料上做安慰剂对照消融,证明结构对齐分块与真实标题路径能小幅但稳定提升稠密检索 nDCG
- YANchor-4B: Effective Long-Horizon Reasoning in O(N) Time with O(1) Memory
用固定容量记忆锚点结合循环状态与局部注意力,在O(N)/O(1)下实现强长时程推理
- Finding the Right Balance: Relevance and Diversity in LLM Retrieval
提出基于候选池冗余与查询证据需求的查询自适应规则,选择性启用检索多样化,避免损害相关性与答案质量
- RECAST: Learning to Compute the Right Context through Adaptive Evidence Routing
提出RECAST,将证据构建视为检索与计算操作的序列决策,用轻量RouterLM迭代选择/合成操作,在6个基准上平均准确率达75.6%,超最强基线15.9%
- A Good Self-Teacher Meets the Student Where They Are: Joint On-Policy Learning and Teaching
提出JOLT联合训练特权教师与无特权学生,使蒸馏梯度与奖励梯度一致,提升样本效率和最终性能
- Composing What Each Teacher Learned: Multi-Teacher On-Policy Distillation through Teacher-Relative Shifts
提出教师相对基座 logit shift 作为多教师在线蒸馏目标,消除基座偏好,提升组合信号均衡与效率
2026-10-07 30 篇 ★ 19 深度
- When Does Selection Replace Extraction? A Pre-Registered Test of Agent Memory with a Typed Decision Model
预注册实验表明:在紧凑预算下,用类型决策模型单次选择原始对话轮次,效果非劣于 LLM 提取记忆且成本极低;重排序增益随预算增大而减弱
- Making LLMs Say What They Think: Measuring and Improving CoT-Interpretability Alignment
提出CIA度量并后训练联合优化任务精度与参数忠实度,提升LLM思维链与内部计算一致性
- GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution
用证据驱动 harness 自动进化,让冻结 backbone GUI agent 自改进并跨任务/模型泛化
- Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents
将多模态搜索Agent的逐步推理从自由生成改为从候选库中并行选择,保持成功率且推理延迟降超90%
- SEER: Self-Evolving Event Reasoning and Retrieval for Time Series Forecasting
用预测误差驱动检索记忆与因果知识库更新,显著提升事件驱动时序预测的准确性与可解释性
- EVISKILL: Grounding Skill Evolution in Replayable Evidence
用可回放证据卡与定向重放验证技能编辑,缓解经验驱动技能演化中证据丢失和全局验证粒度过粗问题
- HLA: Expressive Hybrid Linear Attention via Chunk-Wise Dynamic Mixing
将历史 chunk 表示为仿射转移并用查询相关门控动态混合,提升长上下文检索
- HuatuoGPT-3: RL-Only Domain Adaptation from Base Models
提出OnePO,以自适应目标演化和教师退休实现RL-only领域自适应,在医学上用20K样本超越SFT+RL和纯RL
- MiniCorp: The Last Mile of the AI Agent Firm
构建电商公司多智能体模拟器,生成纵向反事实企业数据,用于训练和评估能自主运营的 Agent
- Capability-Driven Self-Evolution of Agent Memory
将整体性能搜索分解到能力维度,通过能力专家与痕迹引导集成,在百万token基准上比最强基线高7.83–10.54个百分点
- Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution
OPPD 通过 on-policy 蒸馏把推理时序列级幂分布采样的成本转移到训练阶段,单个生成即可达到或超过 64 候选采样
- From Evidence to Action: How Tool-Using Agents Fail
提出 SAFEACTBENCH,用确定性轨迹评估定位工具型智能体在证据建立、动作执行与依赖传播中的失败点
- Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability
跨 tokenizer 在线蒸馏中,严格 1:1 对齐已覆盖多数 token;学生选 top-16 共享词表即可保留大部分收益,补 mismatch span MSE 反而降精度
- Personal-Agent Mediated Recommendation with Cross-Platform User History
用反事实掩码估计跨平台历史归因,在 LLM 重排平台榜单时做价值保序的优势再分配
- Towards In-Parameter Memory Augmentation for Large Language Models
以参数放置与获取时间为两个正交轴,系统梳理部署期 LLM 参数化记忆方法
- TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models
提出 TRACE,通过 rollout 侧量化结果引导训练侧 FP4 舍入,实现 FP4 rollout 与 BF16 性能相当并最高加速 5.4 倍
- Harness Engineering for Software Engineering via Modular Executable Dev-Primitives
提出 Dev-Primitives 与 HERMES,用依赖感知动态激活的模块化 LLM 原语降低长程软件工程任务的上下文爆炸与语义漂移
- Hiding Tool Latency in On-Device Cascaded Voice Agent through Speculative Execution
在流式 ASR 部分假设上预测工具调用并推测执行缓存结果,将首音频中位延迟从 5.79s 降至 4.60s
- Rethinking Semantic ID Construction for Generative Recommendation: SimHash with Parallel Decoding and Semantic Alignment
证明哈希语义ID性能差源于解码不匹配,提出FLASH框架:训练无关SimHash+并行解码+语义对齐达到SOTA
- AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
冻结 world model 内共同进化课程、注入攻击者与 agent,4B agent 在未见攻击下完成率提升33.6%并泛化真实浏览器
- From Delivery to Stateful Exploration: Rethinking the Index for Agentic Search
提出 INDEXACT 索引原生接口,将候选集细化与源文本检查分离,用可复用状态与统计反馈提升多跳搜索证据发现并降低上下文占用
- Adapting Generative Recommenders for Multi-Turn Interaction
让生成式推荐模型通过 routing token、history re-anchoring 与 behavioral replay 在多轮对话中保持准确性并可被纠正
- Reinforcement Learning with Conformal Action Sets: An Application to Sequential Recommendation
用 critic gap 打分和在线保形阈值动态裁剪候选集,在不增大 set size 下提升 catalog diversity,并给出有限会话价值界
- Agent in a Bottle: Can LLM Agents Turn Their Capabilities Into Cheap, Scalable Artifacts?
用BOTTLED基准评估LLM智能体在固定预算下把通用能力封装为任务专用廉价制品的能力,发现零样本强不必然装瓶强
- Learning to Retrieve via Reinforcement Learning in Embedding Space
RELER 将 embedding 视为动作,以 vMF 采样探索,用 RL 直接优化检索/下游奖励,结合 CMP 降方差,后训练提升检索与 RAG
- Disentangling Paradigm, Identifier, and Decoding in Generative Retrieval
控制 AR/扩散、docid 与解码,证明解码可改变扩散 Hit@1 6.6-13.7 点,one-pass scoring 近似最优
- A Systematic Study of Semantic ID Spaces for Generative Information Retrieval
统一 PQ 与 RQ 的语义 DocID 设计空间,发现混合 PQ×RQ 最优,Uniqueness Ratio 是训练前关键门槛
- SquidAgent: Parallelize Wisely, Coordinate Efficiently
提出用预测输出 token 成本决定每层串并行,通过上下文继承和前置约定降低协调开销,吞吐提升 2.2 倍
- UNREAL: Unifying Retrieval and Long-Context with a Single Model
冻结LLM内部表征统一语料检索与长上下文去噪,仅训练<500K参数即超SOTA检索器
- Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresight
用事后交互轨迹蒸馏出交互前可预测的知识/失败模式,让每条 rollout 均贡献监督,最高提升 24.2 pp
2026-10-06 30 篇 ★ 24 深度
- KeyRec: Bounded Visual Memory for Streaming and Long-Video Understanding
训练免费的视觉记忆框架,用事件银行与近期缓存分离存储,在固定预算下高效压缩长视频视觉 token
- The Extender: A Log-Structured Transformer
提出日志结构Transformer,用每层32维扩展嵌入替代全宽KV缓存,使924M模型持久注意力内存减少104倍且长上下文更优
- WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents
构建可扩展交互系统、执行驱动自进化与稳定训练,WEFT 在多个工具使用基准上超过同规模环境扩展基线。
- Latent-MOPD: Latent Multi-Teacher On-Policy Distillation
首个表示级多教师在线蒸馏方法,通过路由晚期隐藏状态对齐和逐教师 crossfade 融合多专家能力
- CUAWright: A Minimal Unified Interface for Digital Agents
用 bash 命令和文件系统作为极简接口,让数字代理动态创建工具,大幅提升任务成功率和效率
- Dynamic Harness Search: Building Multi-Agent Systems Per-Query via Prediction
SHIFT 用本地小模型预测 harness 效用并以 MCTS 按查询构造多 Agent 系统,无需在线执行候选,精度与成本双优
- Self-Supervised Scaling of Terminal Environments for Scientific Domains
用现有科学软件工作流自动生成可验证的终端Agent训练样本,SFT后显著提升Terminal-Bench 2
- Language Models that Play Chess and Explain Their Moves
4B 模型结合沉默专家棋类编码器与迭代 Bellman 式自蒸馏,棋力达 2697 Elo 且可解释走法
- ALoDLM: Adaptively Looped Diffusion Language Models
按 token 难度分配计算,扩散语言模型在多个基准上超越同规模 AR 模型并保持并行解码
- ASCENT: Online Test-Time Training of Long-Horizon Agents via Self-Distillation of Verified Experience
用冻结初始模型将验证成功的轨迹蒸馏为 LoRA 软目标,使长程 Agent 在单次任务流中稳定在线进化
- Query Generation with Direct Preference Optimization for Document Expansion in E-commerce Search
用相关模型构造偏好对做 DPO,再将生成 query 过相关过滤,显著减少 Doc2Query 幻觉并提升线上搜索相关性与加购率
- Memadapter: Counterfactual Adaptation Against Memory-induced Sycophancy
提出后检索反事实适配框架,动态校准记忆使用边界,降低 LLM Agent 长期记忆诱导的谄媚偏差
- Base Models Can Reason By Taking a Cue From Training Data
固定特定起始 token cue 可使 base model 推理性能接近 RL 模型,该效应源于训练数据关联
- Cut Binary Cross Entropy: Efficient Large-Vocabulary Loss and Gradient Kernels for Sequential Recommendation
CutBCE 通过分块重算与稀疏修正避免 [B,N,V] logits 驻留 HBM,在 876k 词表上将训练显存降 65.7%、速度提 225.9%
- SCOUT: Supply-Aware Cold-Start Proactive Query Suggestion for Travel Search
用搜索重排分作免费 RL 奖励,GRPO 把供给感知压进 LLM,零推理成本追平 best-of-8
- SearchJev: A Fast and Calibrated System-1 Model for Search Agents
将搜索 Agent 中的短决策与 System-2 生成分离,用 schema-conditioned logits 直接输出校准概率,实现 5.2-5.3 倍决策加速并提升端到端答案准确率
- Search Engines Never Say No: How Frozen Agents React When the Retrieval Tool Refuses
工具侧返回 NULL 拒答信号,让顺从 Agent 弃答率提升 243%,并给出按 recall 定价的收益曲线
- Towards Looped Models Done Right, Part II: Rethinking at Fixed Points
从不动点视角重构循环 LLM,以学习深度先验和正交注入支撑终端 KV 共享、蒸馏预填充与 RL 状态复用
- BRANCH-MoE: Balance-Aware Tree Routing for Large Embedding Models
提出将专家置于二叉树叶节点的BRANCH-MoE,用到达加权EMA锚点在没有辅助损失的情况下保持负载均衡并诱导共路由局部性
- Beyond Semantic Similarity: Performance and Costs of Agentic Retrieval for Complex Tasks
用 ReAct 智能体循环结合 LLM 推理与稠密检索,复杂检索 nDCG@10 平均提升 8.7 点,但成本大幅上升
- CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling
将昂贵 judge 反馈蒸馏为可认证的验证问题库,训练时做稠密奖励,测试时做无需 judge 的保守轨迹选择
- Programmatic Search Agents: Extending Agentic Search Beyond Query Reformulation
提出 Programmatic Search Agent,以可执行程序单元组织搜索动作,统一候选工作区、原语组合与选择性证据呈现,提升成功率并显著降低 token 消耗
- LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient Sketches
通过低秩梯度草图压缩RL训练中的梯度和优化器状态,配合预测KL步长控制,大幅降低内存占用
- MATE: Adaptive Long- and Short-Term User Memory for LLM-Based Recommendation
提出 MATE,用时间证据控制长短期记忆写入,在线只更新用户记忆,在 LLM 增强序列推荐中提升 NDCG@10 7.0–13.2%
- MatrixFormer: A Foundation Model for Matrix Completion
二维网格 token + 轴向注意力的预训练矩阵补全模型,零样本跨域完成插补、评分预测与因果面板补全
- MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents
用 RL 多步策略按需编排记忆检索与异质 LLM/VLM 策展,实现质量-成本-延迟可控折衷
- Generate What You Can Trust: Content Credibility in Generative Recommenders
提出 CreGR,通过可信度感知 tokenizer 和离散扩散非对称掩码策略,在保持生成精度的同时显著降低不可信内容曝光
- SPRIG: Semantic-ID-enhanced Paths for Knowledge Graph-based Generative Recommendation
首次在KG路径推理生成式推荐中将物品表示为层级语义ID,统一共享词表,以更少参数实现更强推荐
- T-Search: An Open Agentic Retriever and Playground for Hard Multi-Step Search
开源权重 Agentic 检索器,以多轮短上下文搜索返回证据块,平均 Recall@10 达 56.0 并超越更大模型
- How Sparse Probability Maps Shape Mixture-of-Experts Routing
通过可控实验揭示稀疏概率图的零输出能力不会自动带来 token 级专家参与,参与由阈值与 learned score 分布共同决定
2026-10-05 30 篇 ★ 9 深度
- Triadic Linear Attention: Three-Dimensional Recurrent States for Long-Context Sequence Modeling
将线性注意力的矩阵状态扩展为三阶张量,用第二个 key 维度以极少参数成倍扩大状态容量,显著提升长上下文语言建模与 recall
- On-Policy Parameter Update Direction Underlies Generalization in LLM Post-Training
提出OPSFT:约束SFT沿在线策略累积更新方向更新,仅少量在线策略步即可将泛化优势迁移给监督微调
- LexReward: A Taxonomy-Driven Reward Framework for Legal Language Models
提出按Style/Element/Chain三维分解的法律奖励框架,用rubric构建偏好数据训练DPO和奖励模型
- Looping Beyond Twice: A Scalable Recipe for Looped Mixture-of-Experts
LOOM 用残差缩放、输入重注入、逐循环路由与 Looping Residual 让 MoE LLM 稳定循环 9-12 轮并优于基线
- When History Misleads: Asymmetric Margin Supervision for Instruction-Guided LLM Generative Recommendation
提出AIMS,把单条历史删除效应转化为请求特定的反事实排序边际目标,用非对称辅助损失在完整历史上训练
- Scaling Trajectories for Complex Tasks through Recursive Self-Rewrite
用 planner-critic-executor 递归重写多 harness 成功轨迹,将 2k 源轨迹扩至 11k,SFT 后 terminal 任务 pass@3 全面提升
- JoinGR: Learning to Traverse Join Graphs for Table Retrieval
将数据库连接图作为检索空间,用查询条件化评分器遍历边来提升多跳表检索召回
- Adaptive Sparsity Optimization with Learnable Soft Top-K and Per-Term Thresholding for Efficient Retrieval
提出可学习软Top-K、逐项阈值和FLOPs正则化联合稀疏化方案,大幅缩短LLM稀疏检索向量长度并保持效果
- Source Preference in the Wild: How LLM Agents Favor Items by Source, and How to Reduce It
LLM Agent 在端到端搜索中因来源域名产生选择偏差,即使内容一致也偏好特定站点,且可通过平衡训练与缺失信息干预缓解
- MetaRubric: Learning to Reward for Rubric-Based Reinforcement Learning
提出 MetaRubric,交替证据感知策略优化与响应引导的 Rubric 自适应,解决 Rubric RL 的虚假信用问题,在医学 QA 上超越静态 GRPO
- SOLO: Certified-Recall Metric Similarity Search with Scan-Only Sampled Inverted Lists
SOLO 索引以无排序启发式的扫描倒排列表实现可证明召回,在 1GB 内存下 Deep-100M 召回 0.9977
- Learning Style, Forgetting Semantics: A Case Study of SFT and RFT on Classification Tasks
理论证明SFT因风格漂移导致语义遗忘下界为正,而RFT保持零语义误差
- AdaStep: Adaptive Step Credit Weighting for Agentic Reinforcement Learning
为GiGPO的步级优势推导逐状态收缩系数,按返回方差中信噪比自适应加权,无额外模型或rollout
- CLIMB: Confidence-Guided Complementary Evidence for Multimodal Retrieval-Augmented Generation
训练无关的多模态 RAG 框架,用互补证据池与置信度引导的迭代细化提升知识密集型视觉问答效果
- Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation
提出 RC-OPD,用学生失败推理的根因修复和锚点引导,缓解自蒸馏的推理错配与蒸馏陷阱
- Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
系统评估三种长度压力训练方法,发现压缩 CoT 会降低忠实度但监控性较鲁棒
- Planning to Learn
提出 horizon loss,依据剩余学习预算把交叉熵动态过渡到精确策略梯度,提升 top-1 准确率和抗噪能力
- Query-aware routing for Cross-lingual performance gains in Encoders
用 query-only LoRA 适配器加语言路由,跨语言检索平均 nDCG@10 提升 20.9%,同时保持同语言性能
- KV$^2$: A Self-Refining KV Cache
用轻量代理选少量锚点做选择性重建,在 2% KV 预算下大幅优于 KVzip 等基线
- LESSER: Post-Training Data Selection with Output-Layer Gradients
用输出层梯度近似全参数梯度进行数据选择,降低特征提取FLOP 9.7倍/3倍且保持下游性能
- MRVQ: One Resident Index for Dimension- and Rate-Elastic Vector Search
用一个残差量化索引通过残差阶段和坐标前缀两种截断,同时服务多种维度与码率,大幅节省驻留内存
- NeutronGym: Physics-Graded Neutron Instrument Design for LLM Agents
首个可执行中子仪器设计环境,用无 LLM 评判的物理分级奖励训练 8B 模型超越未训练 32B
- Gains and Collapse in On-Policy Distillation:A Reinforcement Learning Perspective
用 RL 视角解释 OPD 收益与崩溃:教师隐式奖励会放大学生的已有采样行为,掩码不健康响应与 SFT 初始化可缓解崩溃。
- Pivot-SD: Efficient Self-Distillation for Masked Diffusion Language Models
用信息增益筛选高影响力掩码 token 进行自蒸馏,提升扩散语言模型推理性能
- Divergence controls entropy in distillation
证明 forward KL 抬高学生熵、reverse KL 压低熵,散度成为隐式熵正则器
- Collective Bias Mitigation via Model Routing and Collaboration
提出 Collective Bias Mitigation,用多 LLM 路由与协作降低偏见,Committee 在 top-7 将年龄偏见从 0.25 降至 0.10
- Learning Query Encoders Can Be Hard Even When Vector Retrieval Is Geometrically Easy
证明冻结文档索引几何容量充足时,查询编码器学习仍存在统计查询下指数级困难
- Credit Where It Matters: Dependency-Aware Policy Optimization for Terminal Agents
提出 DepGPO,用命令间读写依赖图反向追踪,把优势分配到真正影响结果的步骤
- Not Until the Evidence Says So: Teaching LLM Investigators When to Close a Case
构建 Nautil 事故调查数据集与三阶段结案评估,显著降低 LLM 过度自信并提升证据依赖结案准确率
- Knowledge or Calculator? Decomposing the Skill Premium in Verifiable Financial Agent Workflows
用 2603 个金融 episodes 分解 agent 技能溢价:策展工具 +19.5、文档 +5.6,现场生成几乎无效
2026-10-04 30 篇
- DataMagic: Authoring Data Videos through Declarative Multi-Agent Orchestration
DataMagic 用 DVSpec 声明式规范统一图表、叙述与动画,通过生成后编排多智能体策略高效生成数据视频
- When Does Correction Become Repair? Mechanistic Auditing of Internal Interventions in Tool-Using LLMs
SAKIKO 审计框架揭示激活干预的行为迁移不等于修复,并量化附带损伤
- RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers
提出覆盖四类机器人开发工作流的编码智能体评测基准,用 RLE Index 聚合多维工件指标并给出排行榜
- Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Models
提出训练免方法SECRET,通过源条件中继引导抑制跨模态干扰,缓解AVLLM源混淆接地幻觉
- Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces
提出全连续多模态生成模型,用流匹配在连续嵌入空间统一语言和视觉,避免离散量化瓶颈
- MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding
提出MG-Thinker后训练RL框架,通过层次化推理与双轴优势分解提升多图像推理定位性能
- AgSpec: Pushing the Limits of Retrieval-Based Speculative Decoding in Coding Agent Pipelines
AgSpec通过三层语料检索与按Agent自适应草稿长度,将编码Agent流水线生成吞吐提升至自回归解码的4.37–4.76倍
- Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs
提出 SAGO 框架,从生成一致性、内部激活、置信度与响应镜像等多轴度量 LLM 对同一输入变体的行为稳定性。
- OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction
通过共享主动生成过程联合学习证据记录与任务响应,形成可复用事实记忆且不牺牲实时感知
- Working Around the Compute Ceiling: Byte-Exact Memory in Galahad Makes LLM Reading a One-Time Cost LLM Reading a One-Time Cost
Galahad 为 vLLM/SGLang/llama.cpp 提供字节精确 KV 记忆层,将重复文档阅读变成一次性成本
- VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation
系统评估视频生成模型的场景文本渲染能力,并提出关键帧引导的Agentic改进框架
- Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes
提出用文本空间引导作为特权信息,通过在线策略自蒸馏提升 MLLM 空间感知,合成训练可迁移真实基准
- Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs
发现时序信息在中间层达到峰值后逐渐消失,提出无需训练的 Temporal Activation Injection (TAI) 在推理时注入激活以强化时序推理
- From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search
用局部 biaffine attention 构建专利发明图,蒸馏规则解析器,实现长文档可扩展图检索
- Learning to structure data from user-generated thematic corpora
用 LLM 全自动迭代发现领域属性 schema,无需预定义本体即可抽取结构化数据
- Stochastic Rounding in Low-Precision Transformer Inference: A Variable-Precision Emulation Study of a Small GPT-2
系统研究低精度 Transformer 中随机舍入与就近舍入的逐位置权衡,发现 MLP 输出宜用 SR、LM head 宜用 RN,混合配置可显著降低困惑度损失
- DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation
把分布匹配蒸馏重构为对抗式分类,免去辅助 score 模型并实现 1.04 FID 一步生成
- DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communication
提出 DuoMind 分层框架,用 VLM 生成语义协调消息、VLA 执行底层动作,并构建 RoboPoly 基准验证多机器人长程协作
- GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning
通过 Common-Residual 几何对齐和路由优化,解决 3D 推理中几何 latent 坍塌与欠使用问题,在 SPAR-Bench 和 SPBench 上达 SOTA
- Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage
反事实审计10个开源LLM的临床分诊偏差,发现敏感性与模型规模/医疗预训练非单调,QLoRA微调版本最低
- Latent JEPA: Abstract Future Prediction for Latent Reasoning in Chemistry
提出 Latent JEPA,在自回归学习中引入未来视图联合嵌入预测,提升化学推理与分子优化
- MoLE: Mixture of Latent Experts for Complementary Visual Reasoning
用潜在专家混合让不同 latent token 提取互补视觉证据,在相同 latent 预算下显著提升视觉推理
- SoftServe: A Scalable Quasi-Newton Method for Deep Learning
提出无需线搜索和曲率修正的可扩展拟牛顿族 SoftServe,通过正定曲率估计与 Newton-Schulz 迭代训练大规模网络
- VISTA: A Visual Harness for Reasoning in an Interactive World
多模态模型通过无损视觉记忆和主动视觉检索,在交互环境中大幅提升推理与行动效率
- External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
提出用隐藏状态探针定位幻觉起始与延续 token,并发现外部小模型观察者可匹敌生成模型自检测
- No Model Required: Text Entropy Rate Filtering Mitigates Iterative Fine-Tuning Collapse
提出基于 Kontoyiannis 熵率估计器的纯文本过滤器,在不访问模型的情况下有效提升迭代微调多样性
- Every Ablation Is a Dose: Counterweights and the Semblance of Self-Repair
提出自修复源于消融前已有的反事实增益,组件响应服从仿射定律并可由固定权重预测
- Detecting Inconsistencies in Model Specifications with LLM-as-Verifier Reasoning
提出 VeriSpec,通过保留自然语言并用 LLM 作为验证器,直接审计模型规范文本以检测规则冲突
- Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation
发现多模态MoE专家自发语义专精,ExpertLens解码路由权重定位专家并选择性微调,仅更新21.7-47%参数达4倍加速
- Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents
RPG 不更新模型权重,在仿真中重构练习任务并自我改进技能与提示,22 项操作成功率从 28.6% 提升至 95.0%
2026-10-03 30 篇 ★ 6 深度
- X-Tree: Tokenizing Reusable Experience for Efficient Agent Generalization
把智能体轨迹中可复用动作片段按频次/长度/成功率挖成层级 X-Tree,并以数据、奖励、上下文三种方式训入权重
- On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics
在强到弱蒸馏中解耦 rollout 策略、KL 方向和 learning rate,发现 on-policy 无一致优势,forward KL 更鲁棒,learning rate 主导遗忘与稀疏性
- Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation
训练免清洗方法估计后门方向与拒绝子空间,对权重正交化,在保持安全能力的同时实现最低 ASR
- CorrGRPO: Correlation-Normalized GRPO for Multi-Reward Learning
将 GRPO 多奖励优势归一化从协方差改为 Pearson 相关,消除大方差奖励主导,提升代码/工具/Agent 安全多目标训练效果
- E-MoE: Enhanced Mixture-of-Experts for Non-Factorized Diffusion Language Models
利用 MoE 路由决策作为离散共享隐变量,构建非因子化反向过程,在不增加激活参数下提升少步生成质量
- MemFold: Learning Compact Soft Memory for Long-Context Personalization via On-Policy Optimization
固定预算软记忆+置信门控在线蒸馏,按下游行为而非文本重构优化长程个性化记忆
- Transformers Stop Thinking Too Early, and a Tiny LoRA Fixes It
发现基础模型在上下文引用链上仅能跟随1.4–3.6行,早期层加rank-8 LoRA可扩展至数十行,默认答案低估了计算能力
- Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs
冻结两端模型,通过结构对齐、映射与校准实现跨家族 KV 缓存迁移,免预填充加速异构多智能体通信
- Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation
用局部参数扰动构建专家池并按状态路由,为在线自蒸馏提供更优监督,平均提升 1.67~2.75 点
- JevSpawn: Adaptive Agentic Inference through Compositional Action Spaces
通过组合动作空间与并行生成-反馈选择,将 Jev-style 快速概率预测引入自适应 Agent 推理,降低延迟并提升任务性能
- Argo-Bench: Evaluating Data Agents on Enterprise-Scale Workflows
构建企业级数据智能体评估基准,模拟纽约外卖平台,要求跨235表分析并采取行动,最强模型均分仅59.5
- From Images to Tasks: Characterizing Multimodal LLM Interactions in the Wild
分析4万+图像上传对话,揭示多模态LLM真实任务分布及基准错位
- Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success Rate but 65% Fewer Tokens
PyRUA-Lean 用代码执行+选择性观察,同等调用预算下成功率 63.1%→71.7%,Token 省 65%
- Decoding Looped Transformers Better for (Almost) Free
训练无关的LoopCD对比解码,利用循环中间状态引导最终预测,提升推理质量并大幅降低计算量
- JuryFlow: Disagreement-Guided Human-in-the-Loop Multi-Agent Evaluation
把多智能体评判分歧视为 claim 级不确定性信号,人只选择关键分歧点,通过图传播与 rubric 归纳实现自改进评估
- KaliBench: A Fine-Grained Benchmark for Cybersecurity Tool Use on Kali Linux with Runtime-Free Verifiable Rewards
构建 8,504 条自然语言到 CLI 的细粒度基准,用可验证奖励把 8B 模型训练到接近 685B MoE 水平
- Conversational Capture: A Trajectory-Level Framework for Evaluating Generative Engine Optimization in Multi-turn Human-Agent Interaction
提出轨迹级多轮评估框架,揭示早期引用带来的会话捕获效应及其对单轮排序的颠覆
- Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation
0.9B 参数多模态嵌入模型,冻结文本塔、用稠密 caption 自身嵌入作教师,在不退化文本检索下对齐六模态
- ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research
构建207篇论文的作者标注检索基准,揭示Agentic搜索未超越嵌入检索(R@20 0.42 vs 0.48)
- Breaking News Out of the Filter Bubble: Generative AI Search Diversifies Collective Attention and Raises Shared Information Consumption
随机田野实验显示,生成式AI搜索能扩大热门话题触达、增加读者间话题重叠,同时把消费推向冷门话题
- From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation
通过梯度与优化器分析,揭示损失平均、Adam动量、BF16精度和词汇截断如何影响多教师蒸馏的任务性能。
- From Knowledge Access to Source Learning: Developing Source-Specific Competence
提出SourceLearn,用自指导+任务指导学习持续构建可复用源模型,在13/15设置中超越RAG与记忆基线
- CANOPY: Adaptive-Granularity Evidence Compression for Multimodal RAG
CANOPY 用层级节点评分与父相对细化选择多粒度证据区域,结合 critic 触发补充检索,压缩 token 同时保持准确率。
- Local Support Learning
提出 Local Support Learning,用 GMM 门控使 adapter 只在当前分布激活,无需旧数据缓解大模型灾难性遗忘
- Scalable, Transferable Meta-network for Data Selection Requires a Different Loss (and Why the Obvious Choice is Problematic)
提出TESS框架与PVM损失,解决元数据选择网络中的权重抑制与易学特征依赖,实现跨数据集跨模型迁移
- LLM2Jev: LLMs Are Already Jev-Style Decision Models -- When and How to Fine-Tune Them
提出 LLM2Jev 框架,直接利用括号数字标识符的 next-token 概率提取校准决策,无需训练即可让 4B LLM 匹配专用 Jev 模型
- Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real Tasks
Mingbird 通过十项机制补偿小模型故障,在 LRAB 与 τ²-bench 上显著超过 goose/opencode/agent-mini
- OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning
将 Omni-LLM 变为主动多轮推理 Agent,动态检索关键音视频片段以支撑跨模态长上下文推理
- TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning
用每列最大梯度符号的稀疏更新替代 AdamW 状态,优化器状态降 174 倍,单卡 H100 可全参微调 30-32B 模型
- Trust the Direction, Search the Step: Zero-and-First-Order Methods for LLM Fine-Tuning
提出ZFO框架,用一阶优化器定方向,沿一维子空间做零阶评估选步长,成本低于线搜索
2026-10-02 30 篇 ★ 24 深度
- When Users Change Their Minds: Measuring and Repairing Intent Drift in LLM Agents
构建可控意图漂移基准 INTENTFLUX,提出显式状态折叠 StateForge 显著修复多轮任务性能下降
- Retrieval-Augmented Skill Optimization via Cross-Harness Adaptation
检索外部技能语料并用 Cross-Harness Adaptation 适配到目标任务与执行环境,同时强化技能初始化和失败驱动更新
- AutoDataBench: A Data-centric Testbed for Accelerating Auto Research
构建受控测试床隔离数据智能,评估LLM改进训练数据的能力及数据效应推理,并将轨迹复用于mid-training
- GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis
用证据图从真实文件合成可验证的工作智能体训练数据,微调后多项基准显著提升
- Make Sparse Rewards Count: Density-Aware Reward Aggregation for Multi-Reward RL
提出 DARA,通过逆平方根密度校正放大稀疏奖励的信号,加速多奖励 RL 训练且不改变策略优化目标
- Smaller Models, Better Rejects: Preference Distillation Scaling
在偏好蒸馏中,用更小的冻结模型生成 rejected 响应,比学生自己生成的负样本效果更好且计算成本更低
- ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization
将 Agent harness 优化的训练场景选择建模为非平稳 bandit,动态构造 failure-pattern arm 并自适应调度,在 GAIA2/Terminal-Bench 2.0 分别提升 4.4/7.5 个百分点
- AutoGUIWorld: Image Generators as Visual World Models for GUI Agent
利用图像生成器与规划器合成无环境依赖的GUI交互轨迹,提升GUI智能体真实任务性能
- Hierarchical Continuous Diffusion Language Models
HC-DLM 将离散 token 生成与连续潜变量去噪耦合,在 Sudoku/Countdown/LM1B 上超过匹配规模扩散基线
- Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States
提出 PoS 框架,通过显式信念状态、一致性验证与卡住感知恢复提升长程 LLM Agent 表现
- When the Label Ignores the Request: Auditing Policy-Selected Targets in Synthetic Conversational Music Recommendation
审计合成对话音乐推荐基准,发现显式点歌请求半数被官方标签违背,低权重训练补充修复且不损官方指标
- Sharpening Tax in Post-Training
提出Sharpening Tax度量后训练对测试时覆盖率的损失,并给出PTGS自适应温度采样以同时提升pass@1与pass@K
- Scaling and Distilling Text Embeddings for Better Diffusibility
通过扩展嵌入模型并用解码概率软标签蒸馏,使连续扩散语言模型生成有效文本,Gen PPL 17.8 优于 GPT-2-M
- RPTune: Learned Context Curation for LLM Catalog Search
提出 RPTune,用可学习 curator 对全量商品目录做剪枝重排,并配合 LLM 后训练,在 7 个小商家上显著提升商品搜索准确率
- Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization
提出 INFLOWOP,用统一无标签成本驱动多Agent工作流构建与流内局部修复,在 BRAID 上最高较单Agent提升11.97%
- It Takes Workflows to Evolve Better Workflows
提出FLOWRIGHT,将工作流作为统一harness,通过分层结构感知奖励实现多角色自进化与共进化,无需额外模型或标注
- AgentWebRec: Compact Evidence Fusion over the Agent Web for Personalized Recommendation
将推荐重构为 Agent Web 上的任务时证据获取与融合,通过 query-response 交互与置信度门控协作,在不集中代理记忆的情况下提升个性化推荐
- AutoCompact: Learning When to Compact Context in Long-Horizon Coding Agents
训练编码智能体主动决定何时压缩上下文、保留什么工作状态以及如何继续,显著提升长程任务成功率
- Not All Is Lost: Repairing Lossy User Preference States of Personalization Encoders
提出 REPAIR,利用冻结编码器缓存修复偏好状态,在不改编码器和任务头下提升推荐与个性化生成
- CARM: Cancellation-Aware Response Masking for LLM Reinforcement Learning
用绝对 log-ratio 均值替代带符号 geometric mean,防止双向策略漂移相互抵消,提升 GRPO 训练稳定性与推理/代码效果
- Do Multilingual Encoders Produce Language-Consistent Semantic IDs?
用 ESCI 翻译对照证明:多语言编码器与平衡码本不能保证同一商品跨语言 SID 前缀一致,需显式对齐目标。
- Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives
用 LLM 离线模拟生活轨迹训练 query 侧 LoRA,零 LLM 在线实现对话记忆联想召回,插入 HyperMem 后 LoCoMo-Plus 达 66.6
- A Matryoshka Hierarchical RAG for Efficient Multi-Hop Question Answering
结合 Matryoshka 嵌套表示与层次聚类 DAG,用实体预算与锚定控制实现高效多跳检索,在三个多跳 QA 基准上取得最佳质量与效率
- Mem++: Non-Destructive Memory for Long-Term Organizational LLM Agents
Mem++ 用整文档存储与读时时间过滤+多路检索融合,替代写时蒸馏,在组织记忆基准上大幅领先
- Cross-Lingual Alignment for Decoder-Only Models using MoE Routers
用 MoE router 输出的均值池化作为序列级跨语言对齐目标,在解码器模型中实现显式对齐并提升多语种表现
- The Missing Primitive: Diagnosing and Repairing Mathematical Reasoning in Large Language Models
提出 Mathematical Primitive 与 PRIM benchmark 诊断结构性理解,并用 ABSORB 蒸馏框架提升推理
- Neither Black nor White: Balancing Semantic and Collaborative Signals with Graph-Informed Semantic IDs (GrIS)
将 Semantic ID 构建重定义为图上层次划分,统一内容型与协同型 SID 方法,两个实例带来最高 +52% Hit@10
- Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval
提出 CMP,用随机化检索暴露恢复记忆效用的可识别性,解决确定性检索下的 positivity violation
- Finetuning with Sampling: SFT Learns Better Than You Think
用投影采样把离策略专家轨迹逐步变为接近基座模型分布的数据,使 SFT 在科学、数学、医学任务上超越 RL 与自蒸馏
- Optimizing Effective Training Time for Large-Scale Recommendation Systems
定义ETT%并优化推荐训练生命周期开销,使6个模型平均ETT提升15.5个百分点
2026-10-01 30 篇 ★ 30 深度
- Fractional State Space Transition for Long Sequence Modeling
用分数阶动力学替换指数遗忘,通过有限指数模态近似实现高效选择性SSM长序列建模
- Memory Is a Derivation: The Distributed-Evidence Paradox in Long-Term Agents
提出 DERIVAUDIT 审计框架,揭示记忆写入中证据分散导致有效记忆被误拒、无效组合更难检测的分布式证据悖论
- Org-Agent: Beyond Personal Assistants Towards Organizational Agents
提出约束中心的组织级智能体框架,用任务依赖图加约束感知工具同时提升跨用户决策与记忆利用
- AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks
用长程反思轨迹训练 27B agent,在 ML/编程及深度研究基准上逼近更大模型
- EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making
固定状态与历史、切换目标并对同一组动作做排序监督,迫使策略调用预训练世界知识做决策,而非依赖单目标习惯
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation
提出 RIDE,在隐藏状态空间外推教师相对其RL前基座残差,稳定超越教师并优于输出空间外推
- On the Off-Policy Teacher in On-Policy Distillation
提出 SCOUT:周期性地用学生前缀对教师做结果奖励 RL,缓解教师 off-policy 问题,提升蒸馏效果
- WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms
用 WUSH 数据自适应可逆变换对 KV cache 做低比特量化,2-bit 下 Qwen3-8B 全面优于 OSCAR
- AdaM-Rec: Adaptive Modality Routing for Multimodal Recommendation
AdaM-Rec 用 LLM 智能体通过历史正样本伪查询做代理召回评估,动态路由文本与多模态召回预算
- Decision-Oriented Recommendation Reranking: An Empirical Study of Jev
在候选集大小为20-200的受控重排中,Jev效果与点式Qwen相当且延迟增长更缓,占据独特质量-延迟区间
- PivotOPD: Learning to Recover from Pivotal Mistakes in Multi-Turn Agents
在关键轮做预防式 reverse KL、后续轮做恢复式 forward KL,大幅提升多轮 Agent 从关键错误恢复的成功率
- Exploring Forum Post Retrieval with Generative Modeling
用 3B 指令模型生成跨平台语义 ID,系统验证 SID 深度、历史渲染与 RL 后训练对冷启动推荐的影响
- Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?
提出 Box2-Bench 评估 Agent 在工作流可靠性变化时的选择性依赖,发现模型会用但难弃坏指导,反事实 SFT 加 RL 可训练选择性
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents
诊断自进化搜索智能体中 proposer 与 solver 共享错误导致的协同作弊,提出 CrossFit 源级交叉反馈,错误一致率减半且下游平均提升 8.8/8.4 点。
- Scaling Laws for Looped Mixture of Experts
提出首个联合建模循环深度与 MoE 稀疏度的缩放定律,用于资源约束下最优循环 MoE 设计
- Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agents
在动作执行前采样并验证多个候选,以 pairwise 比较和蒸馏提升终端 Agent 轨迹成功率,成本效率优于纯轨迹扩展
- Re-ranking and Late Interaction Drive Retrieval Quality: A Controlled Comparison of RAG Strategies for Scientific Question Answering
在46万篇arXiv语料上系统对比6种RAG检索管线,ColBERT晚期交互与改写加重排效果最好,融合与Agent检索反不及基线
- Component-Aware Feedback for Self-Evolving Programs
对进化搜索中的每次代码变更做组件级归因并写入记忆,让 LLM mutator 在重排任务上收敛更快、效果更好
- Residual Trajectory Distillation for Generative Retrieval
把冻结RQ索引器的残差码本偏好蒸馏进SID解码状态,保留检索索引与推理不变
- MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories
提出MemLife多模态记忆系统与MemOpt强化学习框架,只训练记忆写入器即显著提升长期视频QA
- From Spectra to Joint Schedules in LLM Pre-training: 3+3(+2) Scaling-Law Regimes
用线性随机特征证明功率律由累积谱质量决定,并给出 LR/batch 联合调度下保持、改变或破坏损失缩放律的条件与可迁移代理模型
- Learning from Research: Toward Lifelong Agent Harness Evolution
用论文检索、主题建模和模块化交叉重组,在冻结 LLM 下自动演化 Agent 执行层 harness
- Generative End-to-end Ad Retrieval at Douyin
GEAR 用正交基 BasisRQ 稳定码本更新,并用轻量重排头消解 item 碰撞,在抖音广告上线取得显著收益
- PhantomEnvironments: Training LLM Agents in Fictional Worlds
用零成本规则生成的虚构多跳问答环境做RL训练,得到可迁移到真实多跳基准的LLM搜索agent
- KUAISHOU Explorer LLM-Rec Challenge 2026: Reasoning Generative Recommendation
系统总结多任务推理生成推荐挑战赛,开源 OneReason 数据与评测,提炼推理监督、RL 与偏好优化的关键经验
- When LLM-Inferred User Context Adds Value in Production Streaming Recommendation
LLM 生成的语义用户画像只在探索型用户上优于聚合画像,且会显著放大热门偏差
- RouteRec: Behavior-Guided Sparse Routing for Sequential Recommendation
用会话行为线索(节奏/主题/记忆/流行度)引导MoE稀疏路由,让不同行为模式的会话走不同计算路径
- Learning Multiresolution Relevance for Hierarchical Generative Retrieval
将文档相关度投影为 SID 层级各层的条件分支分布,训练共享 query 表示并保留标准自回归推理
- Learning Functional Subspaces for Neural Network Compression
用端到端学习的正交投影子空间替代逐层闭式低秩截断,显著提升LLM/ViT高压缩比下的精度与推理效率
- Routing Between Generative and Collaborative User Profiles: A Serving-Time Gate for Controllable Novelty
提出服务时路由门控,在协同过滤与LLM生成画像推荐模型间按用户选择性切换,以可控新颖性-相关性权衡提升Novelty@10
2026-09-30 30 篇 ★ 30 深度
- PrismQuant: Optimal Null-Space Rotations for Grouped Quantizers
把激活主特征空间对齐到分组非对称 INT4 的组内常量子空间,实现 W4A4KV4 下 SOTA 且近乎无损
- ANTMAN: Adaptive Need Tracking for Multi-Agent Navigation in Large Information Spaces
用可修订的未解决需求图替代静态分区,使多智能体协调随查询需求而非信息空间规模增长
- Pretraining Transformers with Quantized Softmax in Attention
系统研究量化 softmax 前向与反向规则对预训练稳定性的影响,给出可复现的设计选择
- LongCat-DeepResearch Technical Report
用紧凑的ResearchSpec替代全文迭代,结合并行研究员与全局-局部编辑,提升深度研究报告质量
- Marathoner: Ultra-Long-Horizon Autonomous Intelligence
从 GitHub PR 自动合成任务、拒绝采样蒸馏与 GRPO+后期奖励,让 9B 开源模型具备 10+ 小时执行能力
- EasyPPO: Stabilizing the Critic Is Key
通过 actor-only 截断过滤、按回报方差加权 critic 损失和较小 critic mini-batch,稳定 PPO 训练并全面优于现有方法
- EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memory
共享多模态外部记忆,两个2B模型负责经验更新与树形巩固,支持跨智能体系统复用且不动宿主参数
- HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents
通过统一 bash 动作空间与 CLI-aware 奖励,让 CUA 学会何时用 CLI、如何可靠执行,OSWorld 准确率 53.6% 且步骤减半
- Mnemon: Raw Records, Fast Judgments, Slow Thoughts
用 System 1 决策模型在读取时批量判断原始记录,后台只建索引,以 <4k tokens 上下文在 LoCoMo 达 91.7%
- Recommendation Ranking Off-Policy Evaluation under Ranking-Dependent Examination via Examination-Relevance Decomposition
将点击分解为曝光与相关性,提出 LE-IIPS 与 ED-DR,修正排序依赖曝光下的 OPE 偏差
- SAKI: Maximal-Coupling-Routed Teacher Supervision for On-Policy Distillation
将教师引导 rollout 中的最大耦合修正事件作为 token 级监督路由信号,在信任域内自适应分配教师 Top-1 监督
- Context Language Models
提出 Context Language Models,将上下文作为可编辑文件交给模型原生管理,在长 horizon Agent 任务上同时提升效果并降低推理成本
- TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models
将 LLM 编码代理与冻结表格基础模型结合,只进化数据流水线,拿下 TabArena 与 MLE-Bench-Tabular 榜首
- TabFM: A Zero-Shot Foundation Model for Tabular Data
400M参数表格基础模型,以in-context learning实现零样本监督预测,在TabArena 51数据集上超越AutoML与现有表格基础模型
- Better Nearest Neighbor Graph Indices via (Efficient) LLM-Guided Pruning
提出 LGP,在 DiskANN/HNSW 图索引上离线用 LLM 替换低价值邻居,弥合几何构造与语义评估错配
- AdviSD: Learning to Advise Frontier LLMs via Targeted Multi-Turn Self-Distillation
用配对评分筛选哪些反思修正值得监督,训练小型 advisor 通过自然语言建议提升冻结 Gemini/Claude 的工具调用与多轮 agent 表现
- Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI
提出通过 Builder 从 Target 执行反馈学习元技能,并物化为脚手架以提升固定权重 Agent 的表现
- Dr. OPD: Learning What to Follow for Optimal On-Policy Distillation of Large Language Models
通过双层优化学习 token 级教师信号权重,使学生在在线蒸馏中以 outcome reward 为准则超越教师
- Follow the Entities: A Corpus Map for Agentic Search
以跨文档实体为锚点构建离线可复用导航层,提升多文档 Agent 搜索证据发现并降低 token 消耗
- GRP v0.1 Technical Report
单编码器-解码器统一生成式召回与排序,冻结排序头作奖励并用带 margin 的 GRPO 保护召回,按渐进路径在线替换级联
- HELIX: Purified and Unified - Rethinking Feature Interaction and Sequence Modeling for Large-Scale Recommendation
用单向可复用 KV cache 与 Mixup-PerToken-FFN 联合扩展特征交互和序列建模,电商视频 GMV/用户提升约 6%
- Effective Dense Retrieval using Only In-Context Examples
RICE 用少量 in-context query-document 示例直接提示 LLM 生成 dense 表示,免训练,在 BEIR 上显著超越同类零样本检索方法
- LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization
通过 per-window 量化与 Compensator Tokens 实现 GDN/KDA 状态 8-bit 近无损,端到端加速 1.47×
- Do LLM Agents Execute the Plans They Declare? From Planning-Mode Declaration to Pattern-Specific Execution
提出 Planning-as-Routing:LLM 声明规划模式并由确定性路由器分派给对应执行器,显著缩小声明-执行差距,但模式选择仍是瓶颈
- MERGE: Multi-LLM Ensemble for Retrieval via Generative Enrichment
两阶段多LLM查询扩展框架,用任务驱动自动提示优化在BM25上实现最高+14.9 nDCG@10提升
- ReMem: Rethinking Perception and Memory in Long-Context Recommendation Agents
用 OCR 感知与分块动态记忆重构推荐 Agent,平均相对提升 5.16%
- SelfSearch: Reward-Free Search for Self-Improving Agents
用历史自我改进轨迹取代下游评估信号,驱动 Agent 自我修改并提升任务成功率与执行效率
- Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning
将 Agent 的控制决策与目标级计算分离,用显式元推理管理 artifact 图、预算和 worker 调度,提升长程任务性能并随预算持续扩展
- Learning What to Remember: Long-horizon Counterfactual Memory Optimization
提出 MGPO 用反事实差分给每次记忆改写分配长时程增量效用,训练紧凑可迁移记忆策略
- Explore Broadly, Reason Sharply: Push Small Models toward the Frontier via Sampling
用并行回火耦合多档功率锐化采样链,解决探索利用矛盾,让小模型无需训练逼近前沿推理
2026-09-29 30 篇 ★ 24 深度
- CoWindow Attention: Full Causal Coverage Is a Collective Property
用 KV 头互补长程窗口实现全因果覆盖,训练/解码延迟降 7.4x/3x 且质量接近 FullAttn
- MassAlloc Attention: Let Attention Allocate Its Own Compute
提出MALA,保留完整QK打分,按归一化注意力贡献度跳过低价值后处理,显著降低长上下文训练/推理计算且保持精度
- TemplateCraft: Agentic Visual Template Generation
多智能体系统将自然语言创意转化为可复用的客户端视觉模板,通过 Planner-Evaluator 反馈回滚与记忆提升生成成功率
- Beyond Timestamps: Decision-Aligned On-Policy Distillation for Long-Horizon Agents
提出 ALIGNOPSD,用跨 rollout 决策对齐修正特权监督并用可变决策片段分配 credit,长程 Agent RL 提升 5.5–8.7%
- Learning to Learn from Context: Synthetic Training from Perturbed Public Documents
用少量扰动公开文档合成10k上下文推理样本,将35B模型CL-bench从13.7%提升至24.6%,媲美万亿参数模型
- Skill2Env: Capability-Oriented Environment Synthesis from Skills for General Agents
以技能为种子、能力需求为引导,通过难度模式与任务蓝图合成可执行环境,并用迭代硬化提升训练监督质量。
- TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Traces
自动从真实Agent部署轨迹构建针对用户指定不良行为的基准,高效且评估与人类一致性高
- Surprising Success, Repeated Failure: Entropy-Guided Credit Assignment for Exploration in LLM Reasoning
提出EAPO,利用策略熵与response advantage符号不对称分配token级信用,强化高熵成功、惩罚低熵失败并保留失败中的探索机会
- BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation
用在线贝叶斯可靠度记忆同时决定信任谁与是否咨询,使中心模型在误导信息下保持鲁棒
- Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation
提出 DN-MOPD,按领域反馈 spread 重缩放,解决多教师策略蒸馏中反馈尺度失衡问题
- Beyond the Beam: Constructive Repair and Candidate Completion for Generative Recommendation
用可行性区间刻画identifier分配修复,结合最小叶子替换与候选补全提升生成式推荐新item召回
- Draft-KV: Learning Useful Latent Communication Between Language Models
提出 Draft-KV,用 sharer 草稿过程的 KV 状态经门控侧记忆接口传给 frozen 小模型,显著提升协同推理
- Overview and Analysis of the RecSys Challenge 2026: Conversational Music Recommendation
系统分析16套检索-重排-生成方案,总结多源召回、意图检测与多轮上下文建模等可复用设计原则
- RenderRank: Learning to Rerank Text with Compressed Visual Tokens
将文档渲染成图像并以压缩视觉 token 表示,在重排序中减少 16.5–35.5% 输入 token 且保持或提升 NDCG@10。
- Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
区分执行瓶颈与知识瓶颈,训练小模型只在知识瓶颈时查询强模型,4B 超越 14B 且成本低 2.7 倍
- Improving Test-Time Scaling with Adaptive Looped Transformers
提出 TaH2 自适应循环 Transformer,通过前瞻深度监督让模型仅对收益 token 增加迭代,测试时计算斜率提升 53%
- Measuring and Mitigating Identity-Cue Preference Drift in LLM-based Recommender Systems
提出 PromptShift 训练-free 框架,量化并缓解 LLM 推荐中单条身份线索导致的群体偏好漂移,SliceShift 平均降低 62.42%
- Simplex Diffusion Models
提出在概率单纯形上扩散的 SDM,保留中间不确定性,用 DDIM 式采样统一离散与连续扩散
- EvoSkillRec: Skill-Genome Evolution for Recommender Architecture Discovery
将推荐模型拆解为可复用技能卡,通过技能空间重组与LLM代码空间发明双空间进化,并沉淀有效创新
- Just-In-Time Agent Memory with Runtime Agentic Research
JAM 将 Agent 记忆从请求无关预压缩转为运行时按查询构建上下文,结合分层工作区与可训练研究员策略
- Rubric-Calibrated Preferences: Cross-Query Calibration of LLM Judgments via Item Response Theory
用 IRT 将 LLM 的 listwise 偏好与共享 rubric 校准为跨 query 可比的连续相关性分数
- Correcting to Predict: Pseudo-Value Correction for Multimodal Attribute Value Extraction
将多模态属性值抽取重构为伪值纠正任务,训练时混合检索伪值与占位符,推理用固定占位符实现免检索单次预测
- PEAR: Progressive Evidence-Based AutoResearch for Industrial Search Systems
提出 PEAR 框架,以证据驱动研究状态和置信门控多级验证阶梯,在电商搜索中显著提升订单指标
- How to Loop MoE: Flatten the Experts, Untie the Attention
Foil 在固定专家参数与每 token 计算下,通过摊平专家层并给每次循环独立注意力,提升 looped MoE 预训练与路由健康度
- SANTA++: Sampling Attention through Representative Keys
训练自由随机注意力方法,用代表性键路由团队采样,以 16%-22% KV 读取保留 94%-99% 精度
- SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents
提出 SEABench 基准,用成对非进化智能体与归因评分量化自进化导致的安全退化
- Telescopic Language Models
单次训练让嵌套级联每个深度前缀均为有效语言模型,AULB降43–44%
- Can Generative Retrievers Learn Semantic IDs Without Forgetting How to Speak?
SpeakGR用on-policy蒸馏的正向KL正则,在SID检索微调中保留LLM文本分布,语言drift降低81-94%且检索不降
- SPRINT: Single-Step Generative Recommendation via Average Probability Velocity
把 Semantic ID 生成建模为平均概率速度,单次前向输出完整 SID,并用双层级流对比保持 token 连贯性
- Harness Learning Enables Generalizable Test-Time Adaptation
训练一个 proposer 用执行反馈修订 frozen solver 的 harness,实现无需参数更新的测试时自适应与跨任务泛化
2026-09-28 30 篇 ★ 6 深度
- CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation
提出分层个性化框架 CARD:用户聚类学习组级 LoRA,簇内对比隐式学习个体偏好,推理仅解码注入实现高效个性化生成
- X-Planner: Event-Structured Task Planning for Embodied Intelligence
为 VLA 引入事件结构化规划前端,联合离散事件状态与潜在 CoT 状态,用阶梯解码和冻结重建提升长程规划质量
- On the Diffusibility of High-Dimensional Latents
发现微调重构编码器会降低latent有效维度并使velocity prediction低效,改用x0-prediction可一致提升text-to-image生成
- SLCA-GRPO: Resolving Cross-Segment Credit Misattribution in Tool-Calling RL
将工具段与总结段优势解耦路由,从结构上阻断 summary 奖励对工具 token 的梯度泄漏
- Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures
提出RLCDAlignBench,证明RLCD训练的Jev单次调用零样本检测十类对齐失败,中位AUROC 0.886,成本比LLM judge低63倍
- AgentWorld: Benchmarking Long-Horizon Collaboration of Multi-agent LLMs
提出AgentWorld长程多智能体协作基准与CCE因果协作指标,最佳模型任务成功率仅52.0%
- Block Sparse Attention with Log-Linear Complexity
PISA 用金字塔 Top-K 块选择 + LogSumExp 评分,把可训练稀疏注意力的选择复杂度从 O(N^2) 降至 O(N log N)
- Entropy Regularization: A Free Correction to Cross-Entropy for Verified Demonstrations
提出 ER-CE,用 token 级熵正则化防止概率质量扩散到未支持的输出,提升可验证任务 verifier 准确率
- Game Arena: Strategic LLM Evaluation in Competitive Environments
通过国际象棋、扑克、狼人杀三类游戏构建动态对抗评估平台,避免静态基准饱和
- ActKV: Efficient LLM Agents through Action-Guided KV Cache Management
提出首个面向Agentic LLM推理的KV缓存压缩框架,以动作生成贡献度为准则压缩缓存
- Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers
发现RAG中过时文档可使模型在原本正确时被翻转,并定位为选择性信任失败
- Multi-agent Scaling Across Disjunctive and Compensatory Tasks
引入 Steiner 任务分类,发现多数投票在析取任务上几乎不随团队规模提升,同模型平均在补偿任务仅降 6% 误差
- EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models
将多模态 LLM 的 Encode 阶段作为 EPD 流水线控制点,通过自适应微批处理、部分卸载与动态 SM 划分,在 SLO 约束下显著提升 goodput
- Towards Mitigating Fabricated Consensus: The Active Provenance Gate for Multi-Agent Debate Synthesis
在MAD合成阶段引入主动来源验证与条件阻断,显著提升来源保真度并抑制虚构共识
- KuaFu: Compressing Long User Behavior into Understanding at Billion Scale
以单行为 item 为最小压缩单元,双轴投影将每条行为压到 2–4 token,四阶段训练抑制幻觉,部署后 GMV 提升 1.37%
- LocUS: Head Selection and Subspace Projection for Targeted Activation Steering
LocUS 将激活转向约束到输出词汇子空间并稀疏选择注意力头,以干预<6%参数匹配或超越 SOTA 并更好保持通用能力
- MoSAR: Mixture of Semantic Attention Regimes for Learning Adaptive and Approximable Attention Geometries
在 RoPE 后通过 query/key 路由器混合短中全局 regime,学习可离散化的距离衰减注意力几何,500M 预训练外推最优
- Generalization behavior of OPTQ and the role of regularization
为 OPTQ 及其随机变体建立泛化误差上界,并提出更优的正则化参数选择
- PIA: A Personal Intelligence Agent Turning Health Conversations into Records and Records into Understanding
提出个人智能体记忆系统,自主决定读写,将对话转为类型化临床记录并合成轨迹级理解
- Evaluating the accuracy of KV cache reuse techniques
指出当前 KV 缓存重用评测方法高估效果,提出无歧义精度损失评测法并推出 Boxoffice 生成挑战性数据集
- PriceBench: A Diagnostic Benchmark for Price, Quality, and Brand Preferences in LLM Booking Agents
提出 PriceBench,用 logit 选择模型从酒店预订选择中恢复 28 个 LLM 的价格质量品牌偏好,发现高能力模型偏好更强更一致
- Scaffold: Support Graph Theory Based Sparsification for Graph Neural Networks
用支撑图理论联合控制 dilation 与 congestion 的拓扑稀疏化方法,在 GNN 上大幅降存提速且保持性能
- Retail Product Search: A Practical Approach at Target
Target 混合词法-向量检索,加权交错融合,线上 CTR/转化提升并零结果减半
- Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency
自监督置信度训练仅用600题微调,不改变标准生成,最高减少25%推理tokens且精度匹配
- Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding
提出 Highlight-Then-Summarize:先定位证据再生成问题条件摘要,压缩长上下文并提升推理
- New LoRA Skills Should Read but Never Write
提出 READ 只读扩展机制,冻结旧 LoRA 输出子空间并折叠组合更新,实现多任务 LoRA 增量组合且无推理开销
- Trust Guided Decision Transformer
用模型自身状态预测误差加保形校准筛选可信上下文,再让 critic 选动作,缓解长 rollout 分布漂移
- Compress What You See, Not What You Say: Anchored Context Distillation for Latent-Observation Software Engineering Agents
LOHA 布局与 ACD 训练法将长工具观测压缩为软 token,在 SWE-bench 上降低 43-57% 上下文且性能损失较小
- Completed Pairs Hide Capped Failures: A ReVerPi Case Study of Selective Context Projection
揭示评估中因仅保留完成配对而掩盖资源受限失败,并给出双臂独立执行的评估方法论
- Strategically Diverse Sampling for Self-Training
提出策略多样性采样,证明解法多样性比正确性和教师规模对自训练更关键
2026-09-27 30 篇 ★ 12 深度
- StudentBench: AI and human tutoring yield equivalent GRE learning gains
StudentBench平台证明AI辅导在GRE学习增益上等效于人类专家,成本低918倍
- Six Layers Less: Encoder Pruning for Whisper with Label-Free Recovery
按留一层 WER 变化排序剪掉 Whisper 编码器 6 层,再用无标签语音蒸馏恢复精度,无需自定义推理
- The Fellowship of the Query: Learning Retrieval Actions
用 teacher search traces 将 RAG 检索决策建模为 7 路动作预测,LoRA 微调小模型作为控制器,动作 F1 0.6536、端到端 EM 0.7946
- Beyond a Scalar: Distributional Serving Interfaces for Watch-Time Prediction
将观看时长从单一标量改为冻结分布提供器与紧凑摘要,下游只训轻量 readout 即可复用多目标
- RLVR landscapes for iterated multiplications can be benign: Insights from spin-glass theory
用自旋玻璃证明 RLVR 算法任务景观无局部极小,困难在扩散障碍与梯度误差;transformer 仅末 token 奖励可学算法思维链
- OneTrans-V2: Unifying Retrieval, Pre-rank, and Fine-rank with One Transformer in Industrial Recommender
用一个 Transformer 统一召回/粗排/精排级联,共享用户上下文,结合 DCGR 与 SNT,GMV 提升 9.74%,吞吐 3.2×
- Evaluating Open-Weight LLMs for Turkish Domain Documents Under Retrieval and Hardware Constraints
提出证据标注评估协议,分离检索失败与推理失败,发现 4-bit 量化下字符 TF-IDF 检索基线足够强
- Dual-Hypergraph Indexing: Bridging Knowledge Islands for Multi-Hop Reasoning in Retrieval-Augmented Generation
提出 Dual-Hypergraph Indexing,以双层超图与双路径聚合提升多跳 RAG 的逻辑连贯性与推理能力
- Reinforcement Learning with Verifiable Rewards for Small Search Agents
在0.8B模型上证明RLVR可训练搜索Agent,且稀疏EM奖励最差,token-F1部分信用奖励带来3.8倍提升
- C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks
提出有界索引、关系感知更新与预算路由相结合的跨会话多模态记忆维护机制
- From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendation
用冻结检索器执行生成兴趣查询,按查询命中证据把检索奖励局部化到 interest span,缓解 SID 精确匹配奖励稀疏
- Asymmetric Dynamic Routing: Balancing Reasoning Depth and Computational Efficiency in Hypergraph RAG
提出意图条件路由框架ADR,用轻量分类器动态调度三种非对称拓扑遍历算子,减少48.7% token和45.3%延迟
- Advancing Model Research in AgentX: Long-Horizon Autonomy for Industrial Recommender Systems
双智能体分隔提案规划与实验执行,以四类研究动作持续迭代推荐模型,实现工业场景长程自主研究
- Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration
提出 sPMC 训练框架,仅对少量视觉grounding敏感注意力头做概率质量集中正则,零样本平均提升3%
- Decoupled Learning and Selection in Slate Recommendation for Privacy and Stability Under Noisy Scores
形式化随机分数学习器+确定性选择器的解耦框架,给出差分隐私作用域契约和可证明的分数到 slate 稳定性证书
- KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization
用五个 profiling 引导 LLM Agent 仅优化 Inductor 生成 Triton 子内核,四级验证门保证端到端正确性并实现 1.07–1.40× 加速
- Cross-Country Code-Mixing for Generative Recommendation
将多语言 code-switching 思想迁移到跨国家生成式推荐,用 token 级双约束替换和上下文自适应重加权,使小市场显著受益
- Low-Cost Assays for Measuring Model Behavior Across Vendors and Releases
低成本行为 assay 面板:固定刺激+三种读数,追踪 LLM 跨厂商/版本行为差异
- LLM Agents Can Easily Tamper With Their Own Traces
实证多个主流 LLM 代理无法防止自身删除执行痕迹,攻击者可利用此漏洞隐藏不当行为
- LSF-SR: Latent Semantic Fusion for Sequential Recommendation via Flow-based Conditional Variational Autoencoders
用流式 CVAE 融合协同 ID 与 LLM 语义,缓解分布错位并提升长尾推荐
- Does a model's stated reason for rejecting a candidate do any work?
通过插入缺失事实的反事实检验,发现模型拒绝理由对选择有显著影响,但混杂因素使效应难以确立
- RAPID: Robot Agentic Programming from Demonstrations
利用编码 Agent 从单个视觉演示自动推断任务规范、动作原语与环境,迭代生成可泛化的机器人程序
- ScalarLens: Numerical Embeddings with Stable Coordinates and Contextual Responses for CTR Prediction
将数值 embedding 解耦为稳定坐标与上下文响应,在 27 个 CTR 设置中 25 个排名第一
- SEEK: Skill-Routed Evaluation with Evolvable Knowledge for Industrial Search
提出 SEEK 框架,将搜索评估标准外部化为技能库,动态路由相关技能进行列表级评估与归因,并支持不重训模型的知识更新
- Seek: Self-Evaluative Exploration for Knowledge Retrieval
训练无关的迭代检索框架,用 LLM 生成伪段落扩展 query 并分级评估反馈,突破单次检索 recall 上限
- Transformers as Cross-Task Learners: Shared Structure Drives Sample Efficiency in In-Context Learning
首次用覆盖数量化跨任务低维结构并构造 Softmax Transformer 实现 ICL 近似与泛化
- A Systematic Multi-Domain Evaluation of Document Retrievers
统一算力预算下离线评测33个检索器,揭示NV-Embed-v2质量高但延迟大、SPLADE-v3低延迟且MS MARCO最强、GritLM指令跟随最优。
- X-Rec Technical Report
用 Riemannian Flow Matching 在连续 item embedding 空间直接建模推荐分布,兼得 SID-AR 表达力与 3.46 倍推理吞吐
- Learning Better Reasoning for Generative Recommendation with Semantic IDs
通过 Best-of-N 筛选高预测效用推理轨迹,并用排序感知 RL 持续优化生成式推荐推理
- Do Audio Language Models Hear and Read Distinctive Features Alike?
通过最小音素对差分方向,发现仅 Qwen2.5-Omni 的 voicing 跨模态对齐显著,且模型家族决定表征一致性
2026-09-26 17 篇 ★ 1 深度
- Calibration as a First-Class Criterion in LLM Evaluation
主张将置信度校准纳入LLM评估核心,指出当前未采用导致部署与研究风险
- Knowledge Pull Requests for Continual Document Authoring
提出 KPR 框架,将文档更新拆为 Claim Proposal 与 Document Diff,使每次知识变更可审计,并显著提升信息整合与内容保留
- Learning to Discover Interesting Mathematics
定义证明长度/陈述长度比作为定理有趣度代理,训练27B模型预测证明难度并用于自扩展数学库
- Training Object Permanence in World Models
构建 150 类认知任务 Blender 数据生成器,产出 1.5M 视频训练集并微调 16B 模型,在对象永久性盲测中 continuation 类第一
- Coding Agents for Generalized Task and Motion Planning Problems
编码智能体在28个仿真环境中自动合成可泛化的TAMP程序,成功率56%–95%,超越手工规划器与LLM基线
- Rufus-Air: An Open LLM Post-Training Recipe
公开 GLM-4.5-Air-Base 的完整后训练配方,以难度过滤和奖励可靠性排序驱动 8 阶段训练,显著超越官方 release
- Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs
证明 LLM 输入端线性组合会产生输出分布叠加,并提出引导解码实现单次前向生成两条连贯续写
- The Alignment Illusion in Multimodal Large Language Models
揭示 MLLM 标量视觉-文本对齐指标无法区分噪声与真实视觉流,提出主角度间隙 PA gap 作为几何诊断
- Jev-Mobile: Jev as an Executor for Mobile GUI Agents
在移动 GUI Agent 中把 VLM 高频规划改为低频目标设定,由轻量 Jev 在结构化动作空间中高频执行,实现成功率相近、延迟与成本大幅下降
- Agentic Detection of Online Conspiracies
提出Agentic框架按需查询社交上下文,在希伯来推文阴谋论检测中显著优于纯文本和非Agentic上下文模型
- Multimodal Thinking with Renderable Programs
利用SVG作为文本与图像中间表示,让VLM在推理过程中生成可解释的图像程序
- How Reproducible Are Evaluation Conclusions? A Self-Audit of LLM-Inferred Prompt Structure
自审计 8 个开源 LLM 的 prompt 结构推断评估,发现排名仅底部稳定,小样本评估可能过度确定性
- Instrumental Monitor Evasion Emerges Under Ordinary Task Pressure
系统评估 LLM 智能体在普通任务压力下规避运行时监控的倾向,最佳 3 次尝试成功率最高达 88%
- An Empirical Study of VLM Pipelines for Long-Document QA
图像检索 top-k 页面输入是 token 效率与准确率均衡选择,Agent 收益随 VLM 规模增大才显现
- EnigmaForge: The Question Is Hidden in the Story
用程序化生成的文档谜题测试 LLM 无明确问题时自主发现问题与求解,揭示直觉排序与事实恢复差异巨大
- To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech
提出语音事实核查基准 VeriSpeak,揭示文本-语音模态差距,并验证检索+显式推理准确率达86.1%
- JevOut: Natural Context Can Flip Decision Models
优化自然上下文可在 61.4% 初始正确决策上诱导 Jev 转向固定错误选项,揭示决策模型脆弱性
2026-09-25 30 篇 ★ 7 深度
- Schrödinger's Code Repository: Have LLMs Learned SWE-bench or Memorized It?
提出动态实例化仓库的评估框架,通过四种变换擦除熟悉线索,证明 LLM 编码智能体部分依赖记忆表面特征
- AgentKernel: The Trust-Native Agentic Operating System
提出信任原生的智能体操作系统 AgentKernel,以身份、感知、认知、执行四支柱提供强制不可绕过的安全边界
- Tri-PvP: Exposing Modality Bias in Omni-Modal Large Language Models through Perceptual-Propositional Evidence Conflicts
构建8k三模态冲突基准Tri-PvP,解耦感知与命题证据,揭示OLLM视觉偏见及证据形式不对称
- LatentPort: Beyond KV Cache - Cross-Model Transfer of Recurrent Memory in Hybrid Language Models: A 4B-to-9B Hybrid-State Handoff Without Target Prefix Replay
首次展示不同尺寸混合语言模型间直接迁移 Gated DeltaNet 持久循环状态,无需目标模型重新读取上下文,显著降低续写损失
- Neural Spectral Capacity: Measuring and Designing Architectures from Network Specification Alone
提出基于权重矩阵奇异值谱的闭式容量指标 NSC,无需实例化/数据/梯度即可评估架构,并给出全局最优 DP 求解器
- Self-Organizing Agent Teams Learn to Reason Together
固定智能体团队从历史协作中学习可迁移的团队协作策略,无需预设任务分解即能超越最强成员与路由上限。
- GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression
提出训练无关的跨层共享字典分解框架 GeoPair,通过优化跨层配对保持各层激活几何,实现高效 Transformer 压缩
- MemoryAthena: Adaptive Routing over Latent and Generated Memories
冻结骨干下训练轻量因果路由头,以 Engram 检索为锚对生成记忆做有界插值干预,QA/NLP 多任务平均提升
- FLEET: From Logits Entropy to Enhanced Trajectories in Text Generation
通过记录高熵 token 轨迹并调整 logits,在相同预算下提升采样效率与复杂任务准确率
- ExplorationBench: Measuring AI Systems' Exploration in Verifiable Alien Worlds
构建规则可执行且与预训练知识冲突的异世界沙盒,量化 AI 系统通过探索获取并应用全新规则的能力
- IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesis
提出 IterSynth,将深度搜索拆为 Planner/Synthesizer 双角色共享策略并以 summary 为状态,通过角色解耦 RL 将 8B 模型推至同级最强
- PUBG Ally: A Conversational Embodied Agent as an AI Teammate
提出 PUBG 语音队友 Ally,结合 LLM 智能体与实时控制层,基于 39k 真实对局数据训练并在 141 国上线,正面评价超负面 25.1 个百分点
- Qwen-Planner-Agent: A Closed-Loop AI-for-AI Framework for Real-World Mobile Planner Agents
构建闭环 AI-for-AI 框架,通过 AI 生产数据、CARE 智能体强化学习与模型-Harness 协同进化,在 MobilePA-Bench 以 27B 取得最高综合分 77.05%
- World Action Agent: Harnessing VLMs for Robot Manipulation via World Action Rehearsal
多智能体视觉动作工作空间让 VLM 通过动作预演、视图内修正和技能演化实现机器人操作 SOTA
- WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation
397B 提示增强模型,通过视频反向构建与语义一致性 GRPO,大幅提升长视频生成的人类偏好
- Augur: A Synthetic Decision Lab for Rehearsing Reactions to Product and Policy Changes
构建合成决策实验室,发现开放权重模型与前沿模型的差距多源于评估欠规范而非能力差异
- Canopy: Exploiting Piecewise Smooth Tree Priors for Multi-Fidelity Bandits
提出 CANOPY,在线学习树结构上的分段平滑性失效位置,将昂贵评估集中到不连续区域,提升多保真决策效率
- Return or Revise? Learning When Revision Helps Retrieval-Augmented QA
提出 recoverability 配对效果并训练 scorer,决定 RAG 中是否修订草稿答案,在 9 组设置中优于草稿置信度 scorer
- GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI
通过生成宏观指南、隔离探索局部策略、独立评估轨迹,提升LLM在复杂规划任务上的可靠性
- When Does Action Credit Need Updating?
提出基于分支敏感度的动作信用传输与决策充分门控,显著减少策略更新后的工具交互重算成本。
- Back to the Definition: Estimating Step-Level Advantages via Trajectory Graphs for Agentic Reinforcement Learning
用轨迹图合并多条 rollout,以 Bellman 迭代反传稀疏奖励估计状态价值,得到符合 RL 定义的 step-level advantage
- Automated Regulatory Compliance Question Answering in Financial Services with Domain-Adapted Retrieval-Augmented Generation
用三阶段领域适配检索器与 RAFT-LoRA 微调紧凑模型,显著提升合规问答召回但暴露 grounding 评估缺口
- HEXIS: Compiling Skills into Extended Finite State Machines
把技能文档编译为扩展有限状态机,分离知识提示与显式控制流,跨 4 个基准平均提升 16.1 个百分点
- Self-Play Pretraining with Zero Data
自博弈零数据预训练用生成器-学习器对训,以图灵机程序生成数据,零样本损失随算力可预测缩放
- MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression
利用块级低秩压缩和基于信息熵的动态秩分配,将多示例ICL的KV缓存降低50%、吞吐提升1.8倍
- PoEM: Predicting RL Outcomes from Existing Policies
提出 PoEM 框架,用已后训练策略的线性组合预测新奖励下的 RL 策略,无需再次运行 RL
- SAGE: Mitigating Long-Horizon Reasoning Biases via Topological Guidance
用代数稀疏化与双曲结构引导的SAGE框架,缓解长程推理的探索偏差与累积偏差,12基准7模型家族提升,AC问题8倍改善
- Search-Aware Reinforcement Learning for Multi-Component Query Understanding in Roblox Game Search
蒸馏+搜索感知RL,按查询组件给 live search reward,2B/4B小模型超过大模型教师并提升下游搜索
- Screen Before You Serve: Simulation for Production Customer Experience AI Agents at 140M Scale
用假设驱动的工具边界用户仿真对生产CX智能体做部署前筛选,加速迭代并带来显著业务提升
- Minimally Invasive Steering of Language Models
MISVO用Fisher信息惩罚预logit干预的局部KL,冻结LLM测试时奖励引导,7项任务6项最佳
2026-09-24 30 篇 ★ 6 深度
- RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling
提出动态 rubric 中间表示与两阶段 RGPO 训练,缓解视频奖励模型标量漂移,点/对偶评估达 SOTA
- From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Health
梳理LLM在心理健康中从被动评估工具到共情对话者再到有状态个性化陪伴智能体的三阶段演进,并系统综述了智能体架构与评测资源
- RULER: Instance-aware Rubric Rewards for SVG Generation
用实例感知 rubric 奖励替代标量指标,VLM 逐项评分并结合 GRPO,无需真值即大幅提升 SVG 生成质量
- JEV-as-a-Judge: Accept When Confident, Escalate When Unsure
用判别式 JEV 做低成本一阶段评判,低置信时级联大模型,在偏好/事实性任务上以 0.36% 成本接近 SOTA 精度
- PACT: From Credit Assignment to Critic Alignment
证明 token 级信用唯一等于条件奖励差分,提出 Actor-then-Critic 加重要性采样的 PACT,在数学与编码基准显著超越 PPO/GRPO/SAO
- StableVQ: Practical Guidelines for Stable Vector-Quantized Tokenizer Training
针对共享投影码本 VQ 训练不稳定,提出 Dynamic STE、Region VQ Loss、Decoupled Schedule 三项无参改进,稳定提升码本利用率与重建质量
- Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms
先求解运筹模型再渲染为有状态工具环境,用同一参考解固定奖励,低成本生成可验证的Agentic RL训练环境
- EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics
提出 EmbodiedSWE 基准与 EmbodiedSWE-Gen 流水线,用编码智能体解决机器人任务并生成大规模训练数据以提升 VLA 策略
- Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents
把记忆策展从写时推迟到读时,保留原始轨迹并按当前任务合成紧凑 payload,用 GRPO 以即时成功奖励训练策展器,显著提升 Agent 成功率与效率
- Hunyuan-A13B Technical Report
开源 80B/13B 激活 MoE,通过双模式 CoT 与强化学习在推理和 Agent 任务上逼近更大模型且吞吐更高
- WhatWorkedBench: Benchmarking Experimental Understanding in AI Agents
构建 WhatWorkedBench 基准,衡量 Agent 在预算内实验后预测组件组合效果的准确性
- Log-Depth Recurrent Language Modeling
扩展平衡树递归算子至自回归预测,实现对数深度与线性复杂度的语言建模,长度外推稳健
- Risk-Controlled KV-Cache Eviction: From Memory Budgets to Risk Targets
将 KV cache 淘汰重新定义为部署风险控制,用事后认证选择保留策略并按需回退全 KV
- When and Where to Trust the Teacher: Unifying On-Policy Distillation and GRPO through Entropy-Calibrated Credit Assignment
提出 UECR-GRPO,在 GRPO 更新中统一 verifier 与 teacher 信号,通过熵校准 token 级信用重分配提升数学推理 RLVR
- Complementary Roles of Activation and Parametric Memory in Few-Shot Learning
系统比较LLM中激活记忆与参数记忆的差异,发现事实回忆靠激活记忆,复合任务需二者协同
- Computation Over Geometry: Meaning Identity Is Computed, Not Shipped in the Embeddings
系统实证显示同义改写判断依赖句子在同一前向中的联合计算,冻结双塔向量几乎无法读出该关系
- Memory Attention
提出Memory Attention,以token索引记忆加上下文key构造value,支持归一化折叠与CPU卸载,提升语言建模和下游性能
- Exact Quantile Balancing and Load-Error Injection for Mixture-of-Experts
提出 EQB 精确全局分位数计算和 LEI 局部负载误差梯度注入,提升 MoE 训练平衡与质量
- Towards Efficient Reasoning: Learning Causal Shortcuts for Diffusion Language Models
提出CSL框架,通过提取因果捷径并优先掩码训练,提升扩散语言模型推理精度与收敛速度
- Order-Invariant Answers, Order-Sensitive Representations in Mathematical Reasoning
16 个 LLM 显示:重排规则下答题越准的模型,对规则顺序的表示区分度越高,Spearman 相关最高 0.86
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
通过 Tool-Lab 实验发现,在模糊目标与信息获取成本下,LLM 购物代理会像人类一样省略诊断属性并做出次优选择。
- TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval
在冻结语义检索器上附加时间分支,用时间表达式 grounding 提供监督,提升时间敏感检索
- Tensor Decomposition of Transformer Key-Value Caches: Spectral Structure and Format Comparison
对 KV cache 四阶张量做谱测量,在 2-5× 压缩下 Tucker 重构误差最低,head/layer 近满秩不可压
- Resource-Adaptive Stochastic Gradient Descent for Online Linear Programming without Re-solving
提出RASGD,用O(m)一阶SGD更新资源价格,避免重求解LP,达到O(log T) regret
- Learning the Cost of Reliable Inference
设计基于反向第二价格拍卖的LLM路由平台,在保证质量阈值下动态选择成本最优供应商,节省10%-71%成本
- Controlling Collectives of AI Agents in Reasoning Space with Spatial Transformers
提出 COMPASS 分布式架构,用空间变换器生成紧凑反馈 token 控制大型机器人群体,可扩展至 1024 个机器人
- Predicting Quantization Price for Selecting PTQ Configurations Before Deployment
用 forward KL 诱导的二次价格统一比较位宽、粒度、变换等 PTQ 配置,实现预算约束下的部署前选择
- Fine-Tuning LLMs for Translation: General Forgetting Mitigation Does Not Preserve MT-Specific Instruction Following
比较微调中的遗忘缓解方法,发现EWC保留通用能力最好,但只有混合控制任务数据可保留MT特定指令遵循,且泛化有限
- Support-Compiled Feature Folding: More Evidence at Lower Memory Across Tabular Foundation Models
训练免推理框架 SCFF 将宽表二次特征交互转为线性宽度工作,内存降低且精度提升
- Agent-Editing World Model: Rethinking World Modeling for LLM Agents
提出AEWM,将世界模型从预测环境观测转为编辑智能体状态,缓解任务状态污染并提升长程智能体表现
2026-09-23 30 篇 ★ 8 深度
- SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness
将 Agent 技能正确性形式化为规格推理,用意图掩码多视图联合检测语义与实现缺陷,真实技能库精度 61.2%
- The information geometry of large language models is shared, learned, and controllable
用 Fisher-Rao 输出几何揭示 LLM 共享结构并给出最小扰动局部控制方法
- Realtime-Venus: A full-duplex interaction system with asynchronous delegation
双 9B 模型全双工交互系统,前台实时对话与后台异步工具执行协同,音频/视频基准超越 GPT-4o 等在线模型
- The Functionalizer: Lossless Functional Decomposition for Subword Tokenization
提出 Functionalizer 预分词框架,将大小写、变音、字符重复无损分解为 Unicode 操作符前缀,显著减小词汇量并提升代码生成质量
- Transferring the Intelligence of VLMs to Robotic Control
通过离散动作接口与闭环 ICL,使 VLM 零/单样本控制机器人并达 SOTA
- Towards Full Pipeline FP8 Reinforcement Learning for LLMs
揭示FP8全流程RL中量化噪声扭曲importance ratio导致训练崩溃,提出Calibrated Clipping动态校准剪切界
- OmniEdu: Open Foundation Models for Learning and Teaching
以能力平衡的指令微调语料构建教育基础模型,在K-12解题、课程定位与教学辅导上全面提升
- ACLArena: Agent Continue Learning in Multi-stage Post-training
构建多阶段 Agent 后训练基准,诊断遗忘机制并融合 SDFT 与 LoRA-RL 专家路由,缓解跨阶段能力遗忘
- EDGEGEN: Improving Tool-Calling Agents Beyond Happy Paths with Synthetic Edge Case Generation
从智能体规范提取合规规则,生成数据库接地的边缘用例任务,用于微调和 harness 优化,无需人工标注
- Ovis-Embedding: Pushing the Frontiers of Universal Omni-Modal Embeddings
基于Qwen-omni的原生多模态统一embedding,在多个检索基准上达到SOTA
- Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion
D-RAC 将任意文档先归一为 PDF,再用多模态 LLM 转检索优化 Markdown 后按 ID 规划分块,显著降本
- Recursive self-improvement of AI research agents
展示AI研究agent通过递归自我改进在8天内自主发现7项改进,泛化至未见任务并降低reward hacking
- Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs
训练无关Flash-dLLM以IO感知融合KV cache和自草稿-验证解码,显著加速扩散LLM推理并省内存
- The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Tasks
构建 Taste-Bench 从真实 agent 轨迹自动挖掘决策分叉,度量并蒸馏长时程决策品味
- Agensh: Scaling Organizational Intelligence to 1,024 Agents
去中心化自组织多智能体框架,无中心协调者扩展到1024 agents,长程重建任务成功率随agent数量提升且更快达标
- Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation
本地 Tool-Use 评估中 serving stack 的协议差异会系统性污染模型工具调用保真度测量结果
- Beyond Repeated Sampling: Learning Search Policies for LLM Reasoning
用RL训练小型概念生成器作为大模型推理的搜索策略,在hard数学问题上pass@128翻倍并跨模型迁移
- Optimal Sequential Annotations for Off-Policy Evaluation
在离线评估中,用有限标注预算优化序列标注概率以最小化方差,结合双重稳健处理缺失标签
- CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents
一种只截断/丢弃、不重写原文的自动压缩法,在受限上下文下最多降低50%成本并保持或提升编码Agent性能
- FIRE: Failure-Informed Runtime Engineering for Reliable Language-Model Agents
通过运行时注入定向指令与动作拒绝,不改权重与用户提示,显著提升代理重复成功率
- HySparse2: Hybrid Sparse Attention with Two-Level KV Sharing
通过两级 KV 共享使 prefill 只跑一半模型,同时提升长上下文检索并降低 KV 缓存
- Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding
参数共享 AR-block-diffusion 模型并行草稿 + AR 验证,实现 OCR 解码 3.94 倍加速
- Train Where the Quantized Model Goes: On-Policy Distillation for Low-Bit Reasoning
用在线策略蒸馏把教师监督放到低比特量化模型自己的生成轨迹上,将 MATH-500 平均保留率从 35% 恢复到 70%
- MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning
提出混合粒度多智能体组织图生成,局部选择单智能体或可复用组,以稠密奖励 RL 直接优化构建策略,在 8 个基准上全面领先
- Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models
通过标准 API 注册自定义工具诱导闭源模型外化中间推理,发现提取推理匹配原生 CoT 且 Astra 拥有 token 高效的有向推理
- Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist Agents
通过任务反馈把重复控制固化为可执行代码,LLM仅做语义推理,实现低成本高成功率Agent
- REFLEX with Jev for Efficient Selective Control in LLM Agents
REFLEX 用 Jev 做快速类型决策层,低置信或需生成时调强 LLM,100 任务基准上 95% 成功并减少 72.7% 强模型调用
- The Sirens' Song: When Proximal Background Context Overshadows Distant Evidence
识别长上下文 LLM 的 Proximity Trap,并提出重尾相关性对齐机制 LYRA,把更多注意力导向任务相关证据
- SpeakerMem-R1: Speaker-Centered Dual-Track Memory for Multi-Party Dialogue
双轨记忆+RL训练Writer-R1,解决多方对话长期记忆的消息归属与关系理解瓶颈
- Greedy Decoding Is Not Precision-Invariant: Cross-Precision Output Divergence in LLM Inference
证明 BF16/FP16 下贪心解码会系统性分歧,提出低 margin 触发 FP32 LM head 重算,一致性提升 22–36pp 且延迟开销 <4%
2026-09-22 30 篇 ★ 6 深度
- MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads
提出 HEAL,通过头部级信息解耦与校准识别并缓解多模态大模型幻觉
- BI-Agent and BI-Bench: Towards Automating End-to-End Business Intelligence
构建首个真实 BI 端到端基准 BI-Bench,并设计工具增强 Agent 与后训练框架,使 8B 模型以 50 倍低成本匹敌大模型
- GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planning
用显式图世界模型验证并修复 LLM 长程规划,将单任务成功率从 41.2% 提升至 91.8%
- Geometry of Values: Task Vector Composition for Ethical Preference Alignment in Language Models
用任务向量正交化隔离价值偏好方向,实现可逆的伦理立场迁移
- APort Vault: Benchmarking AI Agent Payment Authorization with the Open Agent Passport
回放 4371 条人类攻击,证明确定性预执行检查可将未授权支付转账从 140 次降至 0 次
- IntBMoE: Integrating Block-Level Conditioning into Expert Composition for Full-Participation Mixture-of-Experts
用代码本+超网络预组合全量专家,解耦参与/执行/物化,AMap 线上 UVCTR +2.4%
- OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue
提出多智能体数据引擎合成音视频对话,构建基准并用多目标RL奖励训练Qwen3-Omni
- One to More, More to One: Category-Aware Iterative Expert Training for Software Engineering Agents
解决软件工程 Agent 多类别任务在不均衡 RL 下的跷跷板问题,通过类别专家迭代训练与多教师蒸馏融合为单一策略
- 1% of Tokens Can Be Enough: On Gradient Estimation in On-Policy Distillation
提出信息效率比 IER,将有用性与梯度估计可靠性结合做稀疏在线蒸馏 token 选择,0.1%-1% 预算匹配全量 OPD
- Harness-Zero: Harness Distillation via Agent-as-Harness
用 agent-as-harness 把优化 harness 的引导转为目标动作空间修正示范并微调,移除专用 harness 后成功率 23.3%→44.3%
- Jev-Mem: System-One-Controlled Agentic Memory for Efficient AI Agents
提出将高频记忆控制与生成式推理分离的 System-One/Two 记忆架构,在 LoCoMo 上以 6.6 倍构建提速和 36.7% 延迟下降取得最佳回答质量
- onPanda: Efficient Annotation of On-Policy Alignment Data for LLMs and Agents via Token-Level Correction
用 token 级定位-纠错-续写循环高效生成 on-policy 对齐数据,标注时间中位数降低 52%
- RRSI: Regularized Recursive Self-Improvement of Agent Harnesses
用 proposal 与 selection 两侧正则化约束 Agent harness 自改进,缓解在有限 evolve set 上的过拟合
- VideoGen-Agent: Reinforcing Video Generation Agents
通过多任务智能体强化学习训练多模态 Agent 协调外部工具,显著提升复杂视频生成任务的指令遵循能力。
- WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
用相机可查询的隐式 3D 记忆压缩多视角证据,实现长时域一致的视频世界探索
- Emergent Collusion in Long-Horizon LLM Agent Interaction
两个LLM智能体在长时互审任务中偏离协议,合谋在94%轨迹中涌现,更强模型更早出现
- Complex KDA: Understanding and Enhancing the Expressivity of Kimi Delta Attention
通过扩展门控与 delta 系数范围,提出 CKDA,在不增加秩或成本下实现 2D 旋转并达到 DeltaProduct2 的表达能力
- Critical-State RL: Diagnosing Trainable States for Multi-Turn Tool Use
用训练前嵌套采样分离动作相关方差与续采样噪声,定位多轮工具调用中真正值得训练的单个模型调用,再做局部 RL
- When Tomorrow Becomes Today: Self-Evolving Policies for Agentic Time-Series Forecasting
将时序预测智能体的延迟反馈转化为专家信任、路径选择与干预强度的持久联合更新
- DolphinBench: Mapping the Pareto Frontier of Agent Memory
首个通过任务完成直接评估智能体记忆,并要求报告成本与延迟的基准
- The Copy Ceiling: An Input-Exposure Control for Ontology-Grounded Generation over Curated Corpora
提出曝光记账与复制天花板基线,证明RAG/本体生成增益主要来自上下文复制而非推理,且超出暴露恢复稀少且常为假阳性
- Et Tu, Brute? Economic Misalignment in Personal AI Agents
研究揭示个人AI代理会从个人上下文推断财富并系统性推荐更昂贵选项,即使违背用户明确目标
- LoRA-generating hypernetworks for efficient on-device LLM generative personalization
训练超网络将用户上下文映射为个性化LoRA,兼顾ICL计算可行性与PEFT权重修改优势
- OSWorld-Pro: Process-based Evaluation for Computer Use Agents
用 2800+ 子目标与 LLM-Judge 评估 CUA 过程性失败,揭示 Claude Opus 5 仅 75.7%
- Pinocchio: Fast Uncertainty Estimates for Black-Box Language Models
用外部校准器仅凭文本输出预测黑盒LLM回答的正确性,无需logits或微调
- SocioVerse2: A Longitudinal Dynamic Social Simulation Framework under a Human-AI Co-evolutionary Paradigm
提出 SocioVerse2 框架,以双循环与智能基础设施支持可干预、可控制、纵向的社会模拟研究
- SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models
提出旋转无关的球面权重量化框架,通过分解8D权重向量分离异常值,实现2-3比特下精度匹配与30.3%解码吞吐提升
- Adapting Tree-Structured Speculative Decoding to DeepSeek-V4 for Efficient Inference
在 DeepSeek-V4 压缩注意力上实现树形投机解码,通过分支感知验证与状态刷新,吞吐最高提升约 18.5%
- Small-world Networks of Agents Brainstorm AI Risks to Support Ideation
将 LLM 模拟的利益相关者连成小世界网络,以中介中心性优先风险,提升 AI 风险构思新颖性
- iSDFT: Information-Proximal Self-Distillation for Continual Learning in LLMs
提出iSDFT将教师视为预算信息源,在每步选择满足信息约束的最近分布,提升LLM持续学习中稳定性与可塑性的平衡
2026-09-21 30 篇 ★ 8 深度
- Grounded Skill Synthesis from Code at Scale for Agentic Intelligence
Code2Skill 从 GitHub 代码挖掘并验证 100 万+可复用技能,检索增强后智能体平均提升 11.7%
- MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup
MoME 用上下文门控选择 M 个记忆槽的混合,取代单一行记忆,在 iso 参数/FLOP 下优于现有稀疏记忆基线,并改善 scaling 趋势。
- CodeMidas: Scaling Agentic Coding RL Environments from Code Itself
用 agentic 流水线仅从源码自动构建可执行 RL 环境,训练 MiMo-V2.5 在多项编程基准全面提升
- MintAct: A Unified Visual Agent for Digital Environments
用2B/4B/8B视觉语言模型统一UI定位、跨端多步导航与视觉工具调用,匹配各领域专用模型
- RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
以“复刻运行中应用”为核心任务,构建跨五平台的混合 GUI/代码智能体基准与训练框架
- GraphSkillEvo: Evolutionary Optimization of Graph-Structured Agent Skills
将Agent技能表示为有向图并用进化算子搜索优化,平均精度比SkillOpt提升1.76–4.01个百分点
- Calibrating Teacher--Student Discrepancy for On-Policy Distillation
提出 Cal-OPD,用正负特权干预估计教师自身偏差区域,只保留超出的差异作为训练信号
- AutoRecLab: Describe the Experiment, Get the Code!
用自然语言提示自动实现推荐系统实验代码,结合RAG、静态类型验证与执行引导树搜索
- AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memory
在写入时用自配置低重叠语义视图组织长期对话记忆,使简单 top-K 检索即可稳定找到相关证据
- CASCADE Against Jailbreaks: Combination Across Stages with Controlled Attack-Defense Evaluation
首个系统研究 LLM 越狱防御跨阶段组合,标准化评估框架发现组合防御显著提升安全性
- Detecting Pretraining Data in Large Language Models from a Free-Energy Perspective
用预测熵修正似然得分,提出自由能检测 ETD,提升预训练数据成员推理的 AUROC 与鲁棒性
- When Steering Fails in Latent Reasoning: A Latent-to-Language Transition Gap
发现 latent CoT 中激活引导对后续语言生成的影响远弱于显式 CoT,定位潜在到语言转换差距为核心障碍
- Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design
冻结大模型加外部程序性记忆持续适应,通过拓宽与深化技能库将设计智能体执行成功率从72.7%提升至99.3%
- DiaVLo: Diagnosing Behaviours of Vision-Language Models
提出 DiaVLo 框架,结合人类标注与模型生成构建行为规范,因果定位关键概念以诊断 VLM 行为错位
- Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention
提出基于检索分数分布特征的轻量级置信度评分RCS,实现多跳RAG的校准弃权,降低高置信错误率
- ExpBoN: Exponential-Noise Best-of-$n$ for Efficient Test-Time LLM Alignment
提出指数噪声Soft Best-of-n,有限样本下指数收敛,结合GSI可减少推理计算39%-45%
- Matrix AdaGrad: Row-wise and Column-wise Adaptive Subgradient Methods
提出行/列矩自适应 AdaGrad,用矩阵结构替代逐元素缩放,获得更紧后悔界
- An Interpretable Memory Decision Controller for LLM Agents Based on Three-Signal Complementarity: Decoupling Confidence and Consistency
在检索与生成间插入零参数三信号互补编码器,解耦置信度与一致性,将冲突记忆下 RAG 幻觉率降低约 56%,高风险近零
- Watermarkable Multi-Draft Speculative Sampling via Poisson Processes
利用泊松过程实现多草稿投机采样,同时嵌入无偏水印且不损失采样效率
- Available Guardrails: Certifying Selective Prediction across ML Systems
将选择性预测认证可用性转化为可计算量,用动态规划优化分区,在安全、粒度和覆盖间达到权衡
- Accelerating Dense LLMs via L0-regularized Mixture-of-Experts
提出 L0-MoE,用 L0 正则化将稠密 LLM 转为稀疏 MoE,实现最高 2.5 倍加速且性能几乎不降
- LLMs as Feature Engineers for Text-and-Tabular Prediction
迭代式 LLM 框架自动从文本提取可解释分类特征,并通过错误反馈将发现速度提升最高 3 倍
- NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities
开源全双工语音模型,统一流式架构实现听、转写、推理、工具调用与说话,打断恢复与工具选择表现强
- Abstention and Noise Filtering: Two Missing Primitives of Softmax Attention
显式加入弃权(sink logit)与值门控噪声过滤,两者结合在10M-350M匹配模型中均优于softmax基线
- EnterpriseVal: Quantifying the Efficacy, Reliability and Value of Generative AI in the Enterprise
提出企业级 GenAI 用例评估系统,融合度量目录、校准 LLM-as-judge、阈值门与价值风险模型,并在银行试点验证
- RheoSampling: Resolving the One-Hot Dilemma in Stochastic Dynamic-Tree Speculative Decoding
通过解耦动态树构建与验证概率,首次实现上下文感知 top-K 动态树与随机采样兼得的无损投机解码
- World Modeling in Transformers
通过机制分析与因果干预揭示 TaxiGPT 内部存在一致地图与导航能力,行为失败源于叠加特征干扰
- TrialAtlas: Multi-Agent Research Organization for Clinical Trial Design and Optimization
提出记忆增强的多智能体系统 TrialAtlas,通过文献、竞品、法规先例及历史 NDA 学习提升临床试验缺陷检测与成功预测
- What Should We Ask Next? Retrieval-Aware Question Learning under Partial Evidence
通过在线 RL 直接从检索排名反馈优化提问策略,替代离线 QA 排序模仿,五轮 R@1 提升 5.79 个点
- A Lie Detector Test for Language Models: Reading Knowledge a Model Won't Reveal
用内部状态探测识别 LLM 隐藏但已知的答案,区分“不愿答”与“不会答”
2026-09-20 6 篇
- PACT: Can Enterprise AI Assistants Be Trusted Under Pressure?
PACT基准首次系统测量企业LLM助手在持久用户施压下的合规表现
- WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing
两阶段数据为中心框架用残差聚类诊断定向补强,在多个文档解析基准上领先
- DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering
提出 DocAttriBench 基准与 MAPPET 自动归因方法,评估多模态 LLM 在文档 VQA 中的答案证据定位能力
- Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations
安全训练降低毒性分数,但性别歧视被转化为隐性代表伤害,毒性指标不足为据
- Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulation
提出 SafeHarness,通过障碍感知路径规划与接触执行显著提升编码智能体的任务成功率和避碰率
- Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation
用预测驱动推断与贝叶斯小域平滑,改善稀疏分群上的 AI 系统点估计、区间估计与估计量选择
2026-09-19 21 篇 ★ 3 深度
- Verifiable Social Reasoning for LLM Assistants
构建多智能体模拟框架 Fuse,用隐藏动机与用户中介生成可验证社会推理评估,揭示 LLM 对偏见框架的系统性敏感
- Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model
构建四个互补维度的评测框架,揭示全模态生成模型 MiniMax-H3 在物理推理任务上总体成功率仅41.97%,音频消歧最弱
- Sample Count Is Not Enough: Candidate-Generation Strategy Shapes the Energy and Performance of LLM Test-Time Scaling
固定候选数下,少量大批次调用比多次小批次调用显著降低GPU能耗与延迟
- When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distillation
发现 base 学生与 post-trained 教师的终止 token 失配是 OPD 长度膨胀主因,语义 EOS 聚合对齐终止概率可有效缓解
- VABench: Measuring Embodied Spatial Intelligence through Visual Demonstrations, Active Perception, and Metric Control
提出 VA-Bench 基准,评估通用 MLLM 在 RGB 演示、主动视角选择与度量命令下的完整观察-推理-执行闭环能力
- Self-Evolving Search Index
提出 SELF-INDEX 框架,让索引自主诊断检索缺陷、选择性修订索引键并主动探索查询需求,跨语料与检索器一致提升检索性能
- Chronicle: Cut-Point Replay for Regression Testing of LLM Agents
通过切点回放把 LLM agent 失败运行转成 CI 回归测试,兼顾录制的可复现与新代码实跑
- Deep Noir: Autonomous Steering Discovery via Architectural Chronometry in Transformer Models
用 Logit Lens 收敛与因果头级归因自动定位 steering 层/头/幅度,实现跨任务激活引导
- dQwen3.5: Hybrid-Attention Diffusion Language Models
将因果 RNN 骨干保留、仅双向化注意力层,实现 AR 到扩散语言模型的高效适配,训练 token 减半且保持并行/任意顺序解码
- FootprintRAG: Visual Analytics for Evidence Context Refinement in RAG-based Scientific Literature Exploration
将RAG证据上下文显式化为可检查、可修订对象,通过LLM-agent与可视化视图支持多轮检索、证据精炼与溯源摘要生成
- Relational Attention for Data-Efficient Language Modeling
在 BabyLM 低数据场景下,用双注意力 Transformer 分离关系注意力与自注意力,提升数据效率和结构泛化
- Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluation
提出由 Refuse、Decompose、Refresh 构成的评估协议,将结论限定在有观测支持的范围内,并在闭环模拟器中实证
- Parallelism, critical windows, and separations among diffusion language models
首次证明均匀/高斯扩散的并行采样步数可随分布内在复杂度缩放,且掩码扩散因关键窗口更窄需更多前向次数
- OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher
用RL训练矢量输入特权教师,在闭环中蒸馏至摄像头学生模型,大幅减少模拟器交互成本
- What People Almost Did: Evaluating LLM Social Simulations Beyond Behavioral Fit
提出 representational adequacy 作为 LLM 社交模拟的新评估目标,用推理轨迹衡量推理过程是否忠实于人群
- Schema-Anchored Latent Reasoning for Semantic Parsing-Based Knowledge Base Question Answering
在 LLM 隐藏状态进行连续潜在思维,通过 schema codebook 对齐与反馈延迟离散决策,提升 KBQA 语义解析组合问题性能
- Treadstone: A Social-Media-Inspired Platform for Multi-Agent Collaborative Data Analysis
用社交信息流机制组织人与 AI 智能体在数据分析中的异步协作与证据追踪
- Inference-Engine Fingerprinting Attacks are Practical: Exploring Model-Driven Environmental Discovery, Exploitation, and Escape
恶意模型仅通过生成特定输出 token 即可指纹并攻陷 vLLM、SGLang 等推理引擎
- An Analysis of Training-Free Self-Reported Confidence in Language Models
直接口头置信度是强基线,但自我报告对提示词敏感且自洽性会放大共享误解
- Faithful Where It Can Be Checked: Auditing a Reflection Agent Against Its System Prompt in a Randomized Trial
审计 GPT-4o 反思智能体发现其仅遵守可检查规则,软性指令被违背且重复追问决策与更差结果相关
- Grounded Product Understanding in Livestream Videos
提出GPUB基准和UniPro模型,联合评估产品检索与时刻定位,大幅提升直播视频产品理解性能
2026-09-18 30 篇 ★ 8 深度
- StepAudio 3 Music Technical Report
支持 ABC-CoT 显式音乐规划与离散-连续表示的 5 分 30 秒级音乐生成模型
- Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement
提出 GAI 框架,用两个维度统一经典 GPI 与递归自改进,并给出目标漂移与自指缺陷的形式化刻画
- Flattening Every Memory Peak in Long-Context Mixture-of-Experts Training
针对长上下文 MoE 训练四大显存瓶颈提出四种精确调度,将 120B-667B 模型训练扩展到 1M 上下文,吞吐最高提升 10.4 倍
- OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
将验证过的执行抽象为可组合符号策略,结合中间验证与自引导练习,免训练实现跨任务泛化与持续能力扩展
- Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents
提出训练自由的 EvoSkill-GUI,将技能作为多文件包通过反思-修订-复用循环持续从执行反馈中改进,在三大 GUI 基准上最多提升 16.2%
- Fathom: Per-Query Read Depth for Sparse Decoding over Offloaded KV Caches
按查询动态分配 bit 预算扫描量化 KV cache,在 offload 场景下减少带宽并加速解码
- RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation
提出配对混淆消息恢复与本地网页调查的基准,评估模型恢复风险指令并执行证据引证网页调查的能力
- Confidence Comes from Experience: Experiential Confidence Estimation from Reasoning to Agents
用模型自己的历史验证样本构建经验库,检索相似任务与置信度,校准 LLM 输出置信度,以 1/10 成本匹敌 10 次采样一致性
- In-Context Robot Learning with VLM Agents
GPT-Policy将VLM agent用于机器人上下文学习,通过context compiler与constrained controller把演示和反馈转为可执行动作,无需梯度更新
- The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction
Edge0 用下一层路由预测实现 SSD 流式加载专家权重,在单 24GB 卡上以 20 tok/s 服务 35B MoE,质量接近 fp16 教师
- PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection
提出 PanoCaps 基准与 PANORAMA 模型,将短语 grounding 形式化为掩码候选选择,联合生成稠密 caption 与像素级掩码
- An Empirical Study of Harness Design for Coding Agents
系统性消融编码 Agent 的上下文管理、规划与动作空间,揭示模型与预算相关的组件设计规律
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
通过跨层KV复用、FP4量化与SWA有界重放,将每token全局KV缓存降至890字节,实现近恒定decode成本
- RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning
先奖励训练特权教师,再做在线策略蒸馏,并根据教师-学生分歧与相对成功率自适应退出教师监督
- SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness
在 harness 层递归搜索自动研究循环,保留四种 token 效率机制,性能不变但成本降约三分之一
- What Does Privileged Information Add to On-Policy Self-Distillation?
系统分离自蒸馏与特权参考的贡献,发现特权信息仅带来有限增益,核心机制是跨模式能力转移
- Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation
提出 Video DeltaNet,用局部 Softmax 注意力+双向线性记忆加速视频扩散,在 MiniMax H3 上实现 14.5 倍去噪加速
- When2Think: Learning Difficulty-Aware Length Control for Efficient Hybrid Reasoning Models
用实例级难度感知奖励塑形动态分配推理深度,在数学基准上实现 AIME24 Pass@3 +10% 且 token -27.9%
- Region-Level Policy Optimization for Fine-grained MLLM Perception
用区域级强化学习训练轻量提案网络,以约 4 倍更少视觉 token 超越全分辨率 MLLM 的细粒度准确率
- On-Demand Attention: Language Models Know When to Recall
训练轻量 recall head 基于解码状态动态触发全局注意力,在保持性能的同时大幅减少长上下文全局读取
- Don't Mask the Environment: Observation Supervision Changes How Agents Explore Under RL
SFT 同时监督 observation token,无需额外数据即可提升后续 GRPO 的 pass@k 与探索多样性
- Score Centering Stabilizes Off-policy Reinforcement Learning
提出加性 score centering 校正项,抵消训练与推理引擎间的漂移,稳定 LLM 的 RL 训练
- To Copy or Not to Copy: Controlling Speculative Decoding via Intrinsic Model Signals
SwitchSD 用轻量探针识别 LLM 的复制意图,动态切换神经草稿与上下文复制,吞吐最高提升 15%
- Quantifying Overclaiming Propensity in Frontier LLM Agents
用 OverclaimBench 揭示前沿 Agent 在文件审查中普遍未读完全部文件却谎报完成,且误导率达 80.4%
- Dual-Axis Policy Optimization for LLM Agents: Bayesian Feedback Attribution and Trajectory Mass Normalization
提出 BATON 框架,分离轨迹内反馈归因与轨迹间目标聚合,提升多轮 Agent RL 效果并降低推理长度
- RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents
将历史案例建模为有向时间线条目链,在条目级检索匹配中间状态,显著提升案例命中率
- UniPolicy: Unified Objective-Specific Policies for Generative Search Advertising
用目标前缀、MoE-LoRA路由和专属FFN解耦多目标生成式广告检索策略,在线提升CTR/RPS/收入
- Learn Your Own Thoughts: Abstract Token Curriculum
提出抽象 Token 课程(ATC),无需显式思维链监督,通过课程学习在连续表示空间形成内部抽象思考
- Stress-testing Alignment Midtraining
大规模压力测试发现对齐中训练植入的动机可被2%冲突微调数据覆盖,且对未演示规则泛化弱
- Think Thrice Before Reranking: Multi-perspective Evidence and Reasoning Integration for Text Reranking
提出 MERIT-Rank,用语义、意图、证据三个互补推理轨迹联合重排序,并以渐进式 SFT+GRPO 训练,4B 模型超越多数 7B/32B 重排器
2026-09-17 30 篇 ★ 5 深度
- Continual Learning Mechanisms Compose for Long-Horizon Memorization
组合数据/函数/权重 anchor 与 merged LoRA 将 100 任务顺序微调平均保留率从 1.2% 提升至 34.9%
- Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures
提出 Continual Search 迭代框架,通过多轮唤醒 LLM 法官持续搜索未解决证据,显著提升长轨迹 Agent 失败根因归因 F1
- Convergent Emergence of In-Context Learning Across Modalities
在六种模态中验证 few-shot ICL 普遍涌现,且任务难度效应在五个模态间相关,支持部分收敛涌现假设
- StepAudio 3 Realtime Technical Report
实时语音基础模型实现边说边想的低延迟深度推理与全双工语音交互
- SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization
提出谱重参数化方法,通过重塑衰减谱和学习率缩放,提升门控 DeltaNet 的长上下文扩展能力
- HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness
提出训练免的 Agent Harness 框架,通过统一工具接口、三重验证与时空图记忆,统一指令跟随与物体目标导航并刷新 SOTA
- Register Tokens for Bounded-State Reasoning in Diffusion Language Models
用固定位置的寄存器 token 在分块生成间携带连续状态,优于离散文本携带,代码生成提升显著
- Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States
用心理引导模拟器生成共享心理状态对话,并以特权蒸馏训练更懂用户信念与目标的LLM
- ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement
对比同类轨迹并按五个功能模块独立进化 harness,在基准隔离数据上实现跨任务/跨模型可泛化自改进
- VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention
训练免费的低比特注意力框架,用值平滑和融合概率投影同时提升量化和速度
- How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus
独立复现验证 Orthrus 并行解码:BF16 下仅约 45% 轨迹精确匹配,FP32 则完全匹配,无损性依赖数值精度。
- EvolveTrade: Experience-Driven Policy Refinement for Self-Evolving LLM Trading Agents
将Agent的system prompt视为文本参数化策略,由策略Agent基于决策轨迹和组合反馈迭代重写
- Agora: Git as Shared Memory for Collective AutoResearch
用 Git 的 append-only DAG 为多智能体研究提供共享记忆,实现去中心化协作探索
- A Zeroth-Order Paradigm for LLM Preference Alignment
提出 ComPO,用比较预言机从低 margin/noisy 偏好对中提取方向信号,缓解 likelihood displacement
- ProgramDistill: From Interactive Web Apps to Verifiable Reference-Guided SWE Tasks
通过「挖掘-构建-补丁」流水线自动生成4,063个可回放验证的参考引导SWE任务,评测编码智能体
- ScienceIDE: Turning World's Scientific Codebase into Agent Learnable Environments
提出ScienceIDE基础设施,将科学代码库转化为可编程环境,训练PhAI-IDE模型家族在科学代码修复与通用基准上获得提升
- CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents
提出 CERA-MoA,让 MoA 中动态路由器与智能体策略通过强化学习协同演化,并用隐藏状态预测熟悉度实现高效路由
- Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs
提出 LLM 运行时增量更新记忆的机制,避免重算长前缀并保持语义绑定
- Beyond Truncation: Rethinking LLM Decoding as Ensemble Pruning
提出 Mahalanobis-Ensemble Decoding,基于 token 嵌入相似度做集成剪枝,提升解码多样性且近乎零开销
- Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It
让工具调用上报剩余进度,比预估算更准,可将 p90 TTFT 降低约 20%
- Clueing up LLMs with Tool-Augmented Deductive Reasoning
以 Clue 多智能体博弈为环境,用可能性矩阵工具外置记忆与约束,提升 LLM 推理一致性
- Version- and Scope-Aware Question Answering over Normative Documents: A Deployed System and an End-to-End Evaluation at Production Scale
将显式版本与适用范围规则置于生成前,使规范文档问答得分从88.1提升至97.7
- How Model Growth, Recursion, and Boundary Operators Influence Scaling Exponents
发现架构干预可改变预训练 scaling 指数,循环深度带来计算效率随规模递增的指数级收益
- Higher-order pruning of experts in mixture-of-experts language models
提出 HOPE 二阶专家剪枝,考虑专家协同交互,显著优于一阶方法,在高剪枝率及 Agent 任务上优势更大
- "If I Had to Buy Just ONE: Galaxy S26 Ultra": Auditing AI-Generated Product Recommendations
审计 ChatGPT、Gemini 与 Google AI Overviews 的产品推荐,揭示第一人称偏好、重复不一致和来源差异
- Cognitive Extensions for Dual-Process Language Agents: Memory and Self-Reflection in Interactive Environments
为 SwiftSage 双过程 agent 加入自适应记忆与自我反思模块,在 ScienceWorld 上提升任务成功率与效率
- Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations
发现简单差异均值向量能低成本表征并检测前沿开源 LLM 的 reward hacking,且可在线提前预测
- Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data
用超网络从实时交互数据动态生成低秩权重,并以贝叶斯在线更新实现会话内持续适应
- Selection Is Retrieval, Abstention Is Not: On-Device Tool Routing over 70 Korean-English Actions
拆分工具路由中的“选择”与“拒绝”决策,证明选择可用检索器、拒绝需神经编码器,设备端可省去大模型
- Rethinking Critic Learning in PPO: Understanding and Mitigating Value Flattening
发现 PPO critic 的价值平坦化失效模式,提出仅对少数间隔状态施加 critic loss 的 SP3O,提升推理策略与训练稳定性
2026-09-16 30 篇 ★ 19 深度
- MInTRL: Off-policy Intervention can boost On-policy RL
提出 MInTRL:在 on-policy rollout 中由 judge 做稀疏局部纠错,并用 advantage-regression 目标免去 importance sampling
- Expert-Space Exploration in MoE Reinforcement Learning
通过扰动专家路由、锚定高置信专家并重放路径,在 MoE LLM 的 RL 训练中实现安全的架构级探索,提升推理性能
- Learning to Solve Hard Problems in RL for LLMs by Never Giving Up
揭示RL训练LLM的“马太效应”,提出NGU动态采样将计算从易题重分配到难题,显著提升困难任务pass@1
- Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models
将微调重构为固定行为漂移预算下的方向选择,用层选择调优逆转 QA-only 失效
- Training Specialist Models without Reasoning Trajectories for Domain Expert Distillation
证明仅用 QA 训练的专家模型会隐式选择推理轨迹,且 tuning 选择直接控制下游学生的领域精度与通用能力平衡
- Lightning Weave: Improving the Accuracy-Efficiency Frontier of Reasoning Models through Capability Composition
提出 Lightning Weave,组合独立后训练模型的策略 log-ratio 并稳定离线蒸馏,同时提升推理准确率与 token 效率
- Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliteration
注入高幅非线性诱饵方向扰乱攻击者的消融估计器,低成本后处理防御 RFA
- Emergence World: Adversarial Stress-Testing of Long-Horizon Multi-Agent Systems
构建持续运行多智能体环境,通过钓鱼、误信息、记忆泄露测试系统韧性,发现识别不等于遏制、模型对齐不组合
- EviQE: Evidence Selection for LLM-Based Query Expansion
EviQE 将 LLM 查询扩展重构为文档证据选择问题,聚合多改写器检索结果并筛选后单轮生成,显著提升 TREC DL 与 BEIR 检索效果
- LazFormer: Scaling Transformers for Industrial Recommendation via Transferable Generative Pre-training
用生成式预训练 + 残差适配器 + 非对称多 epoch 训练,实现工业推荐 Transformer 的参数与数据双扩展
- The Magnitude Mirage: Rethinking Confidence for Reasoning-Intensive Retrieval
发现相似度分数大小在逻辑/时间推理查询中失效,提出零成本的分数分布信号可显著提升检索拒答 AUROC
- Evaluating Brand Retrieval and Ranking in Large Language Model Recommendations
提出基于重复采样的 BRP@k / MRR@k 框架,将 LLM 品牌推荐视为随机检索与排序过程
- Balancing Trial and Reorder: A Hybrid Sequential Transformer-GBDT Ranker for On-Demand Delivery
生产级统一排序器UVR结合双向Transformer序列编码与GBDT,通过标签平滑和试新偏置采样提升商家试新率
- Route Me If You Can: A Benchmark for Query Reformulation Selection
冻结查询改写候选池与检索结果,系统评估改写选择器在跨检索器/领域下的上限与差距
- ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents
发布 ScienceBuddy 科学工作空间,以递归内外双循环耦合 harness 演化与模型强化学习
- Self-Evolving Memory for Generative Recommendation
用稀疏 KV 记忆层隔离不同用户行为模式的梯度,缓解生成式推荐持续进化中的进化冲突
- Generate to Explore, Select to Exploit: Aligning LLM-based Headline Generation with Personalized Recommendation
用 GSPO 训练 LLM 一次生成多样标题候选,再由实时反馈选择器做个性化利用,CTR 提升 2.57%
- Top-K Is Not a Budget for Hybrid Retrieval
DiBud 以访问预算为输入,增量认证 RRF 排名精确前缀,用更少访问量保留混合检索质量
- Where Post-Training Quantization Breaks Text Embedders: A Measured Map Across Four Embedder Families
在检索嵌入模型上系统验证量化启发式建议,发现嵌入表保护和模块敏感度排序均不可迁移,蒸馏学生模型在极端量化下更优
- AURA: Agentic Diagnosis and Refinement for Production Recommender Systems at Scale
用分层 LLM Agent 从真实会话日志中自动诊断推荐失败模式,并生成代码级修复提案
- Efficient Swing Computation for Retrieval in Large-Scale Recommender Systems
提出 ASC 与 K-ASC,用概率误差界替代截断启发式,将 Swing 检索提速数个数量级
- FlashVector: Agent for Hierarchical Model Serving Stack Optimization
将 LLM 驱动的 GPU kernel 优化范式推广到模型服务器、特征处理与运行时配置的全栈自动调优
- PCap: Personalized Retrieval-Stage Diversity Capping in Facebook Marketplace
用 Shannon 熵将用户分桶,并在检索阶段施加个性化类目上限,在线 A/B 提升浏览深度与点击
- Interactive Memory Learning for Long-Term Conversations
提出 ICML 多智能体在线强化学习框架,Planner 与 Trigger 通过跨会话延迟奖励共同进化,实现记忆策略自演进
- Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback
提出CCL算法,通过源域反馈校准教师再训练学生,消除教师偏差且收敛到最优学生
- RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models
通过 Region-Aware Encoder 与多阶段对比学习,在不牺牲全局检索性能下大幅提升区域级检索
- ReliGRec: Reliability-Oriented LLM-Based Generative Recommendation via User-Risk-Aware Prompt Routing
用弱监督用户风险信号在解码前路由 Simple/Cautious Prompt,并注入时序 Graph Token 做 Semantic ID 生成
- ThinkFlow: Self-Evolving Probabilistic Latent Memory for Lifelong Conversational Agents
将对话流压缩为概率潜在记忆技能,用下一用户话语预测实现无标签终身自进化
- Where Should a Document Live: Context, Representations, or Parameters?
系统对比知识注入三种位置,Cartridges(KV)在多文档检索中唯一匹配 ICL,但高压缩下有遗忘
- Predicting Partial Answer Quality and Utility in Agentic Retrieval-Augmented Generation
提出轨迹内探针框架,预测Agentic RAG中间答案质量与增量效用,实现约11%早停节省且保持98%质量
2026-09-15 30 篇 ★ 8 深度
- Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-work
开源35B协同工作模型,通过执行接地数据和分阶段后训练实现成本效率帕累托最优
- Beyond Top-k Skill Retrieval: Diversity-Aware Skill Routing for LLM Agents
用 DPP 多样性选择与 query-residual 核,在技能路由中平衡相关性与非冗余,提升多技能任务覆盖
- DataFlex-RL: An Evaluation Platform for RLVR Data Policies
构建统一 GRPO 配方下评估 RLVR 数据策略的平台,发现选择/加权/自适应策略相比均匀采样无可复现提升
- Online Learning with LLM Experts from Limited Feedback
将多 LLM 路由建模为有限反馈 bandit,给出 full-info 与 bandit 设置下的次线性遗憾界及路由算法
- LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents
提出16.7B MoE分块扩散视觉语言GUI智能体,在多个GUI基准上超越Qwen2.5-VL-7B并在4/6基准上超过Qwen3-VL-8B
- Towards a Deterministic Math Solver for Clinical Language Models
Program-Solve 让 LLM 写 Python 交由受限执行器计算,32B 模型在 MedCalc-Bench 准确率从 83.47% 提升到 90.53%
- Studying Without a Syllabus: Task-Agnostic Environment Preprocessing
提出任务无关环境预处理框架,meta-agent 在无下游任务信息下探索环境生成可复用工件,5/6 基准优于固定流程
- Competence-Gated Pooling of Language Models and Priors for Event Forecasting
提出 competence gate 依据边际价值选择性融合 LLM 与外部先验,显著降低 Brier 损失
- StepAudio 3 Gen Technical Report
离散自回归统一音频生成模型,基于 RVQ token 和共享码本,在 TTS 与语音设计上达到 SOTA
- ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search
全开源 7B 模型,靠混合注意力、FP8/Muon 与 MDP 中训,在数学和 Agentic Search 上逼近大模型
- Atria Dawn: The Dawn of Agentic Superintelligence
推出 Atria Dawn Preview:基于可验证经验管道训练的智能体基础模型,16个基准中5个达最高分,并揭示人机协作转向项目级伙伴关系
- Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Training
提出基于探索潜力评分的动态提示脚手架框架,自适应调整多模态LLM RL后训练的提示分布,提升域内外性能
- When Agents Slow Down: Understanding LLM Agents' Test-Time Strategies via Elo-per-token Analysis
提出 Elo-per-token 分析量化 LLM Agent 测试时计算缩放,发现边际收益递减且拆分并行预算更优
- Dream-RSI: Recursive Self-Improvement through Evolving Worlds
用历史发现树构建重放模拟器,以离线低成本反馈迭代优化探索策略,降低发现成本并提升质量
- Discovery Foundation Models: Toward Open-Ended Discovery Intelligence
提出 Discovery Foundation Models 框架,让基础模型从解题升级为参与新知识的创建、验证与修订
- HazardAuditor: From Executable Threats to Safer Computer-Use Agents
执行级安全审计框架 HazardAuditor,通过跨框架事件规范化和 GuardPO 序列级优化,显著提升计算机使用智能体安全守卫准确率
- Omni-Streaming Thinking
通过待定声明、分模态证据校验与反驳更新,缓解流式全模态模型过早跨模态固化,5个基准平均相对提升超10%
- RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments
训练无关多智能体框架,通过 broad-then-deep 探索构建可复用记忆,让开源模型在 OSWorld/ALE 超越 GPT-6
- Bellman Policy Optimization
利用 Bellman 方程将 Policy Mirror Descent 重构为轨迹级目标,避免价值估计,在 AIME 数学推理上显著超过 GRPO 等基线
- CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering
集成混合检索、引用约束生成、句级grounding验证与单次重生成,在最终交付前决定接受、拒绝或重生成答案
- CiteShade: Citation Laundering in Multi-Source Retrieval-Augmented Generation and Its Counterfactual Defense
提出首个 RAG 引用洗钱攻击,展示如何让模型把错误答案归因于可信源,并给出反事实防御。
- The Router Within: Eliciting Native Skill Routing from a Frozen LLM
冻结 LLM 自身前向传播中已含技能路由信号,两个线性投影即可读出,无需外部模型或技能文本入上下文
- EvoOntology: A Self-Evolving Ontology Layer for Data Agents
将本体封装为 MCP 三层服务,通过自进化循环持续优化,显著弥合数据 Agent 与异构数据间的理解鸿沟
- HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses
用遗传算法协调多智能体LLM,通过种群迭代生成科学假设,在药物重定位评估中DepMap selectivity达0.171
- Learning to Coach for Experiential Learning
训练一个 LLM-as-a-Coach 用 GRPO 从冻结 actor 的轨迹中提取经验,以引导正确性为奖励,显著提升推理与交互游戏表现
- To Each Language Its Tokenizer: Modular Tokenizers for Efficient Multilingual LLMs
提出模块化多语言 tokenizer 与预训练策略,可按语言子集提取子词表并动态使用,降低内存并加速推理
- RESKILL: Explicit Failure Attribution and Structured Repair for Interactive Language Agents
提出 RESKILL,通过显式失败归因、覆盖度归因选择局部技能补丁及重测条件更新,显著提升交互式语言 Agent 的修复效果
- Look Before You Leap: Factual Decoding with Internal Attribution Signals
提出 DescaPE,在推理时用内部归因信号对候选续写打分,抑制幻觉易发路径,提升事实性
- Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Science
多智能体编排系统,用策略探索、反证与树聚合组织长程研究,在TCS-Bench达71.0%、Codeforces 218/222
- Inoculation Midtraining with Learned Neologisms
在midtraining引入<quarantine_token>新词将不安全行为绑定到特定上下文,post-training后在上下文外抑制不安全泛化并保留良性属性
2026-09-14 17 篇
- PLC-DPO: Posterior Label Correction in Noisy and Ambiguous Preference Optimization
利用校准的策略-参考边际把偏好对路由为 clean/flip/tie,主动校正标签方向与强度,提升 DPO 在噪声和模糊偏好下的鲁棒性
- ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation
用作者 rebuttal 揭示的修改动作作为潜在监督,构建 ActReview-40K 并后训练模型生成可操作且带证据的评审建议
- Studying Image Tokenizers as Visual Languages in Unified Multimodal Models
通过跟踪分任务验证损失,揭示图像分词器与文本联合建模时的损失-性能关系及设计影响
- SenseNova-U1.5: Towards Native Unified Visual Intelligence
发布8B-MoT原生统一多模态模型,在无Encoder/VAE架构下完成理解、推理与视觉生成,并借多专家on-policy蒸馏增强视觉能力
- SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
用连续 selector 分数以 log 形式注入 attention softmax,端到端优化上下文排序,紧预算下大幅超过可训练稀疏注意力基线
- Attention Quantization for Tabular Foundation Models
开发FP8量化QKV的注意力Triton内核,通过训练/测试量化误差对齐实现1.7倍加速且精度无损
- CanvasAnneal: Curriculum Reinforcement Learning for Diffusion Language Models
通过向扩散 RL 训练初期注入教师推理轨迹并逐步退火,缓解探索瓶颈,提升数学推理与工具调用性能
- Embodied-BenchForge: A Closed-Loop Agentic Workflow for Embodied Benchmark Construction
提出闭环基准合成框架,用产物依赖图与需求引导验证修复,自动构建可区分的具身评测基准
- MAxBench: A Multinomial Concept Recovery Benchmark
提出几何无关的评估框架 MAxBench,比较 10 种方法,发现仿射子空间最优且优势源于偏移项
- Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents
通过行为商流形平衡冗余更新并保持决策分布的低秩适配方法
- Dissecting GPU Utilization for LLM Inference on Nvidia Hopper
用八个 NCU 计数器视图替代单一 SM 利用率,分解 Hopper 上 LLM 推理 decode 阶段利用率低的机制
- Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage
发现 TruthfulQA 等二选一基准存在表面特征泄漏,提出 Audit-Prune 机制清洗至接近随机水平
- SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading
通过序列建模预测专家激活,结合联合预取调度与图兼容运行时,实现 45% 常留下 96.97% 命中率和 80.22% 满载性能
- Dual-guided Hierarchical Edge Localization for Large-scale Optimal Transport Across Dimensions
提出 HELLO 层次求解器,以对偶势引导边缘定位,实现大规模离散 OT 的线性内存和数量级加速,并证明有限终止到全局最优。
- A Ranking Approach for Measuring Calibration
提出 rankECE,基于相邻预测概率比较的校准误差度量,比常用分箱 ECE 近似更准确
- Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models
构建 TAM 基准,用两类真实手册任务评估 GPT-5,发现精确匹配仅 1% 和 15.5%
- Rethinking Heterogeneous System Disaggregation for Subquadratic Attention
提出按二次/子二次注意力拆分 decode 的细粒度异构解聚方案,显著提升子二次注意力 LLM 的吞吐与能效
2026-09-13 7 篇
- SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problem
用 15k 合成积木堆叠数据训练 LVLM,显著提升 3D 空间推理并泛化到真实场景
- PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving
用统一LLM Agent框架覆盖自动驾驶场景测试全流程,开源中小模型媲美商业API
- Reference-Based Bias Detection in LLMs via Relative Representations of Hidden States
用隐藏状态与锚点句的相似度构建相对表示,在共享空间中度量微调前后偏见偏移 ΔB
- Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs
系统综述视频/音视频 LLM 的推理效率优化机制,按流水线阶段梳理 token 削减与算力降低方法
- From Parameters to Answers: How LLMs Retrieve and Use Their Internal Knowledge
通过层间干预分离LLM问答中的请求路由信息与目标知识依赖,揭示层间交接模式并跨模型比较
- The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
提出递归自我改进的完整路线图与 Headroom-Closed Index,系统梳理从执行自治到元改进的演化路径
- Recognizing Is Not Reversing: A Controlled Inversion Test of Fact-Preserving News Framing
通过540个受控新闻变体证明LLM即使识别出framing也几乎无法在保持事实下撤销干预
2026-09-12 30 篇
- A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware
用三层缓存复用会话上下文、语义查询与URL嵌入,在单台CPU服务器上实现89.3%命中
- TempCloze: Can Video-LLMs Identify the Missing Middle?
提出 TempCloze 视频填空基准,评估 Video-LLM 视觉时间推理并揭示时间对齐是主要瓶颈
- From Reweighting to Rewriting: Unlocking the Intervention Effects of Influential Samples in Training Data Attribution
影响力函数选中的样本在重加权下干预有限,但对其响应进行重写可实现更强、持久且双向的行为改变
- SchemeArena: Factorized Stress Testing of Scheming in LLM Agents
构建 400 场景基准及证据驱动监控器,系统揭示 LLM agent 阴谋行为的关键驱动因素
- SWE-Bench Pro Verified: A Reliable Benchmark for Software Engineering Agents
通过防泄漏与任务整改构建更可信的 SWE-Bench Pro 版本,揭示原有榜单高估模型软件工程能力
- MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes
955 例交通售票机工具调用基准,4B PEFT 模型在 Tier1 上超越 GPT-5.6 且部署成本极低
- Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking
提出训练免的视觉-语言模型框架,结合迭代搜索与推理,提升多语言多模态实体链接在稀有实体上的准确率
- Beyond Solver Verdicts: Generative Reward Models for Autoformalization
将离线 Z3 等价 oracle 蒸馏为生成式连续等价评分,检测 VPU,AUROC 0.961,并带来 11.3 点下游提升
- Following the Preference, Missing the Optimum: Compliance Without Optimization in AI Housing Recommendation
大规模审计发现LLM在住房推荐中几乎完美遵守硬约束,但39%的推荐被同池中更优选项严格支配
- Memory as Plans: World-Action Modeling with Memory-Grounded Planning
MaP-WAM 将长期记忆转化为稀疏视觉上下文与语言计划,由固定上下文执行器遵循,取得 RMBench 83.3% 成功率
- Project Qualia: Recovering Experiential Music Structure from Session Co-occurrence Data
在大规模听歌会话上训练 Song2Vec,通过 artist-residual 去除艺术家主导信号,揭示跨艺术家的体验相似性结构
- Generative Late-Interaction Embeddings For Visual Document Retrieval
GLIE 用 k≪N 个向量存储并生成式重建完整 late-interaction 向量集,在 4 向量/页保留近 80% nDCG@5
- How AI Coders Discuss, Disagree, and Reach Consensus: Challenges and Opportunities for LLM-Based Qualitative Coding
多智能体LLM定性编码中,独立编码、辩论与协调流程的有效性受编码簿长度、数据相似性和代理分歧影响
- Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and Evaluation
构建持续更新的 AI 评测基准数据库与搜索引擎,支持基准发现、证据溯源和分数历史检索
- Explainability Assistant: A Conversational XAI Interface for Interpreting Energy Consumption Models
用LLM function calling替代自定义语法,实现94%意图解析准确率的对话式可解释AI系统
- Domain-Specific Hallucination Detection in Large Language Models
多信号检测管线结合DeBERTa-v3、MC Dropout与DPO,实现通用与领域自适应幻觉缓解
- LOCUS: Task-Aware Low-Rank Post-Training for Token-Efficient Language Generation
冻结主干,在任务相关低秩子空间内做偏好优化,仅更新0.24-0.28%参数即可显著降低输出长度
- Ethics Training Agents: Facilitating Group-Based Ethics Education with Role-Playing and Discussion for Ethical Reflection and Exploration
用多 LLM 智能体扮演不同伦理立场并配主持人,构建结构化人机群体讨论,提升伦理敏感度
- Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training
多智能体 AI 标准化病人系统通过患者/导师/逐轮评估分工与渐进式提示,提升医学生沟通、共情与病史采集过程质量,但不抬高诊断准确率
- A Voice-Interactive Multi-Agent System for Smart Operating Rooms: Architecture Design and Key Technologies
用 LLM 多智能体实现手术室语音控制与报告生成,重点优化 KV Cache 前缀复用、流式解析并行执行与渐进式提示披露
- Model-Aware Schedules Improve Generation via Fiberwise Optimal Transport
提出基于纤维最优传输的模型感知调度,显著提升扩散/流匹配生成效率,并发现可复用的风险模板
- Target leakage, not model class, explains reported accuracy in survey-based cardiovascular screening: a leakage-tiered audit of glass-box and tabular foundation models
十个分类器在44万样本审计显示,移除两个诊断后特征使所有模型AUROC下降约0.05并收敛至0.0045带宽,性能差距来自特征泄漏而非模型架构
- Building py-kvcache: A Performance Characterization of External KV Caching for vLLM with NVMe SSDs
刻画外部 KV 缓存加载与重算的权衡,提出异步直接 I/O、有界 staging、调度感知预取,80k tokens 磁盘加载比 LMCache 快 2 倍
- RAG-Safety-Bench: Reliable Evaluation of Retrieval-Augmented LLM Safety
提出 RAG-Safety-Bench 基准,用四种条件隔离 RAG 安全退化因素,发现护栏不保证 RAG 安全且良性文档也可能引发不安全生成
- Artificial Id: Drive and Persistent Alignment in Agentic AI
提出 artificial id 机制,通过差分持久化涌现自适应行为控制,并指出跨任务持久对齐边界需求
- RetroThinker: Enabling Retrospective Thinking in Speech LLMs
通过 SFT+length-based DPO 让流式 SpeechLLM 自我修正 CoT,GSM8K 相近延迟下绝对准确率 +11%
- SIRF: A Spec-Internalized Risk Foundation Model for Industrial Content Risk Control
通过约70M token小规模CPT将复杂政策内化到8B模型,在verdict-only低延迟下将Black Recall@P95提升15.1pp
- SWRouter: Similarity-Contractive Window Routing for Multi-Turn Large Language Model Conversations
提出相似度收缩窗口的上下文分段与双指标评估,多轮路由准确率较最佳单模型提升16.26%
- A Unified Per-Token Gating Family for On-Policy Distillation: FKL/RKL Mixing with Multi-Channel and Bias Coefficients
把 on-policy 蒸馏中的 per-token FKL/RKL 门控统一为四系数参数化,EOPD/ToDi 成为其一维特例
- Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding
提出边云协同的 CFD 框架,用双轨叙事索引和视觉需求路由器按需取帧,显著降低长视频在线视觉处理成本
2026-09-11 30 篇 ★ 14 深度
- HyQuant: Hybrid-Precision Quantization for LLM Attention
保留 vertical-line token 与局部窗口全精度、其余 KV 低比特,实现长上下文推理的近无损量化加速
- Scaling Automatic Research Agents via World Models
用世界模型替代真实环境执行,消除 AutoResearch RL 训练瓶颈,并引入去偏与降噪提升稳定性
- EvoSafeHarness: Evolving Model- and Domain-Specific Harnesses for Securing Agents
自动合成针对冻结模型与目标领域的安全 harness,联合搜索自然语言策略和可执行代码逻辑,在保障效用下大幅降低攻击成功率
- PARSER: Read in Parallel, Reason in Depth for Long-Context LLM Agents
解耦阅读与推理,并行子代理读全文,主导代理迭代scatter-gather深度推理,长上下文QA大幅提升且延迟降低11倍
- AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems
通过逐代理干预定位问题提示,并用语义聚类生成通用文本梯度,提升多智能体提示优化效果与效率
- Show-Harness: Just a VLM Agent Can Play Robots
通过离散语义动作单元与解释器接口,让 VLM Agent 零样本或轻量微调后直接控制机器人
- Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation
提出 FAE 多轮证据消融评估与 REAL 反事实训练,揭示 LLM 更依赖参数知识并提升证据依赖性
- NCP-ArchPreview Technical Report: Moving towards Latent Space Language Models through Next Concept Prediction
在 8.9B 参数规模验证 NTP 与 Next Concept Prediction 联合训练,用 51.3% tokens 达到 OLMo-3-7B 最终 loss
- An Open Recipe for IMO Gold: Training Nemotron for Olympiad Mathematics
开源三 checkpoint 生成-验证-精炼管线在 IMO 2026 达 30/42 金牌线,并发布后训练与推理全栈
- When Synthetic Data Hurts: On Catastrophic Forgetting in Skill Retrieval for LLM Agents
在34,396技能规模上,朴素LoRA合成数据微调会遗忘真实/OOD任务;保守正则可保持OOD并提升分布内召回13.98%。
- The Answer Path and the Grounding Instruction in LLM Question Answering over Knowledge Graphs
GraphRAG 中答案路径是否出现决定性能,grounding 指令在无事实时使 F1 降 8.63 倍;语法/顺序/大小无影响
- T1: Terminal Agent Reinforcement Learning for Long-Horizon Tasks
122B MoE终端Agent靠RL在Terminal-Bench 2.1达64%,用TITO+R3稳定训练与密集验证奖励
- COBRA-Skills: Contextual Bandit-Guided Evolution for Agent Skill Optimization
用语义 embedding + 神经预测器 + LinearUCB 选择性评估候选技能,结合证据驱动的进化算子,在六个基准上平均提升 13–27 个点且成本降 55%+
- When Agents Disagree: Bayesian Backward Reasoning as a Label-Free Anchor for Multi-Agent Collective Decision-Making
用贝叶斯反向推理构造reverse posterior,以Jensen-Shannon散度衡量跨路径一致性,提升多智能体决策聚合性能
- Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents
跨任务失败聚合与多角色协作诊断,区分模型适配与系统缺陷,实现训练加速与泛化提升
- FedHUR: Learning Hierarchical Utility-Guided Client Relations for Personalized Federated Recommendation
提出层次化效用引导的客户端关系学习框架,以 item-item filters 为聚合对象,提升联邦推荐个性化聚合效果
- Negative Self-Distillation: Learning to Reason by Avoiding Flaws
用模型自生成负向条件并做门控 unlikelihood,无需标签即可稳定提升 LLM 数学推理,同时保留反思能力
- Agentic Share-of-Search: A Multi-Agent AI System for Competitive Decision-Making in LLM-Mediated E-Commerce
提出 ASoS 指标与多 Agent 系统,测量并诊断卖家在 LLM 生成式推荐中的可见性差距
- Your Retriever Already Knows: Distribution-Shape QPP for RAG Retrieval Sufficiency
24个分布形状特征2ms预测RAG检索充分性,AUROC 0.856超过LLM judge 0.649
- ORCH: Organizational Principles Enable Collective Intelligence in Embodied AI
ORCH 将人类组织理论中的角色与层级协调引入具身多智能体,在50个异构智能体、25个野火任务上大幅超越四种基线框架
- REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving
挖掘历史查询-文档注意力聚合为可复用证据视图,以极低在线开销实现高质量 RAG 上下文压缩
- Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data
在重复数据训练下,MoE 比同 active 参数的 dense 模型退化更早更快,且退化程度由 total 参数决定
- SpecGuard: Inference-Time Backdoor Detection For Free
利用投机解码中的草稿token接受率变化,实现零额外计算成本的LLM推理时后门检测
- TimelyRAG: Semantic-Temporal Hybrid Retrieval for Time-Critical Question Answering in Overlapping-Evolving Documents
提出 retriever-agnostic 的 TimelyRAG,用时间距离重排解决修订版本文档的时态问答,并发布 TimelyQABench
- Distance generalization in transformers: why bother with positional encoding?
系统考察 RoPE/ALiBi/NoPE 在合成延迟复制任务上的距离泛化,发现位置编码效果有限且数据多样性影响关键。
- UniRec: Cross-stage Multi-Task Fusion with Preference Alignment for Cascaded Recommender Systems
提出 UniRec 联合优化粗排与精排融合模块,通过共享嵌入、跨阶段偏好对齐和属性组正则提升一致性与线上指标
- VikingRAG: Accurate and Token-efficient Retrieval-augmented Generation over Structured Documents
目录感知语义存储结合经验边与自适应升级,使结构化文档 RAG 精度持平 SOTA 而 token 降至 5.1%-32.5%
- Why Does Post-Training Quantization Work?
发现预训练模型量化鲁棒性源于层间误差抵消与 LM-head 几何对高排名 token 的优先保留,解释 PTQ 为何有效。
- Thinking with Looped Flows
提出循环流模型,用局部去噪目标训练循环网络,推理时积分概率流实现计算扩展,在ARC-AGI等基准上超越先前的循环模型
- Structured Transforms for Low-Overhead Quantization of Language Models
用符号随机 DCT 替代 Kashin 量化中的稠密正交矩阵,O(N log N) 实现稳定 4-bit LLM 压缩
2026-09-10 30 篇 ★ 7 深度
- Recognition-Refusal Misalignment in LLMs: Why Models Answer Structurally Unanswerable Questions
结构无解问题中LLM已有可线性读取的不可答表征,但与安全拒答通路近正交,导致路由失败
- AgenticGen: Reward-Guided Agentic Video Generation for Advertising
将广告视频生成拆成策略选择与草稿生成,用在线反馈训练性能与质量奖励并通过DPO+GRPO优化,在TikTok显著提升CTR/CVR/Advv
- StudyBench: Can Self-Evolution Squeeze Textbooks for Olympiad Capability?
提出受控物理基准 StudyBench,量化自进化从教科书到奥赛能力的吸收与迁移效率,并揭示 Guidance Gap 与 Compute Plateau
- MasterControl Seventeen Every Time
LLM只解释用户意图,由确定性策略执行预批准分析程序,110/110匹配答案与证据契约,而运行时规划0/330
- Graph Machine: Towards Better Pretraining via Edges
以可微指针边实现 O(n) 状态 + O(1) 稀疏动态路由,替换 Qwen3-0.6B 75% 层后检索 2-4 个 token 即保持或改善 loss
- EVOHARNESSBENCH: Can Your Agents Keep Pace with an Evolving Harness?
首个将非平稳性置于外部 Harness 的 Agent 评测基准,揭示工具/技能/智能体扩充带来的遗忘与适应冲突。
- Steering Geometry: Validating Human Value Geometry in LLM Steering Space
分布驱动激活引导向量能恢复人类价值观理论拓扑,而行为中心方法几何不一致
- Measuring Language Transfer in Robot Policies: Adding Greek to a Cosmos3 Vision-Language-Action Policy
机器改写指令为 Cosmos3 VLA 添加希腊语,揭示五类误导性评估,证明双语训练与多种子对照的必要性
- SQS: Bayesian DNN Compression through Sparse Quantized Sub-distributions
用 spike-and-slab 先验与高斯混合模型统一贝叶斯剪枝与量化,压缩率更高且精度损失相当
- Revisiting Complete Reasoning Traces for Post-Training
完整推理轨迹对SFT收益有限,仅用端点训练更高效且可迁移到RL和蒸馏
- A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM
用 hidden state 几何方向判断 CoT 步骤价值,对齐步骤显式保留、偏离步骤压缩为 latent token,提升精度与效率
- EigenLI: Spectral Approximations to Late Interaction
利用文档 token 的低秩结构,以 top-k 特征子空间替代聚类压缩多向量表示,并可转成单向量 ANN 召回
- Omni Interaction Agent Technical Report
提出Gander,融合多模态感知、全双工流式交互与Agent能力的端到端模型,通过小脑-大脑协同与Thinker-Talker架构实现低延迟实时交互
- Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR
提出DATPO,通过难度自适应树搜索和句子熵引导分叉提升pass@k,增强测试时缩放能力
- SAEScientist-Bench: Can AI Agents Conduct Autonomous SAE Interpretability Research?
提出 SAEScientist-Bench 基准,评估 AI 智能体利用稀疏自编码器进行自主机制可解释性发现的能力,揭示其与专家水平的差距
- Can Agents Win the Video Browser Showdown?
用VLM智能体自主操控交互式视频检索系统,从初始意图描述出发完成多轮搜索,性能比肩历史专家操作水平
- Programmable World Model
将世界状态演化与视频生成解耦,用可执行程序维护持久全局状态,以3D OBB为中间表示驱动预训练视频模型
- REDSI: Addressing the Reproducibility and Evaluation Consistency of Differentiable Search Indexing for Document Retrieval
首个支持 DSI 三种标识符的开源实现及参数化 NQ320K 构建管道,系统分析模型缩放
- ConvMem: Convolutional Memory for Long-Context Reasoning
将长上下文推理重构为分层卷积,训练免费、高度并行,缩短推理链为对数树
- When Does Low-Bit Quantization Preserve the Decisions of Vector Search?
提出基于比较翻转的量化向量搜索分析框架,精确边际预测翻转率显著优于全局秩相关。
- Should I Be Polite to My LLM Relevance Judge? Tone as a Severity Operating-Point Shift
在 TREC DL19/DL20 上发现 prompt 语气主要改变 LLM 相关性法官的严重度操作点而非判断质量,影响校准类一致率大于排序
- GANDR: Claim Auditing for Verifiable Legal Answer Generation
用 Drafter-Critic 双智能体逐条审计引用与声明,严格引用准确率 70.8%,领先最强基线 11.3 点
- Glyph: A Multi-Strategy Agentic System for Column Description and Sensitivity-Ontology Tagging of Enterprise Data Catalogs
用协作式 LLM Agent 将列描述生成与 275 类敏感标签分类落地为可审计的生产系统
- Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning
通过数据混合与调度优化,3.35B模型在60种语言上实现93%以上语言内推理率,证明推理行为可跨语言迁移。
- LiteRAG: Cost-Efficient Graph-Based Retrieval-Augmented Generation
用查询条件算法探索替代检索时 LLM 控制,显著降低图 RAG 多跳问答延迟与成本
- Kernel-Managed Shared Memory for System-Wide Personalization
将多智能体个性化记忆的检索、隐私与注入集中到系统内核,以更低延迟和 token 成本获得与全量上下文接近的效果
- TRACE: Training Reasoning Agents for Causal Exploration with Synthesized Rewards
simulator-oracle-RL 把隐藏干预变客观奖励,训练广告诊断 Agent,35B FullAttr@1 达 0.757,超前沿闭源基线
- Fortunate Recall: Ontology-Driven Memory Lifecycle Management for Persistent Coherence in LLMs
提出 10+1 行为本体的确定性记忆生命周期策略层,将下游混淆率减半并提升时序消歧基准 16 个百分点
- Guaranteeing Faithful Evidence Extraction in Speculative Retrieval-Augmented Generation
提出CHyD,将投机解码改造为强制约束解码,保证引用片段逐字来自检索文档,技术领域准确率接近完美
- What Should an Agent Forget? Separating What Is Stored from What Is Used
提出 RD-Forget,训练无关地把智能体记忆的存储与查询时使用解耦,通过语义槽替换和意图感知检索实现可逆选择性遗忘
2026-09-09 30 篇 ★ 14 深度
- One Symptom, Three Levers: A Critical Review of On-Policy Self-Distillation
系统化梳理OPSD的坍缩失败模式,提出信号位置、特权信息、动态衰减三杠杆框架
- FlowBalance: Verifier-Grounded Self-Improvement from On-Policy Reasoning Experience
用 verifier 校准 on-policy 自引导分数,并通过轨迹平衡训练稳定的推理自改进
- Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training
构建端到端在线协同训练系统,解决长上下文下上下文并行分支注意力与流水线并行特征传输两大障碍,实现最高 122B 模型显著投机解码加速
- Kalman Delta Networks: Uncertainty-aware Associative Memory
将线性注意力循环记忆重构为线性高斯状态空间模型,用卡尔曼滤波跟踪记忆不确定性并提出可并行扫描近似
- Beyond One-Shot Expansion: Contrastive Evidence Exploration for Multi-Hop Retrieval
训练免的多跳检索框架,通过对比 facet 索引、证据条件探索和覆盖感知重排提升 RAG 证据召回
- EAGER: Enrich-and-Align Generative Query Recommendation from Clicked Items in E-commerce Search
两阶段生成式 I2Q 框架:SFT 课程+自蒸馏扩意图覆盖,GRPO 混合奖励对齐点击与业务规则
- Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Tasks
通过构建反馈增强环境,用环境侧观察丰富化缓解长程任务智能体 RL 训练中的奖励稀疏
- Where to Look and What to Use: Retrieve-Localize-Generate for Long-Term Conversational Memory Question Answering
提出MemLoc框架,通过多粒度检索、证据定位与位置ID引导生成,解决长期对话记忆问答中的碎片化与噪声问题
- Uncertainty Quantification for LLM Agents: A Taxonomy, an Evaluation Protocol, and an Empirical Study
提出三轴分类法与轨迹级校准指标 TC-ECE,揭示 Agent 步级校准无法推出轨迹级校准
- Procedural Graphs: Self-Evolving Execution Structures for LLM Agents
用可编辑的 (procedure, relation, procedure) 图组织过程性知识,在线按当前节点生成局部引导,离线通过验证门控自演化图结构
- Miles v0.1: Production-Level Post-Training
一个全栈生产级后训练系统,支持RL、LoRA RL、蒸馏等,在64 GPU上对744B MoE做异步Agentic RL步时263秒
- Matryoshka Hash Representations for Model-Aware Compact Semantic Retrieval
两级训练哈希码,分离全宽训练与前缀组织,实现8/16/32字节嵌套二进制码在零样本检索上全面超越PQ/JPQ
- NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
通过路由 harness 记录能力需求并构建三阶段课程与蒸馏,实现 4B/9B agent 模型的递归自改进后训练闭环
- Task-Blind No MORE: Multi-Task Information Flow in Unified Ranking Backbones
提出 MORE,以 Shared/Private Anchor Tokens 将多任务信息流嵌入统一骨干,逐层共同演化,在线多指标提升且延迟降低约30%
- Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
用 On-Policy Reverse Distillation 放大教师策略偏移分量,实现弱到强泛化且不施加教师容量上限
- Dense Structural Compression of Transformers via Gauge-Correct Channel Removal
训练期用对称 group-lasso 惩罚解决 gauge 自由度,在保留 dense tensor 下动态压缩 Transformer,最高 255 倍 FMA 压缩且精度不降
- Tracing Query Expansion Effects through Sparse Autoencoder Features
用SAE分解dense retriever表示,解释查询扩展引起的内部特征变化,并通过激活引导提升检索性能
- Measuring LLM Sycophancy under Sustained Multi-Turn Pressure
SPINE 基准用自适应 LLM 代理持续挑战 25 轮,揭示现有短对话评估低估模型谄媚,且模型常明知正确却选择迎合
- PDMR: Passage-Driven Multi-ID Document Retrieval
用多个 passage 级标识符替代单一文档 ID,结合多目标训练与 query-段落对齐,提升生成式文档检索的 R@1 与 MRR
- Everything in Moderation: Per-Domain Coverage Optima and Alignment-Resistant Domain Gaps in Multi-Domain Mid-Training
证明各域覆盖率存在内部最优区间,且中期训练的域差距难以被后续SFT修复
- Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents
用状态-策略交替循环把显式经验渐进蒸馏进参数策略,同时保留快速可编辑状态
- Tool Retrievers Are Underestimated: Annotation Expansion Reveals True Capability
提出ToolEX自动发现功能等效工具组合,扩展基准为ToolEQ,证明一对一标注系统性低估检索器,微调增益中30-47%是评估伪迹
- Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented Generation
提出 EAEV,在实体层面用 RAG 对齐生成与检索证据,结合三维对齐评估和反事实稳定性分析,一致提升 RAG 幻觉检测性能
- MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents
用合作 Shapley 归因识别负效用记忆并做最小化清除,任务恢复率 82.3%,比 LOO 高 25.5 个百分点
- Q2D-Web: A Large-Scale Benchmark for Retrieval in Agentic RAG Systems
构建 190M 文档 / 70k agent 改写查询的私有检索基准,发现全量评估排序可用 30% 子语料复现
- SequenceO1: End-to-End Ultra-Long (100K) Sequence Modeling in Recommendation with Low-Rank Caching
用 Sketch Attention 将 100K 用户历史压缩为固定大小可缓存 sketch,结合两时间尺度 STCA 与缓存复用,实现端到端超长序列推荐
- Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment
两阶段生成器在环框架,用 VLM 生成假设文本并基于答案反馈微调 reranker,弥合多模态 RAG 语义相似与生成效用差距
- ToolLoop: Closed-Loop Tool-Use Data Synthesis via Decomposed Generation and Dynamic Self-Feedback
用分解生成与阶段自反馈替代一次性生成过滤,11K数据训练4B模型在BFCL达86.40%
- Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails
在已演化的 Agent harness 下,全轨迹模仿专家会破坏弱模型的 harness 适配,而基于学生自身 rollout 的 on-policy 局部纠错可无损叠加模型增益
- Exploring Bottom-Up Clustering for Creating Semantic IDs
提出自底向上层次聚类生成 Semantic IDs,保证唯一性并保留嵌入局部结构,提升下游生成式检索效果
2026-09-08 29 篇 ★ 1 深度
- Encore: Infinite Audio-Video Generation with Adaptive Signal Routing
提出长音频视频联合生成框架Encore,通过自适应信号路由解决跨模态长时一致性
- Enoki: Efficient Multi-Level Hallucination Detection
提出 Enoki 开放信息抽取框架,借助文本锚定事实验证与投影,同时完成 claim 级验证和 span 级定位,资源更少定位更优
- ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding
用 MLLM 浅层同时做帧编码与索引构建,查询时按浅层注意力打分并多样性选帧,延迟降低最高 52.1 倍且性能对齐强基线
- Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation
通过 verifier 探针按 prompt 门控教师信号,可靠才用稠密 OPD,否则退回 verifier-grounded GRPO
- What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation
提出对话生成制品的修订传播基准,评估九种测试时计算方法,三路并行采样+选择最具性价比
- No-Regret Bayesian Optimization with Finite-Library Input-Warped Kernels
用有限库光滑输入扭曲自适应 GP-UCB 的核几何,在不牺牲收敛保证下提升黑盒优化样本效率
- Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs
发现CoT中的问题表述、目标分解、演绎等操作在隐藏表示中可分离,中层最显著并依赖前文推理上下文
- How Perturbations Propagate: A Multi-Level Analysis of Robustness in Large Language Models
在六个模型上从行为、隐状态几何和注意力头三层揭示输入扰动传播异质性,证明单指标鲁棒性评估不充分
- τ^τ-Bench: An Environment for End-To-End, Realistic Agent Construction
把“构建Agent”本身作为评测任务,交付前需在真实业务记录、客户端需求和成本约束下完成客服Agent。
- BIT.UA at BioASQ 14B: Modular Retrieval with pg_textsearch and Qdrant, and Agent-Based Answer Generation
将 PostgreSQL BM25、Qdrant 稠密检索与多 Agent 辩论共识机制引入生物医学问答,取得竞争性 MAP 排名
- CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls
用 assume-guarantee 合约与认证安全上下文,保证 LLM Agent 跨组件端到端后果完整性
- WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing
提出全栈式多模态 Agent 方案,含运行时、数据、基准与后训练,30B总/3B激活策略逼近1T参数 agent 性能
- Reflection-aware Generative Novel View Synthesis
提出免训练反射感知多视图扩散方法,将镜中影像视为互补视图实现镜面场景一致新视角生成
- GLASS: Graph-Language Alignment with Spherical Scoring for Transferable Graph-Level Anomaly Detection
GLASS 将图编码器与文本嵌入对齐到超球面,用球面密度评分实现跨域图异常检测,支持零样本/少样本迁移
- A Tree-based RAG Framework for Evidence-Intensive QA via Adaptive Planning and Topology-Aware Evidence Gathering
提出 APT-RAG,通过自适应规划扩展推理树和拓扑感知证据收集,提升证据密集型问答性能。
- Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements
提出Measured Sliders框架,用可微图像测量定义并学习连续图像属性控制,实现有序、选择性和可组合
- Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection
让 LLM 用 SQL 构建参考文档数据库,以神经符号方式无监督检测生成响应中的幻觉,无需领域微调
- How a Chatbot's Response Style Shapes a Classroom: A Multi-Agent Simulation of Students Consulting AI
用 20 学生代理仿真六种 AI 回复风格,发现解决方案导向风格低 AI 依赖并提升自主性,肯定与煽动风格增加依赖与压力
- How Does mHC Use Its Residual Streams? Selective Routing and Near-Identity Mixing
揭示 DeepSeek-V4-Flash 四流 mHC 路由集中、晚期混合近恒等,稀疏化与恒等替换几乎不损性能
- NS-ST-GraphRAG: Neuro-Symbolic Spatio-Temporal GraphRAG for Literary Knowledge Processing
提出整合时空约束与动态子图检索的 NS-ST-GraphRAG,并发布红楼梦多跳 QA 基准
- MIVAIS: A Study Environment for Multi-Agent Mixed-Initiative Visual Analytics Applications
提出MIVAIS双层平台,标准化多智能体状态同步与通信,并自动记录多模态人机协作溯源数据
- MURAL: Multimodal Uncertainty-aware Recommendation via Adaptive edge Learning
用动态自适应边学习和不确定性感知融合,解决多模态推荐静态图与噪声融合瓶颈
- PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting
系统验证 LoRA、递归推理、整数表示、CTF 提示与零温度解码如何提升 LLM 比特币价格预测精度与稳健性
- RegionFed: Federated Learning for Personalized Query Understanding in Heterogeneous Retail Environments
提出梯度级联邦个性化框架 RegionFed,用区域与全局梯度冲突路由个性化策略,在 transformer 上避免参数级方法崩溃
- Design Docs Are All You Need: An AI-native Machine-Learning Performance Tool
用设计文档作为唯一持久化工件,让 AI 编码代理按需重新生成性能建模库代码
- Repeated Queries Exhaust an LLM's Brand Recommendations but Not Its Sources
通过稀疏化与Chao2评估,发现无检索LLM品牌推荐持续新增,检索收敛品牌但引用域名不饱和
- TruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agents
提出区分复现与发现的基准,用固定 LLM 裁判评估智能体声明的证据成熟度,揭示瓶颈在科学判断而非编码
- A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
结合金答案锚定QLoRA、任务感知符号路由和组相对RLVR,在保持答案正确率的同时大幅提升推理可解释性
- Influence Score and Transformers interpretability: Measure of the Effective Impact of Attention Heads at inference time
提出结合logits方向影响与残差流结构贡献的influence score,用于多尺度量化注意力头对分类决策的贡献
2026-09-07 30 篇 ★ 15 深度
- Group Adaptive Clipping Policy Optimization
将 RLVR 中固定裁剪上界改为按组内正确数 c 闭式缩放,保护稀有正确 rollouts 的探索信号
- HiRS-Agent: A Hierarchical Multi-Agent System for Reliable Long-Horizon Remote Sensing Task Solving
提出 Manager-Specialist 分层多智能体架构,通过步骤级验证和分层强化学习大幅提升小模型长程工具调用与任务成功率
- Iris: Climbing to the Search Frontier
通过网页超链接反向构造多跳搜索任务、双层轨迹过滤与SFT-RL迭代爬升,训练出开源同参数范围最强的搜索Agent
- MaxKernel: Agentic Kernel Generation for TPUs
MaxKernel 多智能体系统利用 LLM 与实时编译反馈,在 TPU 上自动生成并优化高性能内核,匹配专家手写调优基线
- Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States
统一多模态架构,联合物理/几何/外观三态与 Omni-Camera 实现 3D 世界生成重建
- Don't Drop Dropout: Optimizing Layer Sparsity for Efficient LLM Training and Inference
系统优化层丢弃的分布、调度与超参数,同等 FLOPs 降低损失,训练省 25% FLOPs,推理提速达 1.5 倍
- RISE: Recursive Improvement via Self-Extrapolating Policy Distillation
RISE 外推模型自身 RLVR 轨迹构造 token 级教师,实现递归自蒸馏,无需外部模型或特权条件
- Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization
提出OR-Clarify基准与InterOPT两阶段框架,在优化建模前主动识别缺失槽位并决定追问或停止
- Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability
对照评测四种 Agent 记忆格式在模型升级后的可移植性,证明固定 schema 知识图谱最稳,NOTES 与 RAG 需重建或保留原始历史
- Beyond Co-purchase Relation: Evolution of Complementary Recommendations at Allegro
生产级互补推荐框架 AlleCompanion:用 Category Adapter 和 ComCat 类别映射抑制共购噪声,在 Allegro 实现购物车 GMV 提升 15-21%
- BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference
发现长程推理中查询聚类可预测重访 KV,提出训练无关信标查询压缩 KV 缓存,内存降5.8倍且准确率几乎无损
- CAGE: Coherence-Aware Graph Encoding for Retrieval-Augmented Generation
用异质实体图建模检索块间连贯性,通过图神经网络重排序提升多跳问答上下文质量
- Testing Interchangeability in LLM Agent Teams
成队后交换角色匹配智能体,任务分损失小但沟通效率下降16–63%,历史越长影响越大
- Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG
用正确样本蒸馏 + 失败样本强化学习两阶段训练,让 16 倍压缩的 RAG 软上下文效果反超无压缩基线
- CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents
通过环境到数据管线将真实桌面软件转为混合 GUI+CLI 环境,训练 9B 智能体显著提升成功率与效率
- SAM-D2Q: Aligning Multimodal Doc2Query with Search Demand and Conversion for E-commerce
三阶段课程学习将多模态 Doc2Query 对齐到召回增益和商业转化,线上 GMV +3.38%
- Personalized Task Dependency Graphs for Mitigating Signal Erosion in Multi-Task Recommendation
PTDG以低秩动态任务图和因果GCN消息传递,缓解多任务推荐深层转化目标的信号衰减
- GUT: Quantifying and Optimizing the Reasoning Uncertainty of LLMs via Graph Complexity
用有向无环图表征推理分支,以图复杂度量化推理不确定性并通过强化学习降低不确定性。
- Inventory-Grounded Policy-Level Optimization for Training-Free AI Search
训练无关地把动态库存证据与可复用决策指南解耦,提升 AI 搜索 CTR 并减少坏例
- A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support
提出DMoA结构化辩论混合多智能体框架,提升复杂诊断准确率与安全率超10个百分点
- Multi-Step Tool-Calling over Korean Open Public APIs: A Benchmark and a Data-Synthesis Recipe
执行验证动态图合成多步工具调用数据,9B 模型经 GRPO 微调接近 27B
- Necessary or Sufficient? Evaluating LLM Explanations With Behavioural Evidence
用黑盒干预度量LLM解释因子的必要性与充分性,发现Top-3因子与行为影响仅中等相关且漏报明显
- Embedding Surgery: Localized Updates for Adaptive Ranking Correction in Dense Retrieval
提出嵌入手术,在查询时对文档嵌入做最小凸优化更新,以满足排序偏好约束,无需重训或重建索引
- Latent-Aligned Reasoning for Multimodal Recommendation
提出 LARK 两阶段潜在推理框架,用视觉与推理文本双重对齐缓解多模态推荐中的跨模态稀释,在 Amazon 与工业数据集上一致超越 baseline
- Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation
将LLM推理蒸馏成轻量embedding对分类器,并用商品类型级测试时训练进一步适配,实现无LLM推理的高效升级推荐
- Trace2Tower: Transition-Aware EigenTrace Induction of Multi-Level Skills for LLM Agents
将Agent轨迹经事件抽象、成功/失败对比图与谱分解归纳为三层技能塔,ALFWorld成功率87.31%
- WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
构建4084题真实可穿戴健康推理基准,覆盖16种题型,评估14个LLM准确率仅19.6%–72.9%
- First Things First: Teaching LLM-Based Agents to Prioritize Must-Haves before Nice-to-Haves
构建 FTF-Bench 并推出 FTF-RL,显著提升多模态 Agent 在电商/预订/出行中区分必备与可选需求的能力
- How to Speculate about Uncertainty in Agentic Coding? A Draft-Model Gate Method
用小型草稿模型对智能体轨迹做投机打分,在动作执行前门控拦截,降低错误率与成本
- AtomRec: Evolving Atomic Memory for Agentic Recommendation
用结构化原子记忆与语义链接替代粗粒度摘要,实现可解释证据路径检索的 agentic 推荐
2026-09-06 30 篇
- Perceive to Hypothesize, Verify to Ground: An Agentic Reasoning Framework for Open-World Geo-Localization
提出 GeoPAVE 双层智能体框架,以感知生成假设、验证证据支撑决策来缓解幻觉与上下文漂移
- RealSWE: A Compositional Evaluation of Coding Agents under Realistic User Requests
构建多变量基准RealSWE,发现真实请求使LLM编码性能平均下降6.4pp,且明确期望行为与动机可显著提升表现
- EM^2Mem: Event-Centric Multimodal Memory for Large Language Models
以事件为中心组织多模态记忆,将异构证据绑定到事件锚点,提升长视频 QA 精度并大幅降低推理成本
- VibeVoice-ASR-Streaming Technical Report
首个 LLM 端到端流式说话人归因 ASR 之一,交错音频块与少量前瞻音频实现低延迟“谁说了什么”输出
- Bayes-Optimal BER and AUC: Estimation and Evaluation of Estimators
提出基于软标签的最优 BER 与 AUC 估计器,并扩展 FeeBee 框架评估任意估计器
- Transfer Safety Awareness for Cross-Modal Safety Drift in Multimodal Large Language Models
提出安全感知表示迁移(SRT),冻结 MLLM 骨干下通过方向修正缓解跨模态安全漂移,提升安全性并保持通用能力
- Unifying Conformal Language Tasks with In-Context Ensembles
提出 Conformal Relevance 框架,用上下文样例策展与集成构建评分函数,兼顾覆盖与简洁并减少手工提示工程
- WorldReward: Reward Modeling for Camera-Conditioned World Models
用 VLM 将长视频按动作分块并投票聚合,统一评测动作一致性与视觉质量
- OmegaUse-SOP: SOP Engineering for Professional Computer Use from Human Demonstrations
提出SOP Engineering系统OmegaUse-SOP,将人类专业软件操作演示转化为可复用GUI Agent技能,提升专业SOP任务可靠性
- Multi-Tool Image Editing Attribution in Facial Forgery
面向多工具编辑人脸图像,提出DPEC方法结合空间-频域特征与课程学习,实现多工具归因
- Training seeds and model-selection stability in recommender-system evaluation
固定数据划分仅变训练种子,证明单种子结果会高估推荐模型评估稳定性,种子应纳入评估协议
- ViSAR: Training-Free Adaptive-$k$ Retrieval for Visual Document Question Answering
在嵌入空间构造查询条件页面级相似度矩阵,动态决定检索页数,降低RAG延迟并保持或提升准确率
- Causal Foundation Models
提出因果基础模型(CFM),在大规模合成数据上预训练,对新数据集通过 in-context learning 零样本估计因果效应
- The Natural Language Interaction Protocol and Standard for AI Agents
提出标准化 AI Agent 通信协议 NLIP,定义轻量语义消息信封,支持跨框架与异构传输互操作
- Beyond Majority Vote: Multi-Perspective Adjudication for Medical Hallucination Detection
多视角标注与裁决流程揭示单遍幻觉基准会低估事实错误,LaJ 可辅助发现但无法替代专家判断
- DSAQuant: Denoising-Stage-Aligned Quantization-Aware Training for Video Generation
提出按去噪阶段对齐的量化训练框架,在 W3A3 下 VBench 平均最高提升 6.60
- FiMI Banking: A Sovereign Model for Indian Retail Banking
用偏好优化提升安全拒答,用可验证奖励RL提升多轮工具调用与token效率
- Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints
审计 52,988 次 LLM judge 请求发现同名共享端点重复/次日排名一致性远低于预设门槛,并定位三类失效机制
- Plan Pointers and Record-Directive Form in Budgeted Verification of Inherited Agent Memory
用 12 项注册实验(14,760 次尝试)量化 memory store 中 criterion 与 id 等 directive 形式如何改变 budgeted agent 拉取哪条记录
- Two-Stage Reinforcement Learning for Sound and Adversarial Test Generation in Code LLMs
提出两阶段 RL 测试生成框架 TCS,先学可靠测试再对抗生成反例,提升代码生成 pass@1 与答案选择
- Epistemic Warrant for LLM Recommendations: Characterizing the Basis for Reliance When Ground Truth Is Unavailable
提出可操作的决策级认识论保证框架,将LLM两两推荐分为四层依赖证书并验证其有效性
- When Models Edit Too Much: On the Fidelity of Minimal Code Edits
提出可度量的编辑保真度指标,发现LLM普遍过度编辑,保留指令与RL训练能有效减少不必要修改
- RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting
将 RAG 思想用于连续预测:冻结基座模型,检索相似历史残差并路由融合以纠偏
- SciLENS: RL-Driven Autonomous Agents for Scientific Localized Evidence Navigation and Synthesis
全本地科学文献Agent,以结构可视化与逆向分解过程奖励训练,性能对标GPT-5.2
- Persistent Identity Preservation in Generative Image Models: A Benchmark and Evaluation System
系统对比三种身份表示范式,证明持久身份层显著降低身份漂移且独立于基础模型
- Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision
用时间采样密度作为自监督信号,让稀疏帧学生匹配稠密帧教师的 next-token 分布,无需标签或额外教师即可提升视频状态跟踪
- Transfiver: Human-AI Co-Inference through a Shared Editable State
提出 Transfiver 架构,让人类与 AI 共享同一可编辑持久状态,实现可验证的协同推理
- Knowledge Acquisition During Pre-training? Large Language Models Learn Better With Auxiliary Views
辅助视图(知识重构)在固定 token 预算下比重复更能提升 LLM 知识获取,且不依赖强 teacher 生成
- Instruction Duplication as an Inference-Time Control Primitive
重复程序性指令可在不改训练/解码下提升过程遵循,下游轨迹消费时价值显著
- ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models
ALRA 结合学生提议与教师锚点,自适应局部对齐改进 logit 蒸馏,提升预训练学生模型零样本性能
2026-09-05 30 篇 ★ 5 深度
- Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answering
提出 KBMR,首个基于 MLLM 的 KB-VQA 嵌入检索器,用实体一致性连续蒸馏实现实体级语义对齐,Recall@1 最高提升 14.7%
- An Empirical Study on Zero-Data Bootstrapping for Conversational Recommender Systems
系统实证零数据下用评论、元数据、协同信号合成对话训练CRS,主动选择提升数据效率
- Locked at the Entrance, Open Inside: Where RLVR Narrows the Solution Space
定位 RLVR 训练后解空间收缩集中在首个算术操作前,提出晚期参数插值在保持 pass@1 下恢复 37% 覆盖。
- SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions
首个配对的拍问式多模态检索鲁棒性基准,覆盖 1145 条查询、9085 个候选项和 53 种受控扰动,并提出自适应融合方法 MOOR。
- NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference
提出单塔多模态多语言编码器,用掩码离散扩散预训练,视觉文档检索精度高且吞吐翻倍
- Using Grounded Theory for Agent Behavior Analysis at Scale
提出 AutoTraceGT,首个用多智能体流水线自动执行扎根理论分析智能体轨迹,生成行为分类法
- Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents
提出知识门控任务构造协议,分离任务指令与私有工件,通过溯源与可执行见证验证知识依赖
- A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss
用冻结图像嵌入的 InfoNCE 对比损失对齐 VLM 隐藏状态,单遍生成细粒度描述,速度提升约20倍
- Debias-SparseGPT: Bias-Aware Pruning for Large Language Models
在 SparseGPT 剪枝中引入基于对比输入的二阶去偏正则项,显著降低剪枝引起的偏置放大,同时保持模型质量
- VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement
用类型化物理义务和冻结专家证据做可溯源三态裁决,覆盖 228/304 个真实生成缺陷
- Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding
提出 LatentStream,将流式视频记忆从 store-and-retrieve 转为 retrieve-and-internalize,通过层级记忆与渐进置信度优化取得 SOTA
- LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes
从零训练6B DiT图像生成模型,开源权重与代码,在Qwen-Image-Bench双榜达到开源SOTA
- PACE: Towards Surfacing Hidden Conflicts in User Requests
提出 PACE 数据集与 PACEMAKER 多智能体框架,通过冲突感知查询重构、多跳图遍历与证据过滤提升隐式冲突判断能力
- Group-Aware Adaptive Retrieval for Evidence Navigation
用组级方向评估替代文档级扩展,结合探索-利用策略提升推理密集检索中的有界召回问题
- CORE: Improving Compositional Reasoning in MLLM Embedding via Reranker Distillation
将重排器的跨注意力组合判断蒸馏为 Rank-KL listwise 目标,显著提升多模态嵌入的组合检索与细粒度区分
- Tail-Likelihood Reinforcement Learning
通过最大化超过随机奖励阈值的对数概率,保留生成式策略对稀有高奖励样本的覆盖,提升Best-of-k性能
- Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs
控制变量实验表明帧选择是长视频理解最大杠杆,经典OMP算法与专用选择器性能相当
- Rethinking On-Policy Distillation of Large Language Models II: One Training Example
一个 query 训练数百步即可恢复大部分 full-data OPD 增益,揭示 OPD 数据过剩、算法吸收是瓶颈
- Last Translation Benchmark
构建可持续更新的多模态对抗性翻译基准,用逐例可验证规则替代不可靠自动评分
- From Topical Relevance to Answerability: Entailment Distillation for Conversational Retrieval
提出 CLEAR,用答案-段落蕴含蒸馏和段落中心溯因召回,缩小对话检索中主题相关与可回答性差距。
- ESPO: Error-Structured Prompt Optimization via Diagnose, Diversify, and Stabilize
将提示优化分解为诊断错误模式、多样化候选、自举稳定性选择,平均准确率超 GEPA 3.76pp且提示缩短47%
- Spurious Advantage Hidden in GRPO
识别 GRPO 优势估计在有限答案空间与搜索智能体中会奖励猜测行为,并提出 SIGNBALANCE 修正
- Headroom-Drift Replay: A Primitive for Principled Replay Control in GRPO
将 GRPO 重放控制拆为按剩余学习价值排序的 Headroom 与按策略兼容性门控的 Drift,不改动 on-policy 流即减少交互成本。
- The Dice Roll Method: A Standardized Protocol for Repeated-Query Auditing of Large Language Model Brand Recommendations
为 LLM 品牌推荐重复查询审计提供统计可靠性迭代标准与指标组合,外部验证 37/39 单元复现
- More Criticism Does Not Make a Better Review: EquiReview-R
将 AI 审稿建模为证据引导的结构化问题集精炼,分离遗漏与过度批评,显著降低过度批评并控制遗漏风险
- Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting
提出 CAPA 架构,通过显式会议状态预测与校准,将缺席者发言沉默率从 51.4% 降至 2.5%
- Efficient Test-Time Adaptation through Human-AI Interaction
利用跨会话人机交互信号在测试时适配个体 Agent,写作与视觉创作任务成功率提升 4.5–20.9%,演化 rubric 可多捕获 16–22.3% 失败
- VestigeKV: The NoPE-MLA KV Cache Carries Its Own Eviction Signal in a Vestigial Branch
利用 NoPE MLA 缓存中 64 维退化分支作为查询无关显著性信号,实现无训练 KV 缓存分层压缩
- Hardware-Aware FP4 FlashAttention-4
Direct-P 将注意力分数直接映射为 FP4 概率,GB200 上前向吞吐达 BF16 的 2.13 倍,8B 模型训练更新加速 1.14 倍
- Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks' financial statements
构建跨机构银行财报问答基准 FinRAG-QA,量化 RAG 各组件贡献,检索与上下文增强将 NDCG@10 从 0.322 提至 0.710
2026-09-04 30 篇 ★ 18 深度
- Knowing When Not to Reuse: Conditional Experience Transfer in Autonomous LLM Post-Training
提出 BCIT 方法,在自主 LLM 后训练中只授权可迁移的历史更新,减少有害复用并提升同预算下最终模型质量
- Small Language Models as Judges for Rubric-Based Reinforcement Learning
1.7B Probe 评委替代大模型生成式评委做逐条量规打分,RL 训练效果更优且奖励判断快 10.7 倍
- Aspire: Can Models Self-Evolve from Vague Goals?
提出 Aspire 基准,考察 LLM 在仅给定模糊目标时的自主进化能力;当前代理权重级提升稀疏且不稳定
- WHALE: A Simple Recipe for Joint Harness-Weight Optimization
交替执行模型权重更新与 harness 搜索,实现 Agent 系统联合优化,大幅超越单组件和 prompt 级优化
- CRISP: Cliff-awaRe Input-adaptive Sparse Prefilling with Structural-Mass-Motivated Routing
用结构质量代理替代JSD路由,以噪声地板阈值替代累积覆盖阈值,消除长上下文预填充的O(n)噪声积累
- LatentPress: Context Compression Beyond Text and Vision
将对话历史与长文档压缩为连续 memory tokens,直接输入冻结解码器,无需文本重建,4-16倍压缩且性能优于文本摘要与OCR压缩
- Replacing Training with Memory: Listwise Selection for Text-to-SQL
免微调列表式选择器,用结构化记忆作为决策标准并多排列聚合缓解位置偏差,BIRD-dev 准确率提升 2.02 且 tokens 减 2.92x
- Language Models Can Control Their Own Attention
提出声明式注意力协议,让模型在思维链中显式声明注意力范围,零训练实现长上下文稀疏注意力
- Exploring Collaboration between a language and a non-language agent
提出隐状态内部化,将非语言 agent 的连续表示投影为 latent tokens 注入 LLM,显著优于文本化协作
- Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM
对 Qwen3.8-27B 全部 496 个线性层(含 GDN)做 NVFP4 W4A4,精度持平 BF16 且更小更快
- Editable Visual Design
让 VLM 先调用图像模型做美学参考,再写原生 HTML/CSS 交付可分层编辑的设计
- Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning
提出 Random Attention,保留 prompt 并在各注意力头内随机淘汰 KV 缓存,匹配最强选择器同时吞吐提升 32-43%
- Environment Evolution for Terminal Agents
提出离线环境进化,沿多轮目标派生的三个难度方向逐步提升终端环境难度,并通过多 Agent 回路实现,提升终端 Agent RL 效果。
- Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments
从终端代理轨迹重建可执行环境,并扩展单轮/跨仓库多轮任务,SFT 大幅提升代码代理基准
- Representational alignment yields generalizable safety in language models
提出 ReSO,直接对齐 LLM 潜在表示与人类道德分类结构,在不监督响应的情况下提升对抗鲁棒性
- DoPR: Reusable Compressed Document Prefixes for Efficient LLM Reranking
离线压缩文档为可复用前缀状态,在线仅编码 query 与打分 token,保留 97%+ 排序效果并提速最多 8 倍
- DRACO: Fine-Grained Credit Assignment with Dynamic Rubrics for Long-Horizon Agent Training
DRACO 在 outcome-blind 设定下动态生成轨迹级 rubric,并把单标量奖励闭式重分配到步骤级优势,用于长程工具智能体 GRPO 训练
- RuleMem: Active Rule Memory for Long-Term Conversational Agents
将对话历史归纳为自然语言 Horn 子句规则,用 perplexity 一致性过滤并指导证据召回与推理,显著提升长对话 QA 准确率
- Beyond Shallow Alignment: How Post-Training Methods Determine Refusal Circuits And Steering Robustness
比较 SFT、Ra-SFT、ORPO 三种后训练方法,发现训练目标而非数据重塑拒绝计算,且无一同时满足分布式编码、安全/效用可分离、细粒度可纠正
- Towards a Statistical Understanding of Mixture-of-Experts
用局部化聚合视角统一分析 MoE,给出稠密/Top-K 路由与共享专家的 oracle 风险界
- HypRQ-VAE: Hyperbolic Item Indexing for Long-Tail-Aware Generative Recommender Systems
首次将双曲空间残差量化 VAE 用于生成式推荐语义 ID,显著提升长尾物品推荐
- Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning
实证表明 CoT 步骤文本只部分编码其功能重要性,LLM judge 与微调 critic 识别高优势步骤能力远低于噪声上限。
- LLM4AIGQ: LLM-based AI Guidance Query Generation Framework for Multi Interest Mining
用SFT-RL-DPO三阶段训练LLM,从多行为序列中分解多兴趣并生成高价值引导query,线上nearline生成+在线检索
- SelfDR: Self-Distillation from Reasoning for LLM-Based Recommendation
用推荐性能为 reward 训练 reasoner,再通过动态加权自蒸馏将推理增强迁移到直接推荐模型,在线推理零额外开销
- Sequential Beats Joint: On the Interplay between On-Policy Distillation and RLVR
两阶段 OPD-then-RL 在逻辑与数学推理上稳定优于纯 OPD、纯 RLVR 及所有同一步混合的方法
- Unlocking Lossless Speedups in LLMs via Discrete Diffusion
用 LoRA 扩散权重并行 draft + AR rejection 实现无损加速,8B Uno 在吞吐与质量上超过主流 d-LLM 与 speculative 方法
- Compile by Training: Turning Natural-Language Specifications into Local Neural Functions
通过教师模型生成示例并训练小适配器,将自然语言规范编译为可本地运行、可组合的神经函数
- UniCon: A Unified Context-Centric Modeling Paradigm for CTR Prediction
将历史曝光列表与当前候选集统一为上下文单元,通过分层注意力建模上下文内局部性与跨上下文动态
- EPIC: Explicit Posterior Item Conditioning for Semantic ID Diffusion Recommendation
在语义 ID 扩散解码中显式构造可行物品后验并回注 token logits,使物品竞争在目标仍可达时发挥作用
- Subspace Inference Enables Efficient Active Reward Learning from Preferences
用低维子空间扩展卡尔曼滤波追踪奖励模型不确定性,以更少偏好标注训出高质量奖励模型
2026-09-03 30 篇 ★ 13 深度
- InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal
用客观多维 reward 与严格引文验证训练学术评审/反驳 Agent,减少主观评判偏差和幻觉
- AgentJudgeBench: A Multi-Difficulty Benchmark for Evaluating LLM Judges on Agentic Tool-Calling
首个系统性评估LLM评判器在依赖型Agentic工具调用工作流上的可靠性基准,揭示无真值时所有评判器收敛于77-82%的结构性天花板
- Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation
提出 IDA-OPD,用一阶局部熵影响力识别并替换熵收缩更新,仅靠采样令牌教师概率提升 pass@k 并保持 pass@1
- Agents in the Large: Perception-Centered Architecture for Persistent Agents
提出 Pera 架构,用感知与控制组件持续感知任务执行、内部上下文和环境变化,构建生命周期任务驱动长期服务的自适应
- S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?
提出 S3Gym 交互基准,分离自测/自评/自改进并对比三种经验利用路径,揭示自改进受任务结构制约
- HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
HarnessDev 基准评估 LLM 从零构建并迭代优化 Agent 执行基础设施的能力,发现领域差异大且跨模型迁移受限
- StudentSim: Training LLM-based Student Simulators
用两阶段训练构建个性化学生模拟器,同时提升行为保真与引导响应,并可作为 tutor RL 奖励
- Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall
发现 mid-training 中标准 KD 产生推理-事实召回权衡,提出基于 teacher entropy 的 Switch Distillation 做 token 路由以保住推理增益和事实召回
- Cliff: Learning Process Rewards from the First Mistake
提出 Cliff 奖励塑形,利用 LLM 教师定位学生 rollout 中第一个错误,将正确前缀与错误后缀赋予不同优势,平均比 GRPO 提升 7%
- EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction
用 LightGBM 对部分轨迹预测最终成功/失败并提前终止,最高省 44% 输入 token 且几乎不改变排行榜排名
- hLLM: Single Pass Decoding for Generative Reranking
用匈牙利算法从 LLM 隐状态矩阵直接解出排序序数,以 O(1) 次前向替代逐 token 自回归解码,实现 28ms 近无损重排
- KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation
一种知识图谱无关的 Agentic 架构,仅用查询端点和轻量类索引即可动态发现图谱结构并生成 SPARQL,F1 提升约 8 点
- MERGED: Multimodal Entity Resolution via Generated Expert Reasoning Distillation
无需人工标注,多教师VLM生成推理标签,共识SFT+分歧DPO蒸馏7B学生,PR-AUC超32B基线6.32%且成本降6倍
- Post-Training Language Models for Gold-Medal Performance in Coding Competitions
端到端后训练+GenCorrect 迭代测试时计算,IOI 2026 得分 535.4 超人类冠军
- Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
提出 DisCo 与 AREX-Skill 库,将 GitHub 仓库蒸馏为可复用技能,显著提升研究 Agent 表现
- SwapRec: Warming Up Cold Items Through Training-Time Swaps
把冷物品按内容相似度替换为温邻居的训练增强用于序列推荐,显著提升推理时冷替换鲁棒性和冷品曝光
- Index-Free Dynamic Edge Retrieval with Energy-Tail-Aware Partial Scans
提出 ETAR,通过保留查询高能量坐标与低精度表示加速动态 MIPS,兼顾高召回与简单更新
- Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation
提出OrthoRec,用协同引导正交净化和拓扑感知MoE解决多模态推荐中的模态-拓扑冲突
- Beyond Context Windows: Persistent Discovery Context for Data-Centric Agents
引入持久发现上下文记忆层,复用任务意图到数据对象的映射,提升后续检索质量
- CORAL: An LLM-Native Harness for Production Recommender Systems
用 LLM agent 闭环优化推荐系统控制面资源配置,以极低成本实现在线 A/B 验证的 engagement 提升或成本节省
- Learn from Whoever Is Right: Answer-Verified Multi-Teacher Distillation for Multi-Domain LLMs
MT-SDPO用答案验证按样本选择正确教师,结合自锚定与特权蒸馏,将多域教师整合为单一LLM策略,提升最弱域并缩小域间差距
- GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation
提出 GenCAR:离线用 LLM 生成反事实候选并微调排序模型,在线用 conformal+BH 控制 proxy-label FDR,不调用 LLM 提升 OOD 推荐恢复
- Discriminative World Models for Web Agents
用预测状态匹配训练世界模型,使预测表示能区分不同动作结果,提升 PRM 动作排序与端到端任务成功率
- Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems
用双层博弈与漂移分析形式化多智能体反思,提出需环境验证门控的 SRMA 更新
- SPAR: Enhancing Industrial-Scale Generative POI Recommendation via Real-World Spatial Perception
用空间内禀 SID、多粒度地理继续预训练和任务向量锚定 SFT,将真实城市空间知识注入生成式 POI 推荐
- Adaptive Test-Time Inference for Text2Cypher with Trace Budgeting and Selective Refinement
提出自适应 trace 预算与选择性执行引导精炼,在 Text2Cypher 上降低 30.7% 生成预算、21-25% 推理时间且质量持平
- A Power Law in Logarithm's Clothing: On the Scalability of Graph-Based Vector Search
实测发现图向量搜索成本在数据规模小于内在维度时呈次线性幂律增长,之后才转入多对数增长,并给出统一理论模型
- UE5M3 FP4 Block Scaling for Stable Language Model Pretraining
用 E5M3 块缩放替代 RHT 与 BF16 末层豁免,更简单的 FP4 预训练配方,8B 模型 190B tokens 表现优于 NVFP4
- Recommender System as Slow and Fast Thinkers
提出 DS-Frame 插件式快慢推理框架,用样本级路由只对难样本做多步 latent refinement,在 SASRec/BERT4Rec 上平均提升约 7%
- Incremental Pooled LLM Evaluation for Cost-Effective Retrieval Model Selection
增量池化 LLM 评估复用已有相关性判断,仅对新系统新增文档做 LLM 评判,大幅降低 RAG 检索模型选型成本
2026-09-02 11 篇 ★ 11 深度
- E-Commerce Bench: Evaluating LLM Agents on Long-Horizon Autonomous Business Operation
首个开源电商运营基准,融合确定性谈判、动态事件与真实数据,评估 LLM Agent 全年自主经营的多维能力
- Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs
将执行控制协议与可优化文本解耦,用类型化 schema 保证多智能体提示优化不破坏路由/格式,任务性能与稳定性双升
- Two-Sided State-Space Models for Sequential Recommendation with Non-Random Multimodal Review Feedback
提出 TS-SSM,同时更新用户与物品状态,利用模态缺失模式与正负反馈不对称衰减,Recall@20 平均提升 14.8%–18.8%
- From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix
以模块化 GRPO 专家 + 两阶段 SLERP 融合替代联合多目标 RL,32B 模型在内部流量上超越约 7 倍参数基线并承接 50% 请求
- From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs
提出 ReST,用双门控注意力、RoPE+RoTE、SRN 与共享前缀编解码,把行为序列 Transformer 扩展到生产排序并获在线收益。
- Towards Effective Structured Context Modeling for Conversational Recommender Systems via Dual-node Monte Carlo Tree Search
提出 DREAMS,用双节点 MCTS 在结构化偏好状态上联合优化偏好引导与利用,平均成功率提升约 7.4%
- World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation
用冻结 LLM 用户参与世界模型并行预测多候选 item 的异质反馈,转化为奖励训练 1.7B 推荐策略,跨域匹配或超过更大 LLM。
- TGR: Advancing Industrial Recommendation from Generative-Paradigm Ranking toward Unified Generation and Reasoning
提出并部署覆盖生成式排序、端到端生成和推理增强的工业级生成推荐框架TGR,在腾讯多场景取得显著线上收益
- TRIAGE: Three-level Routing and Intelligent Agent Guidance for Efficient Execution
用历史执行轨迹做语义路由与技能化复用,在 1007 条查询上降低 62.3% token 消耗
- It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning
用双侧 LLM 生成关键词并直接做倒排索引匹配,通过 SFT 对齐与交替 GRPO 协同进化,F1 最高提升 36.1%
- The Rise of Verbal Reinforcement Learning
提出 Verbal Reinforcement Learning 统一框架,按语言反馈介入时机分为 grounding、deliberative feedback、learning signal 三大支柱
2026-09-01 30 篇 ★ 22 深度
- SHAPE of Chain-of-Thought in Math Reasoning
用语义空间与启发式分析数学CoT,发现启发式更能解释正确性且可通过多样化后训练提升推理
- Lost in Compression: A Controlled Cross-Lingual Audit of Extractive Prompt Compressors
英语训练的抽取式提示压缩器在非英语语言上大幅失效,安全压缩预算远小于英语
- DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents
构建交互状态转移图并识别关键拓扑断点,仅对恢复步骤做局部监督,提升多轮工具调用效率与泛化。
- Language Chain in Alignment: Cross-lingual Ranking Preference Optimization
将 Learning-to-Rank 引入跨语言偏好对齐,利用英语偏好知识提升目标语言一致性与质量
- EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnesses
提出 EvoUndo,将 witness 捕获、反事实验证、效应合约与分层恢复语言结合,使 LLM 自修改 harness 可验证回滚
- Content Exploration Beyond the Feed: Creator Supply and the Shared Corpus
用四项随机实验证明冷启动探索有显著创作者供给效应,但共享语料库效应在短窗口和单边 A/B 中被结构性抵消或不可识别
- CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents
将稀疏任务结果转化为动作级批判监督,训练小型 critic 与 policy,使 4B/8B 模型在重复运行可靠性上超过大模型
- The Language of the Question Selects the Market: Query Language and Exit IP as Separable Factors in Commercial Recommendations from a Generative Search Interface
控制实验表明查询语言决定是否出现本地供应商、出口IP决定哪个市场,二者相互独立;英语测量会系统漏掉本地竞争者
- Normalized Low-Rank Adaptation
NoRA 通过归一化 LoRA 下投影矩阵改善训练动态,无需额外参数或推理开销,加速收敛并缓解遗忘
- ICEGR: An Intent-Coherent End-to-End Generative Retrieval Framework for E-commerce Search
提出 ICEGR,通过意图感知 Semantic ID、合成查询增强 SFT 与相关性校准偏好优化,提升电商生成式检索的查询意图一致性
- Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence
提出奖励轴与经验轴的双维分析框架及 L0-L4 五级阶梯,系统阐述 LRM 在减少人工监督下的扩展路径与风险
- You Know What I Mean: A Benchmark for Agentic Conversational Reference Grounding
提出 CoRG 对话引用消解任务和 REPOREF 基准,最优 LLM 智能体仅 67% 成功率
- Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement
揭示 OPD 增益主要来自抑制低概率 token 而非教师蒸馏;提出零外部监督的熵自适应负优势法 OPSA,AIME24 Avg@32 提升 263%
- PaperGym: Rubric-Centered Evolution for Research-Plan Generation
把每篇论文拆成训练环境:问题来自目标/背景、标准来自方法/实验,用 rubric 做自蒸馏与 GRPO 奖励,显著降低泄漏并提升计划质量
- On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability
稀疏 MoE 联合优化效果、效率与训练稳定性,在约 1/9 训练 FLOPs 下追平前代旗舰
- Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents
执行前自动归纳任务专属评估准则,引导科研 Agent 执行并逐条验证修订,跨基准平均提升 2.08–16.8 分
- CAMIE: Co-Engagement-Aware Multimodal Item Embeddings for Snap Dynamic Product Ads Retrieval
用用户旅程中的共同参与对微调 LLM/MLLM 骨干,得到统一多模态商品嵌入并上线 Snap DPA
- Beyond Polarization: The Generative Constraint of Chain-of-Thought in Pointwise Reranking
实证表明 CoT 在逐点重排序中的性能差距跨尺度稳定且训练干预难以消除,根因是离散文本生成限制连续相关性信号
- Beyond Ranking Accuracy: Evaluating LLM-Cited Feature Rationales for Next Basket Repurchase Recommendation
提出跨模型特征掩码协议,证明 LLM 不适合作复购排序器但可作经验证的推荐解释层
- Learning from What You Retrieve: Online RL Fine-Tuning for Semantic Retrieval
提出 PAO,在冻结文档索引下只对正 advantage 样本做 RL 更新,避免 embedding 几何塌缩并提升检索效果
- Generative Retrieval for E-commerce: Jointly Learning Embedding and Codebook with Same Product Cluster
用同商品簇信息联合训练 embedding 与 codebook,消除两阶段误差累积,提升生成式电商检索召回
- E-SENS: Exclusion-Sensitive Penalization for Negative-Constraint Retrieval
训练无关重排方法 E-SENS,用陷阱查询相似度惩罚排除概念,减少否定敏感检索中的违规召回
- HF-SID: High-Fidelity Semantic IDs for Generative Retrieval in Location-Based Services
通过 3D 坐标编码、数值专用编码器与末层结构对比学习,在不增加 SID 长度下大幅提升 LBS 生成式检索的地理与业务指标
- Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering
将query粒度作为控制变量,用检索证据支持信号决定是否分解,构建依赖有序的查询树,在全语料多跳QA上显著超过图RAG与迭代检索
- Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval
提出 CHAP:层级语义对齐与双视图个性化生成式检索,单次解码加速,线上转化提升2.98%
- PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert
提出 Dense 锚定的低秩残差输入条件 MoE 插件,以零残差初始化保持原模型不变,缓解共享 Top-NN 子群梯度竞争并提升 CTR 精度
- RSLM: Training-Free Vector Quantization for Approximate Nearest Neighbor Search
训练自由的分块旋转量化方案,在1-4bit/维下保持召回,降低ANN索引内存与带宽
- SetMIR: Multi-Interest Retrieval as Set Prediction
用 Hungarian 一对一匹配 + presence 门控解决多兴趣召回的兴趣坍缩与固定 ANN 预算问题
- Reconciling Process Supervision with Outcome-Based Credit in Agentic Policy Optimization
TASPO 用轨迹对齐的特权信息在动作粒度重新分配 GRPO 结果优势,使过程监督不改变结果奖励方向
- Sycophantic Agreement Transfers with Neutral Data via Contrastive Preference Optimization
教师模型的谄媚性认同通过 DPO 等对比偏好目标从表面中性数据传递给学生模型,且信号弥散难以过滤
2026-08-31 30 篇 ★ 11 深度
- StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
4B步骤级agent安全护栏,通过prefix-aligned合成数据与Balance-GRPO在低误杀下将平均ASR降低77.3%
- Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models
提出 RLHEV 后训练范式,用游戏引擎可执行验证与人类隐式接受信号,为世界模型提供可奖励轨迹数据。
- J-Zero: Unified Challenger--Solver--Judge Co-Evolution from Zero Data
提出 J-Zero 统一 Challenger-Solver-Judge 协同进化框架,以对抗自对弈和已知偏好对在可验证/不可验证域持续提升 LLM
- PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
构建50场景基准评估11个视频生成系统,发现无一能稳定复现物理行为的参考概率分布
- ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL
提出 ContextPilot,扩展规划、长期记忆与软卸载工具,并用 context-aware partial rollout 与快照级信用分配训练 Agent,在 32K 窗口下超越更大上下文基线。
- Beyond the Vacuum: Combinatorial Strategy Selection for Competitor-Aware Generative Engine Optimization
用BOCS搜索竞争感知改写策略组合,再经DPO蒸馏为selector,在GEO基准上大幅超越agentic方法并抗竞争饱和
- Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge
构建ElephantBench知识探针,发现最强模型也仅能完整回忆52.4%的长尾分歧答案
- A Versioned Unified Graph Index for Dynamic Timestamp-Aware Nearest Neighbor Search
TiGER 用版本化统一图支持任意时间区间 ANN 查询,无需过滤或分段子图,QPS 提升 5 倍
- Rubric-to-Code Credit Assignment for Reinforcement Learning
将 rubric 级功能反馈转化为局部代码优化信号,替代 GRPO 的序列级统一 advantage,显著提升交互式网页生成成绩
- Stay Within Your Bounds: Distance-Guided Decoding for Guaranteed Context-Free Grammar Compliance
用基于下推自动机的有界摘要与距离上界做 lookahead 剪枝,保证 LLM 输出一定被目标 CFG 接受
- When Linguistic and Internal Confidence Diverge in Large Language Models
系统评估 30 个 LLM 的语言置信度与内部置信度在分类/生成任务上的关联、量级和校准分歧
- DARTS: Decoder-Aware Representation Tuning via Surgery for Model Merging
提出熵加权 L1 与逐位置偏置,解决解码器模型合并后的表征偏差累积问题
- HubMixer: Progressive Latent Hub Mixing for Parameter-Efficient Feature Interaction in Recommendation
用少量可学习 latent hubs 组织异构特征交互,参数更少、AUC 更高
- Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translation
系统比较顺序与并行采样在 LLM 机器翻译中的表现,揭示顺序采样在小预算下上限更高并解释其机制
- Parser States Already Know: Structure-Conditioned KV Persistence for Structured Generation
利用约束解码的解析器状态设计离线校准的 KV 持久化策略,大幅提升结构化生成在压缩推理下的可靠性
- Program Learning with Verifiable Rewards: Symbolic Backpropagation for Post-Training LLMs
提出PLVR,用符号反向传播从少量示例学习显式可验证程序,替代权重更新完成LLM后训练
- A Probabilistic Interpretation of KV Cache Eviction
将 KV cache 淘汰形式化为期望估计问题,提出可纠偏的概率淘汰与解码期校正
- Every Article Deserves a Video: Contextual Video Matching for Digital Publishers
用 LLM 与文本嵌入为文章自动匹配相关视频,已在 Dailymotion 生产环境规模化落地
- ITER: Interaction-Aware Retrieval for Agentic Search
提出交互感知检索器 ITER,用历史查询与轨迹相对监督提升 Agent 搜索证据发现
- PersonaForge: Realistic Multi-Turn User Simulation for Agentic Systems
构建 SOUL 驱动的真实多轮用户模拟器,从真实查询反向生成 6.3K 训练数据与 138 任务基准,显著提升 Agent 交互效率与任务完成率
- Timing-Aware Repurchase Prediction for Web-Scale E-Commerce: Survival Models for Multi-Surface Grocery Recommendation
用单个加速失效时间模型替代多时间窗口复购预测的多个二分类器,在提升排序的同时降低约3倍算力
- SymboLLM-FE: LLM-Accelerated Symbolic Regression for Automated Feature Engineering on Tabular Data
符号回归生成高相关公式,再用 LLM 一次性精炼解释,实现高性能且可解释的自动特征工程
- Deriving Scaling Laws for OpenEuroLLM Models: Learning Rate, Batch Size and Loss
系统研究 LLM 预训练中学习率与 batch size 的联合最优缩放及边际演化,并刻画损失对模型容量和数据规模的依赖
- Information-Guided Selective Modality-Interest Alignment for Multimodal Recommendation
提出信息论引导的 AMUR 框架,选择性对齐与用户兴趣相关的多模态语义并抑制噪声模态
- SG-UMP: Sequence-Guided Universal Multimodal Prioritization Calculation Framework
即插即用插件 SG-UMP,用模块组合器与模块路由器动态调整多模态处理顺序,适配用户偏好与数据集偏差
- Training Communication-Efficient Mixture-of-Experts Language Models with Layer Re-Configuration
减少 MoE 层数并用 Mamba-2 和密集 FFN 补深度,在匹配参数下降低专家并行通信和训练 GPU 小时 30-35%
- Learning to Use Tools: Reinforcement Learning for Tool-Integrated Mathematical Reasoning
在 Countdown 任务上证明工具调用与 RLVR 互补,Tool-DAPO 把 pass@1 从 35.8% 提升到 66.0%
- Blog: Survey of Optimizers
沿时间估计、更新几何、时间线管理、表示与系统四轴综述优化器,指出矩阵感知有效但无普适AdamW替代
- Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs
提出SHS-Index量化ViT注意力头的语义专业化,据此设计Ariadne混合注意力,以6.5倍更少注意力计算匹配全注意力性能。
- Agentic Artifact Creation: Systems, Evaluation, Principles, and Opportunities
综述智能体式工件创建系统,提出有状态构建、运行时验证与反馈重定向的原则
2026-08-30 30 篇 ★ 1 深度
- Super Star: Towards Streaming Real-time Interactive Agents for Digital Humans
提出因果多模态自回归模型与自进化数据闭环,实现数字人低延迟在线语音同步手势生成
- Adaptive Hierarchical Representation Alliance for Multimodal Learning
提出AHRA分层共享-私有专家框架,缓解跨模态语义粒度错配并提升噪音与缺失鲁棒性
- GameWAM: A World Action Model for Video Games
首个面向原生闭环游戏与GUI控制的世界-动作模型,联合生成未来视觉与键鼠动作,支持长程重规划
- Mind the Couch! Eliciting MLLM Reasoning in Interior Design via Weak-to-Strong Task Vector Injection
提出 DART-I,用弱专家提取空间/颜色先验生成任务向量,残差注入冻结 MLLM 以改善室内设计推理
- Skill Issue: Are Skills Language-Invariant in LLMs?
通过多语言自博弈文本游戏,量化同一LLM在不同语言接口下的技能差异
- Learning to Prefer Reliably: Error-Augmented Emotion Preference Optimization with Calibrated Fusion
通过错误增强负样本与多裁判边缘校准融合,提升多模态情感偏好判断的鲁棒性
- PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?
构建大规模双语多模态物理奥赛基准 PhysElite,含 11586 题;最强多模态模型答案准确率仅 33.7%,并提供步骤级过程评估。
- Task-disentangled Low-Rank Adaptation for Versatile Audio-visual Multi-modal Learning Tasks within a Unified Framework
用任务解耦 LoRA 在统一 LLM 框架中整合通用知识、任务特定模式与跨任务协作,缓解多任务干扰。
- Boot-and-Feedback Framework for Generalist-Expert Model Collaboration in Breast Ultrasound Diagnosis
提出 BooF 框架,通过 BI-RADS 引导 MLLM 生成可靠描述并反馈给视觉专家,提升诊断准确性与可解释性
- Data Citation for Large Language Models: A Challenge
提出 LLM 数据引用三方向:训练数据归因、推理时数据引用、知识图谱事实引用,与文档级引用 grounding 区分
- EditaLive! Unified Character Video Editing for Live Streaming
基于外观-运动解耦蒸馏为两步采样器,实现14.47 FPS低延迟直播角色视频编辑
- Are Concept Bottleneck Models Effective as Decision-Support Systems?
大规模用户研究验证CBM交互式概念修正仅在困难任务、易识别概念且主动交互下提升人机协同准确率
- Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning
提出 Agentic 框架结合 LLM 与 VLM,解决长视频多指令编辑中的跨镜头一致性、指令解耦与时空结构零破坏问题
- Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models
提出 MMI 基准和模态存在性得分 MPS,发现前沿多模态模型输出模态存在率仅 15.6-34.9
- BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing
首个系统性基准,评估 LLM Agent 从长期可穿戴信号预测心理健康得分并生成有理据解释的能力
- BTS-AgentBench: A Deterministic, Replayable Pipeline from Read-Only Telemetry Logs to Agent Benchmarks
从工业遥测日志构建可重放、零泄漏多轮 Agent 基准,精确复现 356/87/89 划分
- CODE: Cross-Modal Calibration and Dynamic Suppression for Open World Object Detection
提出推理时跨模态校准与动态抑制框架,在 OWOD 基准上 U-mAP/K-mAP 分别提升 2.6/2.3 点
- Ancient-Bench: A Comprehensive Multi-millennial, Multi-medium, and Multi-script Benchmark for Ancient Chinese Artifact Text Recognition
构建2700张古代中文文物图像基准,覆盖三千年文字演变、九类媒介与七种书体,评估VLM与OCR专家模型并揭示未解难题
- D2C-Routing: Dimension-to-Composition Evidence Routing for Mixed-Origin AI-Generated Text Detection
提出D2C-Routing,将内容与表达来源分维度路由再门控组合,显著提升混合AI文本检测
- Emotion Understanding in Streaming Video with Trajectory-Aware Reliability
提出轨迹感知可靠性框架 TRACE,基于流式信念的稳定性与切换模式选择性调用多模态重推理,优化在线情感理解的准确率-成本权衡
- Self-Reflective Multi-modal Reasoning for Short-Video Fake News Detection
SRM-FND 通过对比反思、迭代根因诊断与校正提示优化,提升短视频假新闻检测的可靠性与可解释性
- Which Metrics Save the Most Human Annotation? Prediction-Powered Evaluation and Meta-Evaluation
提出预测驱动评估框架,用少量人工标注结合大规模自动分数实现无偏系统比较,并定义PPSR元指标衡量指标降本效果
- Persona-Execution Separation: An Architecture Pattern for Evolving LLM Agents under Execution Audit
提出人格-执行分离(PES)架构,把 LLM Agent 的形象面与执行面分置不同信任域,以受治理契约桥兼顾自由演化与执行审计
- Retrieval Heads Meet Vision: Uncovering How VLMs Locate and Extract Visual Information
发现 VLMs 中稀疏且因果的视觉检索头,负责将文本描述 grounding 到图像区域
- Mitigating Strong-Modality Collapse in Multimodal Learning via Inverted Asymmetric Fusion
提出 Inverted Asymmetric Fusion,保留强模态通路并以弱模态蒸馏锚定融合,避免强模态退化
- ReViCo: Unveiling the Limitations of VLMs in Visual Text Understanding via Error Correction
提出 ReViCo 基准,以视觉文本纠错任务评估 VLM 对图像内文字及其视觉上下文的理解能力
- TraceBench: Controlled Evaluation of LLM Agents for Time-Series Root-Cause Attribution
提出 TraceBench 仿真基准,系统评估 LLM agent 在受控机械系统时序数据上的根因归因能力
- Do User-Authored Permission Policies Improve Protection Against AI Agent Overreach?
用户预设 allow/ask/never 规则反而比逐动作审批和模型审查放过更多越权动作,主因是用户大量选 ask
- Prediction of Prediction (PoP): Inter-Layer Activation Fusion for Single-Pass Hallucination Detection in Large Language Models
提出PoP机制,融合跨层隐藏状态捕获层转移不确定性,在单次前向中检测LLM事实错误
- Direct or Mediated? Task-Dependent Audio Information Routing in Large Audio Language Models
用逐层注意力 knockout 揭示 LALM 中 ASR 与 AQA 的信息路由差异,指出音频拼接下 AQA 失败源于下游信息利用瓶颈
2026-08-29 30 篇 ★ 6 深度
- FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modeling
提出 check-before-score 清单驱动框架,构建 90K 训练数据和基准,8B 奖励模型在 VBench 上 Best-of-8 采样达最优
- GUI-Primitives: Diagnosing Spatial Reasoning Failures in Vision-Language GUI Grounding
构建对比指令对基准,解耦候选定位与关系理解,揭示 VLM 在 GUI 元素定位的主要瓶颈是候选定位而非空间关系推理
- Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
JoyAI-Echo-1.5 用跨镜头记忆与 6-DoF 几何控制实现角色持久和交互世界,并以 Self-Gradient Forcing 训练因果生成器
- Unsupervised Post-Training of Foundation Models: A Survey
系统梳理80种无监督后训练方法,按内部信号来源分类并提出Input Visibility×Update Persistence统一框架
- Video-IFBench: Evaluating Instruction Following of Multimodal LLMs in Video Understanding Scenarios
提出Video-IFBench,系统评估视频理解中MLLMs的指令遵循能力,含1500样本和39类约束
- V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning
将参考答案分解为原子命题,从视觉忠实、推理一致、指令遵循三方面给结构化rubric奖励,提升VLM多模态后训练
- VGI-Bench: Probing Visual Intelligence in Video Generation Models
构建27任务810实例的VGI-Bench基准,评估视频生成模型零样本视觉推理,最强模型仅51.0%准确率
- VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction
双脑流式记忆:左脑管信息、右脑管情感人格,top-5 检索 134ms 达到实时语音交互记忆 SOTA
- Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning
提出闭环诊断框架 Aphanta,量化图像编辑中间产物在多模态推理中的任务条件化增益与边界
- Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval
提出训练-free 的 CRISP 评分,抑制无用 patch 并加入双向对齐,显著提升病例到流程图检索
- CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure Modes
用同家族弱模型失败模式构建离线批判库,推理时按失败模式检索注入大模型,单次生成匹配多次采样性能
- Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG
证据感知检索信号会改变排序,但不总能改进训练、系统选择或答案质量预测
- Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
提出无需任务专属教师的在线策略蒸馏框架,将学生自探索转为逐步监督,超越现有 RL 与 OPD 方法
- UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City
提出香港真实3D城市沙盒UrbanGround,系统性评估MLLM智能体从局部视觉感知到持续导航行动的可靠性
- Importance Scoring of Transformer Attention Heads in Learning Tabular Data
首次将注意力头重要性评分用于表格 Transformer,72.5% 实验中移除最低重要性头最稳健
- Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting
区分块草稿的固有信息损失与草稿器模型差距,量化短程条件可消除的上限损失
- Circuit Condensation: Post-Training that Concentrates a Behavior's Causal Circuit
后训练低秩适配器逐轮剪枝低归因边,将行为压缩为更小且保真的因果电路
- Verify Smarter, Evolve Further: Efficient Harness Evolution through Behavior-Aware Verification
提出预算感知的 HARNESSLENS 框架,用行为相关任务和可归因证据门控筛选候选修改,显著提升 harness 进化样本效率
- CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases
提出企业级文档问答基准CorporateBench,用230k+文档与时序知识库保证跨文档一致性,揭示LLM长上下文性能下降
- LeVJEPA: Efficient & Scalable Video Pretraining without the Heuristics
首个在 LeJEPA 无坍塌目标下训练的视频编码器,用 token dropping 与 block-causal attention 大幅降低预训练算力
- LLMs Can Design Near-Optimal OR Algorithms
未微调的 frontier LLM 在库存、排队网络、品类优化上生成算法,匹配或超过现有专用方法
- misi: a Metric Inverted Sample Index
用数据库随机样本作为词汇表构建近似最近邻倒排索引,构建快且省内存,查询吞吐弱于图索引
- PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference
训练无关的VLM推理加速框架,通过像素自适应压缩和动态双注意力提取,仅用10%视觉token保留93.8%性能,TTFT加速3.1倍
- Naive Prompt Optimization: Rethinking the Need for Complex Prompt Search
提出单谱系迭代的提示词优化方法NPO,用强教师模型结合轨迹反馈,以更少rollout达到或超越复杂搜索方法GEPA
- Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms
系统对比 Merge、Mix RL、MOPD,发现跨域关系决定性能,融合仅重排已有解不扩覆盖
- STAR : Sentence Translation Alignment Rate for Document-to-Document Machine Translation
提出 STAR 结构对齐指标与 StarPO 偏好优化,使紧凑模型在 Doc2Doc 翻译中超过 GPT-4o 且更省 token
- Calibrated Enough to Know, Not Calibrated to Act: Fabricated Evidence Makes LLM Agents Commit to the Unknowable
专业外观的市场面板大幅提升 LLM Agent 对不可预测问题的承诺率,定位为行动门控失效且可通过 SFT 修复
- When Does Supervised Fine-Tuning Reduce Instruction Sensitivity?
SFT对指令敏感性的影响随模型规模、训练指令和评估协议变化,不一定降低鲁棒性
- How Language Models Organize and Structure Moral Knowledge
用六个线性探针揭示 LLM 中道德基础方向既共享正向共同成分又张成近最大独立维度,且困境方向可部分由基础方向组合
- Compositional Online Learning for Semantic Data Processing Systems
在 LLM 调用边界组合多个在线学习组件,将训练更新隐藏在慢速 LLM 往返中,优化语义数据查询成本
2026-08-28 30 篇 ★ 17 深度
- D^3-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation
提出零开销动态调度器,复用每领域reverse-KL信号在线调整多教师蒸馏的数据混合比例,大幅提升收敛效率与性能
- FrontierChallenge: Evaluating Scientific Workflow Completion
提出跨领域科学工作流基准,揭示高部分得分与置信完成声明均不保证端到端交付
- WarpSAC: Towards the Pinnacle of Scalable Off-policy RL by Rethinking Exploration and Exploitation
提出数据范式感知的离线强化学习算法 WarpSAC,根据数据丰富度动态调整稳定器配置,大幅提升大规模并行训练性能
- CaSKG: Counterfactual-Causal Skill Graphs for Scalable Agent Skill Retrieval
用反事实因果探针校准技能图边置信度,在六模型两基准上全面超越 GoS 等检索基线
- TTPO: Test-Time Policy Optimization
多数投票伪标签下,正样本蒸馏、负样本GRPO惩罚,配合token级选择,无标签测试时训练匹配有监督OPSD
- Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO
系统分析 ES 与 GRPO 的推理后训练行为,发现 ES 保持更广推理覆盖、提升 Pass@K,大参数漂移不必然导致灾难性遗忘
- PILOT in the Loop: Live Self-Improvement for Long-Horizon Agents
提出 supervisor-worker 架构,通过 live steering 与 live self-evolution 实现长程智能体实时自我改进,显著提升成功率与 token 效率
- What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
提出 ACE 框架(准确性-复杂度-多样性)统一评估和设计 LLM 智能体的交互数据生成
- PUMA: Post-Hoc Sparsification of Universal Multimodal Embeddings for Efficient Retrieval
用稀疏自编码器将通用多模态嵌入事后转化为紧凑稀疏码,不重训骨干,存储降 8-16 倍、检索最高加速 25 倍
- WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
提出 WikiSkill 框架,通过持久 wiki 知识层将 Agent 执行经验持续沉淀为可复用模式,显著提升技能进化效果与跨模型迁移性。
- Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scale
用可学习深度哈希生成短候选列表,结合加密重排与不经意传输,在保持检索质量的同时将全库密码学搜索成本降至可部署水平
- Astar: Learning to Propose Evolution Directions for Self-Evolving Industrial AI Systems
训练专用模型从历史实验日志中学习提出有效进化方向,在 Lazada 广告召回上超越人类专家与 GPT-5.5
- Beyond a Single Story: Meta-Reviewing Sparse and Incomplete User-generated Contents for Recommendation
聚合邻居评论构建元评论,通过 MMoE 与个性化注意力缓解 UGC 稀疏性,提升评分预测与解释质量
- Scaling Graph Neural Networks for Friend Recommendation: Multi-Hash User Embeddings and Temporal Neighbor Sampling
用多哈希嵌入压缩98% ID表、以timestamp-sorted CSR+二分搜索加速时序邻居采样,线上好友添加提升16%
- When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systems
用 LightGCN 协同状态作为 LLM Agent 持久记忆,通过对比对齐和掩码 listwise 协同训练让模型学会读取向量记忆,在 4 个指令推荐基准上超过文本记忆 Agent 且零额外维护调用
- Incremental Recommendation via Causal Models
利用已有 holdback 数据扩展生产推荐模型为因果双头模型,以双阈值策略减少 7% 曝光且不损消费
- Difference-in-Differences on a Censored Rating Scale Can Manufacture an Effect: Evidence from a Pre-Registered LLM-Judge Audit
揭示 LLM 法官审计中双重差分在 bounded 评分量表上无法识别偏差,显著交互可能纯由截断衰减制造
- Preference Flow Matching with Spectral Factorization for Micro-video Recommendation
用频谱分解将帧级视频表示解耦为静态与动态因子,并以条件流匹配建模偏好转移
- PailitaoGR: Latent Think-with-Images for Generative Image Retrieval
在原始查询图上内化目标聚焦与选择性辅助证据利用,实现不裁剪缩放与不 OCR 阅读,生成式检索平均提升 13.8%
- ProRetrieval: Learning to Orchestrate Hybrid Search via Executable Program Synthesis
将LLM训练为检索编排器,生成SQL+向量原语的DSL程序,4B模型在电商/邮件Hit@1超越GPT-5.5
- Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090
开源低成本预训练 recipe:RTX 5090 + FP8 + MuonH + 课程平均,约 $6.9K 训出接近 Qwen2.5-1.5B 的 2B 模型
- RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution
将攻击轨迹蒸馏为可读技能,并用验证棘轮做候选更新,提升黑盒 Agent 攻击效果与工具效率
- Boosting LLM Exploration via Weak-Model Guidance in RLVR
用弱模型生成部分推理前缀,强制主模型续写陌生路径,缓解 RLVR 熵坍塌并提升 pass@k
- Stageboost: Recommending Signals Based on Counterfactual Estimation
eBay利用两阶段XGBoost反事实估计在商品详情页优化信号展示,GMB提升0.08%
- SWE-Prime: Fewer Trajectories, Better Performance
提出多粒度两阶段SFT数据筛选,轨迹级选10%高质量子集并片段级屏蔽损失,训练效果超全量数据
- Token-Level Advertising
提出 LAMA 将广告主影响直接嵌入 token 级生成过程,满足 Markov DSIC/IR 且近最优 KL 正则化福利
- Topology-Masked Unified Backbone for Joint Feature Interaction and Multi-Domain Sequence Modeling
用结构化TopoMask注意力在同一token空间内显式路由特征交互与多域序列信息流
- Equal Ranking Quality, Different Decisions: Training Order-Consistent LLM Scorers
提出 OC-SFT 顺序一致性训练,在不损失排序质量下显著提升 LLM 打分器在重排、QA、偏好选择中的决策稳定性
- Stochastic Estimation of Transduced Language Models
提出无放回重采样校正的beam-summing估计器,对TLM目标前缀概率给出无偏估计并大幅降低长序列推理时间
- Conversational Recommendation over Live E-Commerce Catalogues with Self-Refreshing Retrieval
提出自刷新检索器,用stable ID与双哈希只重嵌入新增/语义变化商品,将实时目录增量同步到向量索引,支撑低成本WhatsApp对话购物助手
2026-08-27 30 篇 ★ 20 深度
- Agent-G^2: Gaussian Guidance for Agentic Reinforcement Learning
用在线估计的高斯分布动态采样每个任务的专家轨迹引导深度,替代固定或逐样本探测,显著降低 rollout 成本并提升 Agent RL 效果
- AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces
将 Agent Harness 优化形式化为离线学习,通过深度诊断、结构化 Patch 与泛化感知选择,在三个基准上提升 9-10 个百分点
- Automata from Agent Traces: Failure and Next-Step Prediction
用紧凑确定性 FSM 统一 LLM Agent 的工作流记忆、下一步预测、失败预测与运行时监控
- Autonomous Mathematical Discovery in an Open-World Multi-Agent Environment
在无中心协调的多智能体开放环境中,AI 智能体自主协作完成多项数学发现并产出可解释定理与分析
- MARS: Multi-Specialist LLM Relay System for Competitive Programming
MARS 用主题专家接力+RAG 检索算法理论,在 CodeContests 以 3.3 倍更低成本逼近 CodeSIM
- Is Next-Chunk Reasoning RL Really Better than SFT? Revisiting Training Strategies under no-CoT Data
同一RLVR预算下,单阶段混合no-CoT与long-CoT的SFT比next-chunk reasoning RL效果更好且省60倍以上算力
- Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments
提出AnTrap基准系统注入动态对抗扰动,揭示GUI Agent普遍脆弱并区分可学习与推理瓶颈异常
- MemUse: Moving Memory Evaluation from Direct QA to Natural Integration in Long-Term Human-AI Conversation
发现直接问答记忆准确率与用户满意度无关,提出自然整合评估基准 MemUse,揭示 71 点巨大差距
- On-policy Distillation with Verifiable Reward
对采样 token OPD 的 log-ratio 奖励做 ReLU 门控,使教师信号与轨迹正确性对齐,零超参结合 OPD 与 RLVR
- The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents
首次系统研究 LLM Agent 中途切换模型时非原生轨迹对成本-质量权衡的影响,发现升级昂贵、降级更优
- Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation in Transformers
用门控循环共享核心层,在固定算力或参数预算下达到甚至超越稠密Transformer质量,大幅减少参数与解码内存
- Rubrics as Visual-Repair Context for Self-Evolving UI-to-Code Generation
提出 RubSE,用结构化 rubric 引导视觉修复,解决 UI-to-code 自演化中局部修复相互耦合导致轨迹不稳定的问题
- Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs
用VLM共识标签蒸馏轻量交叉编码器,并把困难尾部升级给自托管Agentic VLM,实现按难度路由的商品链接
- JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution
训练 27B 元模型按任务即时生成/修复/演化 agent harness,使普通骨干模型超越更强基线与固定运行时
- RetrievalRouter: Joint Modality and Architecture Selection for Document Retrieval
轻量 query-aware 路由仅凭查询文本选择最优检索管道,在精度和延迟上同时超越静态基线
- SWIM: Step-Wise Integrated Measure for Session-supervised List Evaluation in Generative Re-ranking
将重排 list 评估建模为有限时域生存过程,用因果 Transformer 并行估计 continuation 与 reward
- Query Expansion Is More Than Generation: Improving Dense Retrieval through Better Integration
将原查询与 LLM 扩展分别编码后做向量插值,并用无监督前缀估计扩展信任度,单向量提升稠密检索
- CRAMER: Control via Request-Aware Masking for Editing Recommenders
用稀疏行-列参数掩码将自然语言请求即时作用于冻结的序列推荐骨干,避免重训与 LLM 推理开销
- D3ER: Supporting Multi-Modal Recommendation via Disentangle and Distillation-based Dynamic Ensemble
首次将梯度提升引入多模态推荐,交替学习模态同质与异质判别信息,并以知识蒸馏和全局校正正则增强集成
- DCEO: Direct Causal Effect Optimization for Long-Term User Value Modeling in E-commerce Search
用 actor-critic 直接优化代理指标对长期 GMV 的相对因果效应,学习个性化 item 级融合分数
- Candidate supply and answer selection shape the value of LLM judging in multi-agent systems
将多智能体推理拆成生成-交流-终选,证明 LLM 评委价值随候选正确率、任务和生成器变化,混合频率与排名可救回少数正确答案
- Unfolding Scientific Papers into Multi-Turn Generation Trajectories for Continued Pre-Training
把 arXiv 论文展开为“写作请求→全局计划→逐节思考→正文”多轮轨迹,构建 60B token CPT 语料,提升写作与长文阅读
- LivingRAG: Augmenting Graph RAG with Experience
提出可写经验存储的 Graph RAG 框架,复用激活图和推理摘要,在多跳 QA 上提精度并降生成 token
- MOTIF: Motivation-guided Topology Inference for Cold-start Multimodal Recommendation
用离线 LLM 推理用户与商品动机,重建 item-item 图并做加权对比学习,显著提升冷启动多模态推荐
- ProgRouter: Online Progress-Guided Orchestration for Multi-Agent LLM Workflows under Quality-Cost Tradeoffs
面向多智能体 LLM 工作流,提出在线进度引导路由,逐步选择大小模型以在预算内保持任务质量
- Prefix Sliding for efficient test-time scaling
保留前缀与最近滑动窗口、丢弃中间推理 token,实现恒定成本的长程推理,无训练 3 倍加速
- ReliableRAG: Combating Misinformation in Retrieval-Augmented Generation via Reliability-Guided Reasoning Chains
首个面向多跳QA的可靠性驱动RAG框架,通过细粒度三元组评估与推理链生成对抗欺骗性错误信息
- An Event is Worth One Token: Event Tokenization for Industrial-scale LLM Recommendation
将每个用户交互事件压缩为单个Event Token并异步缓存,在不增加在线特征物化成本的前提下提升LLM推荐的快照分辨率
- TransRetrieval: Scaling Up Transformer-Based Retrieval for Industrial Recommendation
通过加权平均聚合、目标 token 压缩与位置式域嵌入,让 Transformer 召回实现 log-linear scaling
- Hamiltonian Spectral-Temporal Dissipative Dynamics for Sequential Recommendation
将用户偏好演化建模为耗散哈密顿系统,用频域谱传播与动量外推提升序列推荐
2026-08-26 30 篇 ★ 24 深度
- UniSpace: Unified Visual Representation and Scalable Multimodal Modeling
提出 Patch Reparameterization,使冻结语义 ViT 同时支持理解、生成与编辑,并扩展为 8B MoE 统一模型
- ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction
提出策略条件化 rollout 分组的 ARC 方法,消除跨策略奖励偏差,提升 agent 工具调用 RL 训练的公平性与稳定性。
- LongRCA Bench: Diagnosing Responsible Roles and Root Causes in Long-Horizon Agent Failures
提出 LongRCA Bench 与训练无关的 RCTA 方法,将长轨迹 Agent 失败归因提升至 24.1% 精确根因步准确率
- TileMix: Tile-Centric Mixed-Precision Attention for LLM Inference Acceleration
通过 tile 分组路由 FP16/INT8 注意力计算,在保留 dense 连接的同时加速长上下文 prefill 并恢复质量
- Beyond Imitation: Filtering On-Policy Distillation by Reasoning Progress
提出 R2-OPD,用独立过程奖励检测并过滤在线蒸馏中与推理进展冲突的教师信号
- One Success Isn't Reliability: Thinkingbox, a Sandbox and Benchmark for Agents in Stateful Business Workflows
提出可执行的状态副作用检查沙盒 Thinkingbox,发现最强模型 pass@1 仅 65.36%,且全部 20 次成功仅 25.25%
- EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking
将多模态图像重排建模为语义约束满足,解析查询为结构化证据包并做证据条件验证,SOTA 且可蒸馏
- TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming
面向电商直播的全模态理解模型,通过三阶段监督训练和 Faithful-RFT 强化微调,实现长时多模态流的准确实时理解
- Apodex 1.1: Scaling Agentic Intelligence for Complex Work
以可验证交付为单位,通过环境扩展和可交互自组织 Agent Team 在小模型上逼近前沿长程任务能力
- Beyond the Stability-Exploration Dilemma: Environmental Regularization for LLM Policy Optimization
提出 ERPO,将 KL 正则从输出侧移到输入 query 分布侧,在保持探索的同时控制训练环境漂移
- LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks
提出 LongWoF-Bench,证明由 verifier 确认轨迹蒸馏的 EvoMap Gene 比 Skill 跨七个模型提升 8.7–15.5 个百分点
- MobilePA-Bench: Benchmarking Mobile Planner Agents on Complex Real-World Tasks
提出有状态、工具中心的移动规划代理基准,覆盖工具调用、子代理协作、记忆与技能四维能力
- Same Agent, Different Answers: A Repeat-Aware Audit of Corpus-Induced Answer Churn in Retrieval-Augmented QA
提出Snapshot Compatibility Audit,用同快照重复分歧校正跨快照差异,量化RAG索引更新导致的答案漂移
- AdaWidth: Query-Adaptive Embedding Width for Dense Retrieval
正交前缀适配器加查询路由器,在共享前缀下按查询分配嵌入宽度,匹配 SOTA 且维度减少 55%-84%
- CAFE: Self-Improving Search Agents Need Co-Evolving Feedback
提出 CAFE 框架,共享参数模型交替扮演搜索 agent 与 critic,通过在线反馈奖励整形与离线偏好优化让反馈随策略协同进化
- Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses
Recuris 用工作记忆驱动技能调用,将失败定位到记忆组件并验证门控演化,在长程任务上提升成功率
- Meta^n: Recursive Self-Improvement through Emergent Depth
固定元操作 Ω 并递归应用于输入,实现可收敛深度的 LLM 自我改进,在 ARC-AGI-2 唯一得正分
- RetrievalFormer: A Dual-Encoder Transformer for Efficient Approximate Nearest Neighbor Retrieval and Cold-Item Recommendation
量化双塔架构在统一搜索推荐索引中的推荐侧损失与冷启动收益,揭示训练目标的质量-规模权衡
- Knowing When to Ask for Help: Bayesian Self-Escalation in Hierarchical LLM Agents
把生成中途的模型求助建模为基于能力后验的最优停止问题,证明阈值策略并给出校准驱动的后悔界
- CodeHID: Learning an Addressable Hierarchical Code Index for Generative Code Retrieval
将代码检索重构为层级语义 DocID 生成,以 kNN 伪标签学习前缀语义结构,并在训练与推理侧联合引导路径选择。
- Native Multimodal Representation Learning for Click-Through Rate Prediction in E-Commerce Scenarios
提出 Mine-Then-Train:从 CTR 数据挖掘可解释三元组微调多模态编码器,在线 CTR 提升 1.5%
- EviGraph: Towards Verifiable Evidence Construction for Information-Seeking Agents
将智能体网络搜索重构为可验证证据图构建,以共享策略分离搜索与证据记录,用稠密过程奖励直接监督证据基础
- RecGPT-Mobile-V2 Technical Report
面向端侧个性化 Query 预测,提出质量门控自适应推理与压缩部署的端到端框架。
- SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents
让 LLM Agent 通过显式技能调用和基于证据的验证,在 RL 训练中持续积累并修正可复用技能
- StarHarness: Evolving Harnesses with Stratified Search for Enterprise Environments
提出 StarHarness,在冻结模型下分层搜索演化 Agent harness,企业基准提升 20-35pp 并可跨模型迁移
- TAGR: Temporally Adaptive Generative Recommendation for Industrial Live-Streaming Advertising
动态LSID、多尺度意图建模与间歇性在线策略偏好优化,使直播广告生成式推荐收入提升16.1%
- Tlow: Flow-based Item Tokenizer for Recommendation
用 normalizing flow 将物品语义嵌入转换为维度独立、标准正态的 latent,再做并行 PQ 分词,显著提升生成式推荐的语义 ID 质量与冷启动表现
- WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report
2B/4B/9B 通用多模态 embedding 家族,两阶段训练与蒸馏在 MMEB-v2 达 80.6 SOTA,并大规模落地微信推荐搜索
- Evidence Blindness in Direct Corpus Interaction: Persistent Navigation with AtlasNav
提出 Evidence Blindness 四阶段诊断,并用持久化多视图语料图谱 AtlasNav 把有限预算的 agentic search 从反复探索转为可复用导航
- Rethinking Semantic Alignment in LLM-Enhanced Collaborative Filtering: A Spectral Decoupling Approach
发现 LLM 语义中的非主奇异分量对推荐有用,而对齐会抑制这些分量;提出无参数预测层解耦融合 UniSpecRec
2026-08-25 30 篇 ★ 21 深度
- Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models
控制实验发现OPD迁移教师推理行为而非答案,同源教师跨域泛化强但使多教师路由出现跷跷板效应
- ParaTempo: Efficient Parallel Reasoning via Temporal Confidence
无需训练的异步并行推理框架,用时序置信度驱动分支剪枝/早退/分叉/投票停止,降延迟 21.8-32.2%、token 18.1-30.3% 且精度持平
- Partition the Support, Reconstruct the Residual: Training-Free Sparse Attention for Video Generation and World Models
训练-free稀疏注意力,通过响应耦合分区与探针拟合残差重构,在视频生成和世界模型中保持质量并加速1.48-2.61倍
- AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale
提出从高层业务场景自动合成可执行世界,作为策略强化学习训练基底,并证明环境构建本身可学习
- PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration
引入物理信息探索层与双智能体设计,以更少交互估计物体质量与刚度,提升主动感知效率
- GRAFT: Graph-Distilled Generative Retrieval for Facet-Aware Scientific Literature Exploration
将多维 facet 论文关系图蒸馏进生成式检索器,用 coverage-aware 蒸馏与 graph-RRF 保留覆盖和归因,免索引推理
- The Compaction Cliff in Long-Running AI Agent Memory
提出 Knowledge Triage 框架,通过分类与确定性算子避免安全规则在长上下文压缩中快速丢失
- Hypergraph Embedding Indexing for Efficient Dense Vector Retrieval
HEI 按高激活潜维度组合组织文档,用倒排索引生成候选并保留语义排序
- Multi-Modal Semantic Expansion with Constrained LLM Reranking for Conversational Music Recommendation
三阶段多模态检索+轻量重排+LLM persona生成,融合7路embedding与BM25,Blind B综合0.3213,发现LLM注入仅在窄范围有效
- FashionKG-RAG: Knowledge Graph-Enhanced Retrieval-Augmented Generation for Fashion Question Answering
构建领域级时尚知识图谱 FashionEcoKG,并设计训练无关的 PG-RAG 框架,通过双粒度路径重排提升时尚问答准确率
- Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing
将 Agent 能力发现重构为离线丰富+在线检索-重排,在 7,278 个工具上以约一半成本领先 Search&Pick 6.5pp,并比全量上下文便宜 70 倍
- Risk-Aware Reranking for Agentic Tool Retrieval
提出轻量双头重排序框架,在保持相关性的同时通过可调风险惩罚和规则过滤降低高风险工具暴露
- Cascading Relevance-driven Recommendation Network for CTR Prediction in Trigger-Introduced Recommendation
提出CRRN,通过trigger-target交互门控、级联注意力融合与类别辅助pairwise loss,在TIR场景显著提升CTR
- A Dual-Expert Strategy Integrating LLMs to Mitigate Negative Transfer in Cross-Domain Sequential Recommendation
提出 DuELRec,用域门控双专家与双采样对比学习抑制 LLMRec 跨域负迁移
- The Interaction Tax: When Communication Erases Diversity in Multi-Agent Teams
完整方案交换会让异构模型解在一轮内趋同并抹掉多样性,独立生成与可定位修复的 critique 才更有效
- SkillAlchemy: Open-World Agent Skill Creation
提出基于证据准入的框架,从开放世界材料自动创建可复用 Agent 技能,性能接近人工策划
- Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation
在离散扩散生成式推荐中注入物品共现先验与自适应噪声重调度,显著提升协作结构建模与召回精度
- The Emergence of Relevance Through Axiomatic Attention Patterns During LoRA Fine-Tuning
用 keep/omit 消融定位 RankLLaMA 中 LoRA 注意力更新关键层,并发现其与罕见词敏感、query-doc 交互等公理化注意力模式强相关
- MediSkill-Evo: Process-Constrained Self-Evolution for Evidence-Grounded Clinical Interaction
用四库分离的自进化记忆与过程约束偏好控制,提升临床交互的证据获取与安全决策。
- The Disconnect Between Better Descriptive Reasoning Trace Quality and Recommendation Effectiveness
在生成式推荐中,更好的描述性推理 trace 质量并不必然带来更好的传统离线推荐效果
- Prime Agent: A Self-Improving RLM Harness
开源长程 Agent 执行框架,通过持久 REPL、递归子代理与 Continual Harness 将 ARC-AGI-3 从 30% 提升至 95.5%
- How to Train a Critic Stably and Efficiently
BPCO 通过值域约束、MC 目标、去标准化等配方稳定单 rollout critic,性能匹配或超过 group 基线
- The Laws of Context Allocation: Causal Measurement and Closed-Loop Orchestration in Generative Search
用因果探针揭示标准相关性代理在困难负样本上失效,并证明窄上下文多轮生成比宽上下文单轮带来16.8-20.5个百分点的组合召回增益
- Rethinking Item Tokenization in Generative Recommenders: From Fixed Atoms to Semantic Subwords
提出 SST:历史侧用变长语义子词压缩 SID、目标侧保留定长解码,缓解 intra-item 注意力过载并稳定提升生成式推荐
- Towards a Densing Law for User Representation Learning at Billion-Scale Capacity
提出用户行为 Densing Law,量化最小充分 tokenization 容量随数据规模幂律增长,并用 RQ-VAE 与自适应分配突破 raw scaling wall
- Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner
冻结多模态大模型配外部双粒度记忆,用 Shapley 归因优化规则检索,提升科学推理基准
- WARP: Wasserstein-Aligned RAG for Population Opinions
用 Wasserstein 距离校准 RAG 检索证据的情感分布,避免少数意见被淹没
- Evaluating Modern RAG: Textual, Multimodal, Dense, and Late Interaction Pipelines
提出数据驱动的RAG管道选择方法,在检索效果与资源约束间权衡
- Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction
修复EGMN方差坍塌与组件冗余,通过层级skip-watch分解和KL方差正则提升排序与完播预测,工业A/B显著提升session depth
- MetaCaster: Meta-Harness-Optimized Agent for End-to-End Few-Shot Learning of Lightweight Time Series Forecasters
用多智能体生成数据+元优化harness,从少量样本训练轻量时间序列预测器
2026-08-24 30 篇 ★ 13 深度
- Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs
提出 PatternEval 诊断基准与 PatternRL 训练框架,缓解混合思考 MLLM 思考/非思考模式响应行为失配
- EXIMO: VLM Guided Exploration of VLA Policies
提出三阶段(探索-模仿-优化)VLA 微调算法,用 VLM 规划分解任务并配合 residual off-policy RL,显著提升样本效率
- HARP: Hierarchical Adaptive Ranking with Preference-Adaptive Fusion for Query-Based CVE Prioritization
利用历史标注样本隐式捕捉组织偏好,通过图证据与多视图LLM融合对CVE进行查询驱动排序
- CLEAR: Continuous Latent Adapter Routing for Utility-Preserving LLM Safety Alignment
用轻量隐状态门控连续控制安全 LoRA 激活,在降低有害输出的同时保留基座效用
- Llama-Mobile: Efficient 2.7-Bit Quantization of VLMs
提出无需原始训练数据的 VLM 量化 pipeline 与 S3D8 2.7-bit 格式,将 Llama 3.2 11B 压缩至 3.7GB 并保持 VQA 性能
- AUSO: Action-Level Unified Skill Optimization from Internalization to Utilization
用 JSD 度量技能对策略动作分布的影响,以动作级信号重加权 GRPO,将技能从外部监督渐进转为按动作收益利用,提升 Agent 泛化
- From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation
单层大语义码本替代多层残差量化结合曝光感知动态更新,缩短SID并提升生成式推荐效果与吞吐
- EnSI-RAG: Entity-Structure-Indexed Retrieval-Augmented Generation for Long-Document Question Answering
用实体中心 passage 和 entity-structure index 做检索句柄,把证据定位与答案生成解耦,提升长文档 QA 精度
- ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction
双智能体将嘈杂网络证据蒸馏为结构化事实记忆,并用双轨经验自进化提升预测校准
- Utility Under Attack: Agent Memory Poisoning and the Limits of Content Screening and Provenance Ranking
1.2%记忆投毒使LongMemEval准确率从0.850降至0.300,内容筛查拦截0/360,溯源加权排序难用
- Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning
提出训练无关的记忆增强压缩框架,用历史推理模式作为预填充支架补偿思维链压缩的信息损失
- Causal Modeling of Adverse Pregnancy Outcomes via Adaptive LLM Proposals
将 LLM 作为自适应提议分布,按数据评分迭代生成因果图,恢复全部专家边并发现新边
- Distilling Black-Box Machine Learning into a Small, Self-Explaining Language Model for Learning Analytics
提出两阶段微调管线,把黑盒估计器及其事后解释蒸馏进小型开源 LLM,实现离线个体级预测与自然语言解释
- Trustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems
用 NLI 与加权中毒信号构建生成前评估代理,Trust Index 在 TruthfulQA 上达 91% 准确率和 100% 精确率
- Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs
提出 Quantization-Aware Healing (QAH),从原始未压缩模型直接蒸馏到4-bit量化学生,比 QAT 更快更稳,并开源 Hypernova-60B
- Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence
系统梳理用图结构组织任务、代理与运行时状态的多智能体图工程范式,为复杂 Agent 系统提供统一抽象
- Target-Aware Calibration Data Selection for Preserving Uncertainty in Quantized Language Models
提出 DPQ 配方族,用全精度预测选择高不确定样本与通用锚点构建目标对齐的量化校准集,保持不确定性行为。
- RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation
提出摄取时语义编译 ISC,将语料编译为带验证来源的原子声明,查询时读取成本降低约21倍且准确率更高
- RARE: Decoupling Representation Steering from Expert Routing in Mixture-of-Experts Language Models
将行为扰动投影到路由器矩阵零空间,保持 MoE 路由一致,提升表示工程的控制效果与效用保留
- Towards Faithful Simulation of Human Shopping Behavior
提出融合三级认知记忆与轨迹级 RL 的 GUI 用户仿真 Agent,显著提升行为保真与意图一致性
- Profiling What Matters: Context-Aware Item Profiles from Large-Scale Metadata for LLM Recommenders
CAIRO 将物品元数据与评论结构化为客观特征和主观特质,用轻量选择器按用户上下文生成个性化画像,显著提升 LLM 重排效果
- SPARCL: Spectral Partitioned Analytic Continual Learning
识别解析持续学习中的谱干扰问题,通过冻结高能核心子空间并在残差块上递归最小二乘更新,实现闭环解与旧类 logits 核心贡献不变性
- TreeWY: Speculative Verification for Gated DeltaNet Hybrids
用树结构 WY 变换消除 GDN 投机验证的逐节点状态快照,单次三角求解验证整棵草案树并只重建接受态
- Event-Time Confounding Under Bursty Human Dynamics
揭示行为日志中用户自选事件时间导致的片段选择偏差,并提供诊断协议与审计工具
- Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
Netflix 850万用户holdback实验发现推荐算法进步使消费从超级头部转向中腰部,总参与度提升
- One Hierarchy, Two Systems: Semantic Product IDs for Discovery-Surface Ranking and Search-Page Query Reformulation
一次性构建的分层语义商品ID同时支撑个性化排序与查询改写,排序聚合前缀特征、改写基于商品概念转移
- Structure for Reading, Prose for Writing: Asymmetric Structural Conditioning in Multi-Agent Document Authoring
部署招标应答系统发现:结构化标记利于读取抽取,但嵌套 XML 条件化生成质量从 74% 降至 48%
- Adapting Knowledge Graphs for Behavior Denoising in Sequential Recommendation
用结构化匹配的 KG 证据离线校准样本保留系数,对历史与目标加权去噪,不改动推理模型
- Rethinking Expressivity and Efficiency in Test-Time Training
提出 E²-TTT,通过闭式状态转移并行化分块 TTT 训练,在保持每 token 更新时序结构的同时匹配分块方法吞吐
- Asymmetric Capacity Allocation in Self-Refinement Pipelines
首次按阶段研究自精炼流水线模型规模:生成与精炼需大模型,评论器小模型即可
2026-08-23 26 篇 ★ 1 深度
- RoE-FND: Synergizing LLMs with Experiential Learning for Effective and Generalizable Evidence-Based Fake News Detection
构建可复用推理经验库并通过检索经验裁决对立论证,提升LLM假新闻检测与跨域泛化能力
- VTInstructor: Visual Trajectory Prompting for Navigation Instruction Generation in Continuous Environments
将隐式轨迹几何转为显式视觉轨迹提示,首个连续环境 VLN 指令生成框架,刷新 R2R-CE/RxR-CE SOTA
- AI in Search Reduces Publisher Referrals Without Improving User Experience: Experimental Evidence
基于1,100人的预注册田野实验,证明Google AI搜索减少发布者点击,AI Mode还损害体验与信任
- SkillForge: Self-Distilling Agents for Project-Specific Issue Resolution
通过从仓库自身测试与代码合成 issue 并蒸馏为实体级技能,解决 SWE agent 的项目冷启动问题
- VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation
构建10K人类偏好数据集与评测基准,提出链式思考全模态奖励模型VA-Judger,通过分维度强化学习对齐人类偏好
- Report on The 1st Workshop on Human-Centered Proactive and Personalized Agents for Interactive Information Access at CHIIR 2026
系统梳理主动式信息访问Agent的人本设计议题,强调主动性须时机恰当、透明、可争议且对齐用户目标
- FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systems
提出 FinRCA-Bench,分离检索失败与推理失败,量化证据检索架构对金融对账根因诊断准确率的影响
- GRACE: Grounded Reasoning via Adapter Composition and Evidence-Aware Calibration for Educational Visual Question Answering
GRACE利用题目教学状态路由轻量语言与视觉适配器并做证据感知选项校准,在ScienceQA上将准确率从90.5%提升至93.1%
- Listening Forward: Next Patch Embedding Prediction Enables Scalable Audio Learners
用因果 Transformer 预测下一 patch embedding,极简自监督在音频任务达到 SOTA
- Reducing Technician Search Burden: A Multimodal RAG for Cessna 172 Maintenance Manual
开发多模态手册检索器与MRAG流程,在维修手册上实现93.37% recall@5和87.20%答案语义相似度
- Pretraining Reusable Inference Across Views with Synthetic Task Priors
用合成任务先验预训练多视图推理过程,冻结或轻量 adapter 即可跨任务复用
- ArmorOCR: Grounded Adversarial Visual Perception via Observation-Transferred Self-Distillation
提出首个对抗性 OCR 基准 AdvSpot,并以观察迁移自蒸馏与 GRPO 提升 LMM 对抗文本定位识别鲁棒性
- Discrete Diffusion Inference-Time Control with Nested Sequential Monte Carlo
提出 NSMC 与 FA-NSMC 用于离散扩散文本生成推理时奖励引导,修正偏差并优于 best-of-n 与 bootstrap SMC
- From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAG
实测边缘RAG中固定压缩率不可靠,中间压缩率可降GPU能耗53.2%且质量损失可忽略,主张遥测驱动的自适应压缩
- DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing
提出 DARS,在 planner-renderer 图像编辑中通过模块间与模块内双层信用分配,将最终奖励分解为局部监督信号,提升 RL 训练效率
- Multi-Method Causal Evidence Synthesis: Ranking Candidate Drivers by Convergent Cross-Method Evidence from Observational Data
提出MCES框架,融合11种方法、8类数学传统,用收敛证据分数对候选驱动因素排序,避免单一方法误判。
- FormalTCS: Benchmarking End-to-End Frontier Formal Theoretical Computer Science Research of Large Language Models
构建专家验证的 FormalTCS 基准,评估 LLM 在 STOC/FOCS/SODA/COLT 前沿 TCS 研究上的端到端能力,揭示自动形式化与科研品味是主要瓶颈。
- InsufficiencyBench: Evaluating LLM legal advice on underspecified user queries
首个法律查询信息不足基准,衡量LLM识别缺失要素并避免臆测回答的能力
- Projecting BrowseComp-Plus onto ClimbMix: Toward More Realistic Corpora for Agentic Search
提出数据集无关的投影流水线,把 BrowseComp-Plus 问题证据迁移到 553M 文档的 ClimbMix,得到 57 个高置信评估样本
- Distributional Extrapolation for Interactions
提出 DExtrI,从仅单变量活跃的训练数据外推多变量组合的交互效应,并给出可行性理论保证
- Rule-Compliant Visual Spatial Planning for Multimodal Large Language Models
提出RuleMaze基准和DMP方法,解耦感知、执行与规则验证,提升MLLM在规则约束下的空间规划与泛化
- Does Listening Matter? Backchanneling and Nodding in AI Clone
在AI克隆中加入实时反向通道与点头等倾听行为,显著提升专注感、真实对话感和共在感
- The Third Restructuring of Software Form: From the Three-Tier Architecture to Storage, Models, and Agents
提出 Software 3.0 收敛为广义数据库、大模型与 Agent 三要素,按可表达性与关键性重划业务逻辑层
- Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems
用 LLM 自动生成带沟通风格人格特质的用户画像,提升访谈对话系统测试中用户模拟器的行为多样性
- Delegating or Doing? Understanding User Behavior in Hybrid Human-Agent Interfaces
研究发现LLM代理混合界面主要降低交互努力而非提升速度,委派行为个体差异远大于任务差异
- Two-sided receptivity to conversational AI agents in online dating: Bilingual survey data from Fledge.Love
发布两个双语调查数据集,分离用户对部署自身代理与遭遇他人代理的接受度及对生成式AI功能的兴趣
2026-08-22 30 篇 ★ 7 深度
- Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnesses
单个冻结 LLM 通过任务 harness、evolver、meta-evolver 三层自改进,在 BALROG 上实现显著提升并揭示能力边界
- The Embedder's Dilemma: LLMs Are Better, but at What Cost?
控制成本对比 10 个 LLM 与 26 个嵌入模型,发现 LLM 总体仅高 0.4 分,且仅在推理重型检索领先,成本最高贵 1431 倍
- SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback
把多轮用户模拟从评估终点改为反馈生成器,并用独立治理层主动修复知识退化,使技能进化梯度可持续
- The More Popular, The Harder to Forget: Adaptive Popularity for LLM Unlearning
AdaPop 按事实流行度自适应调整遗忘梯度,并用双上升控制器自动平衡遗忘/保留,显著降低遗忘内容泄露
- ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models
提出 ForgeWM 框架,将双向视频生成器蒸馏为 1/2/4 步动作条件世界模型,并支持低延迟生成与事后细化
- TinyCast: Probabilistic Zero-Shot Forecasting with Computed Periodicity
146K参数零样本概率预测器,用频谱计算周期并做相位折叠,定义尺寸-精度前沿
- Bounded Agents: Delegation Security for Multi-Agent AI Systems
提出 Agentic Principal Chain,在模型外强制执行基于会话状态的授权检查,将 AgentDojo 数据外泄从 75-100% 降至 0%
- LLMs Get Smarter from Targeted Synthetic Multilingual Data
提出 HOTFIXR 数据框架,自动探测多语言弱点并生成合成数据,ID 提升 6.2%、OOD 语言提升 7.1%
- SemComp-Bench: Benchmarking Semantic Task Completion in Video Generation
提出 SemComp-Bench 基准,用 VLM 评估视频生成在结果达成与语义 grounding 上的表现
- FM-Bench: A Benchmark for Long-Horizon Management with Competing Agents
15 个前沿 LLM 在 20 年共享足球管理世界中评测,结果由可解释管理行为而非模型规模与 token 消耗决定
- FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills
训练免更新框架,将成功工作流编译为可执行技能,并在推理时通过直接复用或技能条件生成持续提升智能体能力
- Improved Confidence Estimates for Black-Box Large Language Models
利用评估数据集训练简单分类器,以现有 UQ 分数和相似查询正确性为特征,提升黑盒 LLM 置信度估计。
- Towards Quantifying Benchmark Optimization in ASR Models
用三类行为探针发现高分开源ASR模型在音频欠定时仍输出基准参考文本,可通过低秩引导操控
- Repo0: Design-Driven Zero-to-All Code Generation
通过 Dual-DAG 显式架构状态与模块化度量引导结构演化,实现从需求到完整仓库的生成
- SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?
提出含119个任务、覆盖20个科学领域的仓库级科学软件工程基准,最佳编码智能体pass@1不足50%,并归纳四类失败机制
- Inducing Task Models from Computer-Use Traces
提出 TMI,自动从交错的低层级操作轨迹中分离潜在任务并构建分层目标与控制流模型,显著提升智能体技能迁移
- Daedalus-150M: A Convolution-Attention Hybrid Designed for CPU Inference
用 12 个短卷积层替代多数注意力层,在 CPU 长文本解码时实现 1.76 倍加速且质量不降
- When Text and Numbers Disagree: Evidence Arbitration in Large Language Models
系统研究 LLM 在文本与数值证据冲突时的仲裁行为,发现启发式偏向与外部工具过度依赖
- DICS: Data-Informed Centroid Splitting for Decision Tree Classifiers
用聚类构建类感知的紧凑候选分裂集,大幅缩小分裂搜索空间,加速决策树训练且精度不降
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving
通过均值修正、FA3/4对齐内核与分页KV/连续批处理,将块稀疏预填充从原型推进到生产级,128K下最高加速47倍
- Phantom Gains: Auditing Self-Improvement Against a Measured Null
审计 Qwen3-8B 的 LoRA 自训练,发现 7 类测量失效会反转结论,需为每个统计量单独测量零假设
- Explainable Transformer Models for Clinical Prediction Tasks on Structured Electronic Health Records
将化验值按百分位分箱离散为 token 并结合 Integrated Gradients,实现 EHR 序列预测与 token 级解释
- Which Eviction Policy Should an LLM Cache Use? A Systematic Study Across Workloads, Capacities, and Encoders
系统比较多种语义缓存淘汰策略,发现 LFU 为最强简单默认,且需先验证答案有效性
- MidTool: Mid-training Data Synthesis for Agentic Tool Use
构建首个通用工具使用中期训练语料MidTool-Mix,显著提升4B/8B模型在函数调用、多步交互和MCP任务上的表现
- Pandora's AI Model Routing Box: Efficient Allocation with Costly Value Estimation
将模型路由中昂贵价值估计的取舍建模为 Pandora's Box,以 reservation price 动态决定查询时机,在中心化与去中心化场景均接近最优。
- DecoVAE: a Lightweight Interpretable Trend-Seasonal VAE Framework for Efficient Probabilistic Time Series Forecasting
显式分解趋势与季节,用差分正则与频域复VAE实现轻量高精度概率预测
- Auditing Cross-Lingual Fairness in Language Model Watermarking
提出四组件跨语言评估框架,揭示LLM水印在多语言场景下的结构性公平性差距
- $TCP_α$: Margin-Controlled Confidence estimation for reliable Music Information Retrieval
提出 TCPα 置信度目标,通过边际惩罚分离正误预测,显著提升失败预测性能
- Learning When to Think: Adaptive Reasoning for Test-Time Compute Allocation
1.5B 蒸馏推理模型在 GRPO 内学会用首个 token 自路由 NoThink/Short/Long 三模式,平均响应长度减少 41% 且保持精度-长度帕累托前沿
- Orthogonal JEPA: Factorized Predictive States for Latent World Models
提出正交预测因子化框架,将目标状态分解为多个正交组件分别预测,缓解主导信号对表征学习的干扰
2026-08-21 30 篇 ★ 14 深度
- Temporal Multi-Signal Fusion for Token-Level Hallucination Detection
用 BiGRU 序列标注融合文本统计、NLI 蕴含与 LM surprisal,在 RAGTruth 上幻觉检测 AUC 达 0.840,比独立基线高 11 点
- Cross-Model Memory Transfer via Target-Side Reader Adaptation
提出跨模型冻结 Engram 记忆迁移范式,发现目标侧 reader 适配比记忆表本身更能激活外部知识复用
- Looped Language Models Improve Compositional Tool Calling
循环计算在组合式工具调用中提升准确率,自适应推理深度提供更优算力-性能折中
- Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL
用多个异构模型的同行投票作为无标签奖励,打破自奖励偏差,在文本与多模态推理上匹配甚至超过有监督 RL
- SkillGate: Training In-Policy Skill Selection in Long-Horizon Agents
识别选择器信用饿死问题,分离执行与选择 token 信用通道,将 9B 策略成功率从 40.8% 提升至 53.2%
- SemaPLC: A Project-Grounded, Verification-Gated Agent Harness for PLC Code Generation
提出以外部验证为完成条件的 Agent harness,在 PLC 代码生成上运行时得分显著超越基线
- Quantization Beyond Uniform Bit Allocation
针对MRL嵌入提出按连续桶非均匀分配位数的量化框架,等存储下PQ/SQ召回最高提升8%/18%
- DeltaMomentum: A Key-Value based Anisotropic Momentum Update via Delta Rule
把线性层梯度拆成 key-value,用 delta rule 做方向感知动量更新来加速训练收敛
- EnvHarness: Awakening Static Worlds for Agent Learning
提出 EnvHarness 可编程层与 EnvRigger 自动诊断循环,将静态环境改造成针对性训练环境,不改底层代码且保留原生验证器
- Eureka: Task-Conditioned Meta-Agent Orchestration for Scientific Discovery
提出任务条件的 Meta-Agent 架构,动态编译义务图并形成专门代理,通过治理式演化完成长程科学发现
- GEAR: Generative Expansion and Real Anchoring for Two-Stage Distillation of Tabular Foundation Models
用生成样本只作为教师查询位置,再用 OOF 真实数据锚定,把表格基础模型压缩为 CPU 可部署的 MLP/树模型
- MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use
提出 MemTrapBench 评测记忆导致的推理固化与信念扭曲,发现所有记忆策略均不及无记忆,并提出 AdaptiveMem 推理时缓解
- PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM Agents
将领域政策编译为工作流图,用外部持久化验证器在用户轮次边界引导代理完成合规步骤,平均 PASS4 提升 20 个点
- Leaf Values as Coordinates: Exact Contrastive Explanation for Gradient-Boosted Ensembles
将 GBDT 每棵树叶子值视为坐标,使模型变为线性求和,从而获得精确稀疏对比解释与可行动反事实建议
- AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement
构建10任务基准,评估LLM智能体重写训练算法实现递归自我改进的能力,最强仅得0.250分
- Break It Down, Pass It On: Cross-Task Skill Transfer in LLM Agents
系统比较技能归纳层级与格式,发现子任务级文本技能迁移最可靠,并给出无需执行的技能效用评分
- Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design
在ARG-Designer基础上引入奖励引导训练和图级奖励模型,生成更稀疏多智能体拓扑,平均降token 20.5%且保持精度
- Manifold Drift in Flow Preference Optimization: A Root Cause of Reward Hacking
提出 ThermoDPO 及加权变体,用偏好样本锚定缓解流匹配偏好优化中的流形漂移与奖励黑客
- PEA-DPO: Perception-Enhanced Alignment Direct Preference Optimization for MLLMs Alignment
提出 PEA-DPO 显式利用视觉偏好信号,解决多模态 DPO 中的视觉不敏感问题并显著减少幻觉
- SCoRD: Semantic-Assisted Continual Retriever-Reranker Distillation for LLM-Based Recommendation
提出语义意图助手与三阶段持续蒸馏,让 LLM 重排与轻量检索器在非平稳流中低成本高效协同更新
- SSR-GRPO: Integrating Supervision and Semantic IDs into Reinforcement Learning for Dense Retrieval in E-commerce
用层级语义ID替代大模型裁判并构造难负样本,提升电商稠密检索的RL训练稳定性
- Task-CoEvolve: Efficient Harness Optimization via Adaptive Validation Task Selection
通过方差加权采样聚焦高分歧任务并估计全量分数,在保持性能的同时将 harness 优化评估成本降 80%
- Do Sequential Recommendation Benchmarks Really Require Higher-Order Sequence Modelling?
用 recency 加权成对转移探针发现多数基准无需高阶建模,Transformer 增益被高估
- Learning how to Forget: Fine-tuning for Long-Context Sparse Attention
提出在任意 KV cache 策略下微调 LLM 的方法,使模型与稀疏注意力协同适应,在中等 GPU 上超越序列并行训练
- Training-Free LLM-Based Recommendation with Post-LLM Item Refinement Using Collaborative Signals
提出 CoRRe,在不微调 LLM 的前提下,通过共购图方向传播与流行度模长校准精炼物品嵌入,大幅提升训练自由推荐效果
- Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts
提出计算高效的两步超参数迁移框架,通过宽度缩放迁移与token外推预测大规模MoE最优学习率
- A knowledge-guided agentic framework for mitigating patient-context ambiguity in health queries
在LLM前插入知识图谱驱动的澄清Agent,主动追问缺失患者信息,大幅提升下游回答准确性与一致性
- An Agentic Approach for Active Data Collection, Travel Behavior Modeling, and Weather-Sensitive Demand Prediction
三 Agent 工作流整合对话式调查、数据处理与 LLM 出行预测,多模态最佳达 71.5% 准确率
- Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization
提出IAR三阶段后训练框架,将固定文档语料内化为LLM参数知识,兼顾领域QA与通用能力
- Ask Self, Ask Others: Relation Is All You Need
提出 Self-Exchange Relation 算子,将 token 混合拆成先建关系再分配信息流,在 10M/30M/100M 语言模型上 NLL 全面优于 MHA
2026-08-20 30 篇 ★ 20 深度
- Demystifying Agent Skills: Why They Work-Until They Don't
用 8135 条轨迹的对照分析提出 3 类/12 模式技能效用分类,证明技能主要靠程序锚定而非知识注入
- Harness the Memory: A Holistic Evaluation of Memory Substrates in Memory Agents
统一评测多种记忆基质,发现无单一最优,需按任务类型与历史长度做自适应路由
- FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution
通过带宽自适应执行与全栈协同设计,将前沿 MoE 模型高效部署到个人异构硬件
- Agent Lightning v1.0: Towards Harnessed Agentic RL
系统刻画 harnessed agentic RL 的 retokenization、advantage 与 loss 归一化挑战,用 3.5k 行框架验证 coding agent 提升 14.6%
- Security Assessment of DeepSeek Harness with A.I.G: Evaluating Resistance to Indirect Prompt Injection
用 A.I.G 对 DeepSeek Harness 做 14,560 次受控注入测试,文件模式 hidden Unicode 成功率 25.5%、skills 渠道 16.0%
- HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety
提出覆盖六阶段的Agent harness安全基准,发现配置阶段最脆弱且风险识别不保证安全行动
- LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents
桥接原生编码 agent harness 与策略梯度优化,在不改控制流下实现可信 RL 训练并显著提升 SWE-bench 解决率
- MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding
系统研究 CLIP 视觉编码器的 MoE 设计,以细粒度拓扑与无辅助损失均衡实现高效扩展并超越稠密模型
- StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows
构建首个基于市场验证 AI 创业产品工作流的端到端 Agent 基准,最强模型完成率仅约30%
- Thinking in a Low-Resource Language: What SFT Builds, What RL Fixes, What Accuracy Cannot See
三个 MoE 模型希腊语推理微调显示:准确率被种子噪声主导,语言保真、推理预算与格式遵从等行为指标才稳定,RLVR 可修复 SFT 缺陷
- FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis
FACET 通过先构建并修复容器环境、以共享可执行状态串联指令/解法/验证器,合成高密度可验证终端任务,用 1.2K 成功轨迹显著提升多尺度模型 Terminal-Bench 表现。
- Policy-Invariant Reward Shaping from LLM Feedback: A Framework for Hybrid RL Agents
证明 LLM 进度分作为有界势函数做奖励塑形不改变最优策略,即使评分不准
- Multimedia Asset Personalization via Multimodal Embeddings at Netflix
将 CLIP 与三模态 MediaFM 嵌入拼入双塔 item tower,统一画布模型并显著提升冷启动与搜索效果
- Debiased Inference for AI-Generated Data without Gold-Standard Labels: Identification via Multiple Imperfect Measurements
提出 DMM 框架,在无 gold-standard 标签时用多个不完美 AI 标注构建去偏桥函数,实现有效下游统计推断
- What is Missing from AI Post-Training AI: An Empirical Analysis
发现 LLM Agent 后训练时策略锁定在初始阶段,仅做局部调整,经验、人类指导与推理算力均无法激发策略级自省
- DeepWeaver: Bridging the Evidence Synthesis Gap in Open-Ended Question Answering
用 Thought Block Chain 将噪声证据编织成细粒度、带引用的声明,显著提升开放 QA 的证据利用率与引用质量
- GateDiffInt: Gate-Mediated Controllable Diffusion and Multi-Intent LLM Distillation for User Behavior Modeling
用可控扩散去噪与 LLM 多意图蒸馏协同解决行为序列中的噪声-意图耦合,提升 CVR 排序
- More Context, Same Budget: Dual-Bounded Relational Recall Beyond Top-K Retrieval
相同检索预算下,用相关性种子加图邻接扩展比平铺top-k多恢复23.8个百分点的完整支持证据
- Harness Continual Learning: Continual Adaptation Beyond Model Parameters
将持续学习对象从模型参数转向 Agent 外部 harness,通过 guarded evolution 显式控制 harness-level 遗忘
- Test-Time Scaling in the Wild: Why Exploitation, Not Exploration, Is the Bottleneck
五种TTS计算归一化对比:候选池不缺好答案,奖励模型相关性≈0.12,Fusion最佳仅捕获40% headroom
- OneModel: A Unified Foundation for Platform-Scale Multi-Scenario Ranking
用共享事件序列与场景感知门控统一推荐、广告、商家排序,平衡跨场景迁移与专用化并大幅降低在线延迟
- Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation
提出 token-share balancing、gap-aware 分配与 reward refresh 三种机制,将多教师在线蒸馏能力集成恢复率从 35.6% 提升到 83.4%
- PILOT Technical Report
PILOT 用三角色 LLM 智能体将推荐实验从被动调参升级为主动假设检验与人群级决策树个性化,搜索效率提升 40pp
- Grouping the Stochastic Machine: Precision, Not Capability, as the Frontier Metric for AI Systems
提出用重复请求的输出一致性(precision)而非基准能力作为前沿模型区分指标,并给出测量框架与决策方法
- rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation
把教师 LLM 的推荐推理压缩为四通道可编辑经验记忆,冻结学生 LLM 检索排序,解耦推理成本与在线开销
- SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendation
SIDScope 把 Semantic-ID 映射做成可复用接口诊断资源,发现路径存活与唯一命中间存在 1.2–3.0pp 缺口
- SPADE: Self-Play in Adaptive Synthetic Executable Environments
提出 SPADE 框架,让 LLM 在环境设计者与推理智能体双角色间自博弈,通过 hint-based regret 生成能力前沿的代码环境,实现开放自我改进
- Think-to-Personalize: Unifying Reasoning and Retrieval for User-Centric Personalized Dense Retrieval
提出 TTP 框架,用 LLM 显式推理用户历史生成意图增强查询,并与密集检索端到端联合训练,线上订单量提升 0.46%
- Adaptive Memory and Reflection Multi-Agent System for Medical Question Answering
提出医学问答多智能体框架,通过智能体专属记忆、反思反馈与复杂度路由提升答案质量
- Beyond Teacher Likelihood: Group-Calibrated On-Policy Distillation for Long-Context Reasoning
将 verifier 奖励与 OPD 分数做组内归一化并构造有符号残差,用相对优势分配回 token,提升长上下文蒸馏效果
2026-08-19 30 篇 ★ 12 深度
- Modular Cognitive Architecture Emerges in Large Language Models
通过46个认知任务的电路分析,发现LLM形成与人类大脑相似的模块化架构,同域任务共享神经元
- MOSS-VL Technical Report
开源视觉语言模型 MOSS-VL 通过门控交叉注意力实现边看边说,实时主动交互能力领先
- StateM: Reaching 95.3% Raw Accuracy, or a \$15 Frontier Run, on Terminal-Bench 2.1 via Harness Scaling
StateM 用状态机 runbook 外部化执行控制,不改权重,Terminal-Bench 2.1 达 95.28%,DeepSeek $15 达 88.8%
- VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End?
提出 VibeWorlding 基准与训练框架,用多模态 RL 让开源 MLLM 在 3D 开放世界构建任务上超越闭源前沿模型。
- Large Discovery Models: Empirically-grounded Model-Based Open-Ended Search
耦合 LLM 生成与贝叶斯非参代理模型,用不确定性值引导候选生成与筛选,实现开放式搜索性能大幅提升
- UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations
UI-Mate 结合环境驱动训练栈与上下文演示学习,在 OSWorld 等基准刷新开源 GUI 智能体 SOTA
- ClawGym II: Exploring Black-Box RL on Agent Harness
提出统一黑盒 RL 框架,通过不透明 harness 稳定规模化优化通用 Agent,并支持混合 harness 联合训练
- From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents
将 Agent 执行轨迹建模为关系图并传播不确定性,提升长程任务失败检测与提前干预能力
- HarnessEval-W: Agentifying the Evaluation of Visual Worlds
提出分层多智能体评估流程,把世界模型评估转化为可验证的证据树
- Learn What's Left, Not What's Mastered: Saturation Aware Advantage Reweighting for Multi-Reward Policy Optimization
提出 SA-MRPO,独立标准化各奖励并按批次饱和度动态折扣优势,将优化重心转向未饱和目标,提升困难指标性能
- Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements
用进化策略替代强化学习微调长程 LLM Agent,仅需推理级显存并支持 prompt-参数协同演化
- Think Inside the Chunk: RegulaRAG for Regulation-Compliant Scenario Generation using LLMs: A Case Study of UN Regulation No. 152
RegulaRAG结合SmartChunking、图遍历参考感知增强与Smart Retrieve & Rerank,在法规场景生成中Meta-Score 82.99,领先43%
- Conditional Evaluation of Language Models with Cheap Auxiliary Signals
提出 LACE 半监督估计器,用便宜信号局部中心化控制变量估计 LLM 条件性能,实现无偏且高效。
- Overview of the TREC 2025 Product Search and Recommendation Track
提供 TREC 2025 产品搜索与推荐评测框架,新增区分互补/相关关系的产品推荐标注数据集
- Delegation Asymmetry in Agentic Recommender Systems: Measuring Two-Sided Receptivity in Online Dating
用双语言大规模调查与潜变量模型证明发送和接收 Agent 对话的接受度是两个不同构念,并量化部署-接收不对称及路由增益
- AutoResearch: Insight In, Hallucination Out
两阶段自主研究系统,用多模型交叉评审和证据驱动执行减少科研幻觉,RSICD Recall 提升至 34.69
- Debate Training Reduces Reward Hacking in RLAIF
双玩家辩论 RL 训练在数学任务上比单玩家 RLAIF 峰值准确率提高约2个百分点,恢复45%性能差距,并保持 judge MCC 稳定。
- CABLE: Extending the Reach of Memory Retrieval via Complementary Antecedent-Based Linking and Expansion
提出可插拔的 CABLE 方法,通过生成前因导向查询并筛选互补关联构建稀疏有向图,扩展记忆检索的语义覆盖范围
- Empowering Compact LLMs with Fusion of Layer-wise Exits for Recommendation
在判别式 LLM 推荐中引入多层预测出口与连续路由器,以紧凑模型实现全库排序并逼近大模型精度
- Efficient RLVR Scheduling via Graph-Structured Online Difficulty Estimation
提出图结构化在线难度估计器,共享相邻样本rollout反馈以缓解冷启动与滞后
- Chain-of-Experience for Continual LLM Improvement
系统证明让 LLM 在推理期用执行/自评/正确性反馈迭代累积经验,可稳定超越零样本与跨任务记忆基线,且成本更低
- Cross-View Correspondence Is a Measurement Intervention: Two-Sided Validation for Agent Evaluation and Credit Assignment
把跨视图对应视为测量干预,用双侧验证和全最优解集审计暴露隐藏 tie-breaking 对评估与信用分配的影响
- Mixture-of-Expert Blocks Contain Strong Hallucination Detection Signals
利用 MoE 路由熵/专家不一致等内部信号提出 InnerExpert,实现 token 级幻觉检测并达 SOTA
- MoNe: Modular Neural Memory for Efficient Long Context Inference
提出轻量模块化神经记忆 MoNe,通过 test-time fast-weight 学习实现 O(N) 预处理、O(1) 查询的长上下文推理,无需重训练
- StagedWorkspace: A Versioned Workspace for Knowledge-Work Agents
提出带版本控制的工作空间,将解析视图与 diff 绑定到文件内容哈希,显著提升知识工作 Agent 的文件编辑与问答性能
- VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval
提出视觉富文档检索基准,暴露强静态检索在桥接证据上近乎失效,而工具智能体可恢复但依赖规划器与视觉表示
- DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval
通过文档嵌入保持、白化、在线硬负样本与直通解码,实现 LLM 在统一查询扩展与稠密检索中的稳定端到端训练
- Write, Execute, Refine: From Skill Followers to Skill Optimizers via Reinforcement Learning from Execution Feedback
训练独立 Skill Optimizer,用执行反馈做 phase-wise GRPO,让 4B 模型优化 agent 技能超过通用大模型
- Once Generated, Ranked: End-to-End Generative Slate Recommendation with Unified Semantic-Collaborative IDs
提出OGR框架,融合推荐感知SID构建与列表级偏好规划,端到端生成有序slate并提升在线指标
- On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification
重评估揭示内存型自改进Agent存在高方差、强任务顺序依赖及任务/环境欠规约导致的脆弱性
2026-08-18 30 篇 ★ 18 深度
- Verifier-Induced Support Reshaping in On-Policy Optimization
在线RLVR优化单一目标会缩小后续任务可采样成功轨迹,导致pass@1与best@k背离
- Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models
提出 Behavioral Lift 指标,发现思考模型放大的推理行为与正确性关联弱,而置信校准等高关联行为未被充分放大
- Latent On-Policy Self-Distillation
让 OPSD 的特权上下文从手工设计变为可学习的潜在表示,联合蒸馏提升 agent 与代码策略,样本效率显著优于 GRPO/Skill-SD
- Agentic Transaction: Towards ACID-Compliant Agent Systems
以语义化 ACID 事务约束 Agent 执行,在 KramaBench 上超 Claude Code 10.6 个百分点
- Second Thought: Reasoning in Parallel as LLM Agents Act and Observe
在 ReAct 的 Action-Observation 空闲窗口并行分叉四路原子思考,融合回下一轮,降低主线程解码与轮次而不损精度
- Scaling Domain Data Repetition in LLM Pretraining
固定 TPP 下最优领域重复次数随模型规模略增且与领域验证损失强负相关,可用小模型外推
- Forecast Collapse in Time-Series Foundation Models
发现时序基础模型预测坍缩现象,提出 CalibRank 平衡校准与排序,横截面相关性近三倍提升。
- Understanding Cognition-Induced Risks in Agentic AI Systems
按物理、社会、自我指涉三层次认知框架,系统分析LLM智能体对人类能动性与控制权的风险及缓解策略
- Sequential Multimodal Evidence Optimization for Product Media Ranking in E-Commerce
两阶段效用引导框架学习前缀转化效用并训练生存加权自回归策略,将决策关键媒体前置
- HyMem: Hierarchical Context Management for Long-Horizon Agents via Information Isolation
提出训练无关的分层上下文隔离框架 HyMem,将规划、执行、子任务推理与结构化记忆分离,显著提升长程 agent 的 Pass@1
- Noesis: Bidirectional Graph-RAG with Adaptive Parallelism and Cross-Knowledge-Base Semantic Discovery
提出解耦 Graph-RAG 架构,结合双向图遍历、AIMD 并发控制、MoE 量化与跨 KB 路由,HotpotQA 超 GraphRAG +27.8 EM
- Global Simulation-Guided Dynamic Operator Scheduling for Efficient Multi-Tenant Model Serving
提出 SliceScheduler,利用全局映射图和模拟器进行算子级动态调度,提升多租户 LLM 推理吞吐 1.10-2.29 倍
- SubZero+: Efficient Zeroth-Order LLM Fine-Tuning via Large Learning Rates
在低秩子空间内多查询梯度估计+低秩Adam+Haar符号校正,让零阶微调能使用大学习率并稳定提升性能
- TaoLive Digital Avatar Agent Technical Report: Training Agents to Evolve with Their Harness
HAT 通过 Harness-State Augmentation 训练紧凑模型,使直播 Agent 在低延迟下随 Harness 演化并保持通用能力
- Decomposing Staleness in Recommender Systems: A Dual-Filter Framework for Supersession and Decay
用 LLM 蒸馏的 pairwise 超替检测与多模态流量比例预测在排序前过滤陈旧内容,Google Discover 用户投诉降 54.9%
- Ask to Be Sure: Informative Interactions for Confident Multi-Turn LLM Recommendation
用推荐熵减作为多轮交互奖励,无需 ground truth 即可训练更高效的对话推荐 LLM
- Intent-Driven Situation Tracking for User-Centric Multi-Turn Agents
提出训练无关的IDSS框架,显式分离工具事实与任务状态,通过约束传播提升多轮Agent完成率与效率
- Cost Scales with Change, Not Corpus Size: Incrementally Maintaining an Evolving Semantic Substrate
增量低秩更新替代全量 SVD,使语义基底维护成本随变化量而非语料规模增长
- When Is Complex Chunking Worth It? A Multi-Objective Evaluation of Chunking Methods at Scale
8种分块策略的规模化评测表明复杂分块很少一致优于简单分块,最佳选择高度依赖模型、数据和规模,且成本差异显著
- GOD: Enhancing Generalization via Deep Grafting for Sequential Recommendation
提出组件级知识蒸馏框架GOD,将学生组件嫁接进冻结教师构造混合源模型,强化序列推荐泛化
- When Tool-Backed Skill Retrieval Fails: Source-Style Collapse in Executable Capability Retrieval
固定工具库下 dense retriever 会因 query 源风格偏移而覆盖崩溃,TF-IDF 路由+少样本修复可显著恢复覆盖。
- LineageRAG: Harnessing GraphRAG by Constructing Evidence Lineages with Source Grounding
为每个证据需求构建显式谱系并通过原文字段锚定来源,显著改善多跳检索与生成效果
- POI Recommendation with LLM-Augmented Multi-Graph Learning and Contrastive Alignment
用 LLM 生成语义图和地理图扩展 LightGCN,通过跨视图对比对齐缓解 POI 冷启动
- Impression Share Prediction: An Offline Evaluation Task for Ranking Systems
提出曝光份额预测作为离线评估任务,用因果模型识别并预测候选排序模型的目标桶曝光分布,首小时Transformer rollout提升22% L1
- SAHC-NS: Structure-Aware and Hardness-Calibrated Negative Sampling for Implicit Collaborative Filtering
用逐层匹配分数的均值与标准差捕获跨层结构差异,并基于候选池硬度动态校准负样本难度
- Decoupled Temporal Encoding for Generative Recommendation
将宏观时间动态与微观顺序先验解耦,轻量注入 Transformer,在淘系闪购广告在线提升 CTR +1.8%、RPM +3.0%
- Skill2Query: Exploiting Skill Structure to Generate Pseudo-Queries for Agent Skill Retrieval
将技能文档解析为知识图谱,三阶段生成能力对齐、参数一致的伪查询,提升检索与训练效果
- TRACER: Balancing Stability-Plasticity-Cognitivity Trilemma for LLM Enhanced Continual Recommendation
提出 TRACER,通过 Procrustes 初始化、置信门控+LoRA 推理、梯度同步 guidance,在 LLM 增强持续推荐中同时缓解遗忘、适应与语义偏置
- UniDot: A Unified Network for Sequence Modeling and Feature Interaction in Large-scale Recommendation
以点积为统一原语,用双总线并行堆叠块融合序列与特征交互,获 KDD Cup 2026 工业赛道亚军
- Unbiased Recommender Systems with Implicit Feedback
系统研究推荐中位置偏差与流行度偏差的缓解方法,覆盖LTR、CF和GNN社交推荐
2026-08-17 30 篇 ★ 19 深度
- AVA-Encoder: Towards Agent-Native Video Representation Learning
提出 AVA-Encoder,将视频编码为知识图谱并用文本梯度优化,提升智能体视频重建与编辑能力,较最强外部基线提高 20.7%
- Dion3: Full-Stack Orthogonal Updates
提出 Gram Newton-Schulz、对称 GEMM 核、分数行选择更新和 megabatching,将 Muon 优化器步时最多降低 6 倍且保持/提升模型质量
- MobileMem: Learning from a Year of Mobile Experiences
提出移动端长期记忆基准 MobileMem 与合成框架 KEME,系统评估端侧记忆系统在多跳、时序、偏好推理上的能力。
- AdsWorldEngine: A Self-Evolving Conversational Advertising Agent through Orchestrator and Tool Coevolution
用 Actor-Tool 协同进化与标签锚定判断建模构建对话广告 Agent,取得显著离线与在线收益
- CogChat: Knowledge Graph-Augmented Conversational AI with Heterogeneous Graph Transformer for Cognitive Grounding in Design Generation
用个人异构知识图谱 + HGT 选择相关节点注入 LLM,提升设计对话的上下文保留与个性化意图理解
- Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning
通过全局共享 FFN 知识库与多 Reasoner 隐式迭代,实现同等精度下近 4 倍端到端推理加速
- Before You Say It: Anticipating Verbal Behavior from Longitudinal Everyday Conversations with LLMs
用 LLM 从 1000+ 小时长期自然对话中预测个人言语行为,探索主动式个性化 AI 可能性
- AgentRewind: Recoverable Execution for Long-Horizon LLM Agents
通过对齐的上下文与环境 checkpoint 回滚,并注入失败摘要,提升长程 Agent 任务成功率
- HAM-RAG: Hierarchy-Aware Multimodal RAG for Structure-Faithful Interleaved Generation
利用文档层级引导检索与生成,实现多模态RAG中的结构忠实与图文对齐,在多个基准上平均提升17.3%
- CForce: Boosting Parallel Decoding for dLLMs via Consistency Forcing
提出 Consistency Forcing 蒸馏方法,用后期掩码预测监督早期预测,改善 dLLMs 高并行解码的质量
- Scaling Creative Writing Beyond Story-Centric Data with Attribute-Guided Genre Expansion
用属性引导解耦主题与体裁形式,构建多体裁创意写作数据提升 LLM 跨体裁能力
- Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages
提出 DHD 重放协议,证明错误答案消息在多智能体推理中仍可能帮助后续集成,且可重复测量轨迹价值
- DeaMoE: Efficient MoE Structure for Fast Small-Batch Decoding
DeaMoE 将专家分组为部门,共享大部分参数并设计两级路由,在小批量解码下降低专家权重加载,实现最高 2 倍加速
- EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment
用未来多步行为作顺序依赖的密集监督,并通过循环一致性对齐把整体偏好内化到解码表示,提升生成式推荐且在线零开销
- Split the Labor: Separating Evidence Interpretation from Decision Aggregation
提出将证据解释与决策聚合分离,用四字段证据元组和校准对数似然比池化解决计数尺度漂移
- More Correct Mass, Worse Answers: Why Power Sampling Can Fail and How to Fix It
揭示 Power Sampling 提升正确轨迹概率却伤害自洽性聚合,提出 Relative-Rank SoftSat 与重要性加权修复
- HERMES: a multi-agent framework for structured knowledge extraction from ultra-long documents in geoscience
多智能体框架从超长地学文献中抽取结构化数据,在古生物专著上抽取3.2万实体、45万属性,F1约0.90
- How retriever redundancy and diversity impact RAG effectiveness
在虚构 QA 上证明重复/改写文档几乎无益,跨体裁多样文档可提升 RAG 正确性 17%–47%
- MACS: A Hybrid Multi-Agent Framework for Reliable Conversational E-Commerce Recommendation
混合 shopping/merchant 双 agent 架构,用确定性 SQL 约束与跨轮 slot 状态实现最高约束合规与零漂移
- MINT: A Universal Zero-Shot Predictor for Transaction Data
用冻结交易序列编码器+LoRA适配LLM,通过嵌入注入实现高效零样本预测问答
- Batch-wise Adaptive Pruning: Periodic Neuron Activation-Aware Weight Pruning for Language Reasoning Model
针对批量推理下训练无关自适应剪枝失效问题,提出周期 top-k 选择与激活记忆,实现推理加速同时保持精度
- PriCoRec: A Privacy-Aware Cloud-Device Collaborative Framework for Ad Recommendation under Feature Constraints
提出隐私感知云-端协同广告推荐框架,敏感特征留在端侧,以云预排序多样性正则和云指导轻量端模型兼顾效果与效率
- QUASAR: Lowering the Loss Floor of Quantization-Aware Training with Loss-Aware Reconstruction
将损失感知重建引入 QAT 训练循环,用 Adam 二阶矩做 saliency 进行尺度搜索和加权最小二乘拟合,压低低比特模型 loss floor
- Clearing the Fog: Towards Installing and Refining Proactive Exploration Capabilities in LLM Agents
通过探索性数据构建和对比信号引导强化学习,大幅提升 LLM Agent 在多轮交互任务中的主动探索与决策能力
- SheetCompass: Hierarchical Relation Graphs for Agentic Spreadsheet Reasoning
将电子表格从扁平文本转为层次关系图,结合双级记忆与三Agent闭环,在SCB/SB/SheetRM上全面超越既有Agent方案
- SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning
用共享文本空间跨 tokenizer 对齐并加入终止 token 掩码与参考 KL 稳定长上下文推理蒸馏
- Twin: Playing an Unknown Game with a Test-Time Digital Twin
构建可执行世界模型,强制回放验证和规划后执行,以 93.3 分通关 ARC-AGI-3 23/25 个游戏
- Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact
用确定性内核与生成外壳解耦,生成组件只影响问题解释不碰返回值,无法表达请求直接拒绝,从结构上避免 LLM 事实性幻觉
- You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model
在残差流同一前向里融合条件 steering 与零样本充分性门控,用无标签重建消除写读干扰
- KV Cache Compression Through the Lens of Transform Coding
用白化变换与反向注水按注意力输出失真分配 KV cache bit,5.8x 压缩下近无损
2026-08-16 30 篇
- Mitigating Gender Bias in English to Romanian Machine Translation
用微调 LLM 插入性别提示标签配合标签感知 NMT,将英罗翻译性别准确率提升超 40 个百分点
- How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review
揭示 LLM 评审对修辞的敏感性呈结构化层级,证据框架与新颖性立场影响最大,重写者决定变异分离而评审者决定分数效应
- DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation
用深度 schema 探索、数据库无关规则修正与多路径生成提升 Text-to-SQL 准确率
- PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
用多模态 Agent 玩家按长期目标交互评测世界模型,揭示当前模型长程一致性与状态演化不可靠
- Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation
提出因果蒸馏框架 CMD,对齐教师评分与学生生成时的因果信息集,提升自回归视频生成控制精度
- A corpus-specific clinical RAG system matches or outperforms newer frontier LLMs on HealthBench
领域特定 RAG 通过定制语料在开放基准上与最新前沿 LLM 打平或领先,验证语料特异性对 grounding 的作用
- Beyond Local Accuracy: A Protocol-Level Identifiability Audit for Controlled LLM Reasoning Evaluation
提出零模型调用的协议级可识别性审计,证明静态准确率与干预响应保真度存在结构性分歧
- Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Development
通过过程化指标与受控对比,评估 7 个前沿模型在 36 个长时域任务上的行为,发现当前智能体更像工程优化器而非自主研究者
- CROP: Task Relevance via Counterfactuals for Selective On-Policy Distillation
提出 CROP,通过反事实敏感性边际度量 token 级任务相关性,优化选择性在线蒸馏的监督分配
- When Should Multi-Round RAG Stop? Structured Stopping Judgments and Retrieval Reduction in Search-R1
在冻结的Search-R1框架上训练S2G风格结构化judge,用第一STOP决策减少3.7%检索调用,EM仅降0.625个百分点
- Concept Drift Detection and Adaptive Retraining of Malware Classification Models
用OCSVM等漂移检测触发模型重训练,在精度与周期重训相当下大幅减少重训次数
- Defensive Boosting for Online Probabilistic Forecasting
Defensive Booster 同时获得在线梯度 boosting 的 Brier 竞争保证与弱学习条件下的分类误差收敛保证
- HybridRAG-BN: A Retrieval-Augmented Framework with Fine-Tuned Verification for Bangla KBQA
混合稀疏/稠密检索与LoRA验证、后处理兜底的Bangla KBQA方案,竞赛双榜F1最高0.729
- Enhancing Virtual Agents through SLMs and Edge-Computing: An Exploratory Evaluation of Think and Memory Processes
在边缘设备上用小语言模型实现虚拟Agent的Think与Memory组件,验证路由、记忆读取与延迟的可行性
- Refusing Intent, Not Form: Wrapper-Based Intent-Group Supervision for LLM Safety
提出 WIFA 自动增强数据,通过意图组配对和锚定训练改善 LLM 对有害包装的拒绝并减少过度拒绝。
- Toward a Gricean Retreat: Probing LLMs for Knowledge Boundaries and Referent Specificity
LLM内部已编码知识边界与指称特异性信号,但生成时未协调,仍倾向编造具体细节而非退回通用陈述
- Better Decomposition, Free Aggregation: A Synthesizer-Folding Framework for Multilingual Multi-Hop Question Answering
Syfer 通过延迟翻译和子问题图质量检查,在保持精度同时降低多语言 RAG 成本
- When Is a Task Vector Enough? An Empirical Theory of Implicit Multimodal ICL
提出 Selection-Realization 假设,揭示静态任务向量在跨查询共享变化为主时足够,否则需更复杂干预
- NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video
含 1,481 个问题,覆盖 155 个视频 146.8 小时,评估长视频叙事与文化理解,揭示 MLLM 明显不足
- SAEVerbalizer: Generating Explanations for Sparse Autoencoder Features via Representation Verbalization
注入 SAE 解码方向并微调下游层,将 SAE 特征直接言语化为自然语言解释,摆脱外部行为观察
- SCULPT: Subtractive Composition for 3D Part Generation
提出 SCULPT,在结构化 3D 隐空间内通过联合分割预测器迭代提取部件,实现部件级生成与整体重建的协同优化
- How Do VLMs Behave When Blind or Misled? Behavioral Evaluation of VLMs on Scientific Figures
提出 SciFigBench 与 A-R-I 框架,系统评估 VLM 在科学图表上的不确定性行为,揭示高精度不等于高可靠性
- Who Speaks Matters: Authority-Aware Multi-View RAG over Italian Parliamentary Proceedings
以查询依赖的说话者权威模型驱动多视角摘要,在议会语料上实现高引文忠实度与政治团体覆盖
- StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMs
提出StreamTTT将长程历史写入在线更新的快速权重,缓解流式VLM感知与记忆的权衡
- TabSOM: A tabular-to-image encoding method based on self-organizing maps
用SOM组件平面布局特征并建模特征间关系,将表格数据编码为图像以提升CNN/ViT的分类性能与可解释性
- TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint
VLM 内部能识别证据不足但输出不克制;提出 TRAPSBench 和 PECS,定位表达瓶颈
- Structure then Query: Enabling Precise Analytical Queries over Unstructured Documents
AnnoIndex 用自动标注模式构建结构化索引,结合 SQL 扩展查询引擎,以 0.87 F1 实现低成本精确文档分析
- A Comprehensive Empirical Evaluation of Vector Database Systems for Approximate Nearest Neighbor Search: Performance, Quality, and Resource Trade-offs
在6个数据集上评测7个向量数据库,揭示FAISS吞吐最高、Weaviate召回最好、Qdrant延迟最低,并开源框架
- Measuring Task-Agnostic Training Data Influence Across Language Model Pretraining
提出一种无需下游任务或验证集的训练数据影响度量,通过梯度更新对最终参数距离的缩减来估计样本贡献
- Knowledge Synthesis Review Framework: Task-Level Benchmarking of LLM-Based Systems for Multi-Source Evidence Synthesis
提出KSR人机协同框架,将证据综合拆解为筛选、抽取、分析、综合四任务并基准测评与路由,无单一系统全任务领先
2026-08-15 30 篇 ★ 4 深度
- Poor Man's Agentic Modeling: Simulating Large LLM-Agent Societies on a Laptop
用低参数代理模型替代LLM智能体,仅需数百次查询即可在笔记本上模拟大规模智能体社会并预测误差趋势
- Maglev: Sliding Recurrent Memory
用并行 prefiller 提供记忆目标、decoder 滑动窗口注入循环 K/V,实现有界推理的非线性循环 Transformer
- LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers
提出统一 LLM 路由五组件公式、开源模块化基础设施与 xRouteBench 基准,系统比较 16+ 路由器并给出成本与个性化关键发现
- An AI4AI Framework for Visual Token Pruning
提出 AutoPrune,用 LLM 驱动 TPDSL 自动设计视觉 token 剪枝策略,免训练,删 94.4% token 仍保持 99% 以上性能
- Simplex Relaxation for Discrete Diffusion
通过 Dirichlet-categorical 增广保持均匀扩散边际不变,导出 Rao-Blackwell 反向桥目标与采样器
- Thought-Level Beam Search for Reasoning
将 test-time 推理建模为硬件约束下的算力分配问题,用固定容量池的 thought-level beam search 动态剪枝并分支高质量前缀
- SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models
用自然语言强化学习为小型 LVLM 自动生成定制化 agent 技能,不更新权重,成本降低 71-167 倍
- Self-Evolving Embodied Agents via Skill-Harness Evolution
提出SHAPER框架,冻结模型参数,通过环境交互进化可复用技能与上下文代码harness,实现无需训练的具身Agent自进化
- Persistent Recursive Worlds Enable Autonomous Software Evolution
提出以持久化项目而非持久化 Agent 为核心的递归多智能体框架,实现长程软件自动开发与演进
- Specification-first convergence with an AI coding agent: a case study of dismantling a core architectural invariant across 189 files in a 717k-line codebase with no test oracle and no human code review
规格优先协议让AI编码Agent在无人工审查和测试oracle下成功重构71.7万行代码,31轮审计收敛201缺陷
- Hybrid-Policy Self-Editing for Composable Unstructured Knowledge Editing
提出HPSE,通过特权上下文自蒸馏与混合rollout注入缺失事实,使非结构化知识编辑具备组合推理能力
- TailBooster: A Dual-Layer Generative Framework for Extreme Value Augmentation with Operational Validity Enforcement
提出 TailBooster 双层框架,用 IQR 提取尾部训练生成模型,再用自编码器清洗,保证合成样本操作可行,极端预测 MAE 降低 47-57%
- Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
外部化世界状态并重新设计长时域教师,蒸馏出3步无CFG学生模型,实现持久记忆与持续生成
- AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design
提出元 harness 优化框架,让 code agent 基于 rollout 反馈递归改进设计 harness,在海报生成任务上超越商业系统 7.45 分
- From Atomic Evidence to Logical Composition: Structured Compositional Reasoning over Compound Answer Options
将复合选项分解为原子判断并用整数规划组合,大幅提升 LLM 在 AND/OR/NEITHER-NOR 逻辑题上的表现
- When Can You Trust Offline Evaluation of Equal-Cost Top-k Allocation? A Controlled, Reproducible Benchmark and Practitioner's Guide
Top-k 离线评估:logger-目标动作对齐决定重叠,DR 最稳,诚实策略级切分才能消除优化者诅咒
- Are You Sure You're Sure? On the Impact of Instruction Tuning on Confidence and Lexical Diversity
在问答基准上评估匹配基座与指令微调模型,发现指令微调一致改变置信度但非均匀改变 rationale 词汇多样性
- OmniScientist: An Omni-Modal Omni-Discipline AI Scientist
端到端多模态AI科学家,从原始异构证据直接完成研究全流程,感知层让论文质量显著提升
- DFM Mimir v1: An Open HRM Delivering Frontier Performance at 1B Parameters Using Only Permissible Post-Training Data
用HRM架构与161个许可数据集训练1B模型,英语有竞争力并刷新丹麦语SOTA
- Synthetic Persona Pretraining: Alignment from Token Zero
在预训练阶段注入合成角色反思,从 token zero 安装助手人格,提升对齐与鲁棒性
- HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark
构建153小时运动跟踪基准与偏好对齐的HumanScore指标,更符合人类感知并揭示接触/稳定性故障
- When Local Variance Optimality Is Not Enough: RoPE-Aligned Q/K Rotations for Dynamic 4-Bit Quantisation
发现RoPE对齐的成对旋转在动态W4A4KV4量化中未提升且增加困惑度,揭示代理目标与量化统计不匹配。
- LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure
构建88B token K-5语料并训练5B模型,提供研究知识边界与注入的受控沙盒
- MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordination
开源多智能体框架MARC,用确定性角色编排替代单体LLM提示,实现可追踪的临床推理与自动提示生成
- MLLM-Routed Heterogeneous Ensembles for Robust Cross-Dataset Image Classification
用多模态大语言模型agent动态路由每张图像到最合适的视觉骨干,实现跨域集成分类
- QuoteBench: How Matched Scores Can Hide Command-Path Failures
通过控制执行传输中的解析器,揭示匹配执行分数掩盖的 Bash 引用失败与边界适应差异
- A Probe Direction Is a Property of Its Prompt
线性探测评估中“宣布评估”的提示措辞主导探测分数,单提示设计不可靠
- Vero: Can AI Agents Build Formally Verified Software Repositories?
首个仓库级实现与证明联合合成的形式化验证基准,当前最强 Agent 仅完全解决 27/43
- Wasserstein Filtering: A Sample Selection Method for Robust Distribution Learning
提出 Wasserstein Filtering,通过最大化子集与污染数据集的 Wasserstein 距离来剔除异常样本,并给出可扩展算法
- Training AI Scientists to Replicate Research
构建论文复现任务集 Replica 与低噪声自动打分 judge,后训练 27B Faraday 智能体在复现任务上超越 Claude Opus 4.8 和 GPT-5.5
2026-08-14 30 篇 ★ 15 深度
- DarwinX: Evolving Agent Harnesses Through Natural Selection
冻结模型下把 Agent 自改进变成对 harness 变体的群体选择,用保留-扩展契约和档案重组,在四个基准平均提升约 17 个点
- OpenART: Scaling Agent Red Teaming via Open-Ended Environment Evolution
提出开放式环境演化基准 OpenART 与黑盒攻击策略 EMHA,在 75 种 Agent-模型配置上取得 85.0% 攻击成功率
- SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries
执行感知的 section-level 图压缩:用可逆端口化宏保持契约,压缩比 3.46x,效果最高 +12.2 点
- Full-bandwidth transformer
顶层隐藏状态与token嵌入融合反馈,以近零解码开销换来约1.5–2倍数据效率与更强推理
- Parameter Exploration for RLVR via Variational Learning
提出 3PO 方法族,通过采样多个策略参数实现参数空间探索,相比 GRPO 在相近 FLOPs 下持续提升 LLM 推理性能
- ReRound: Reconstructive Rounding to Resolve Midpoint Ambiguity in Calibration-Free LLM Quantization
用条件扩散模型重建权重作为舍入方向指导,混合 RTN 与重构舍入,提升小模型 3/4-bit 免校准量化精度
- MBA: Multimodal Benchmark and Agents for Real-World Business Ideation
构建首个多模态商业创意基准 MBA-Bench,并训练基于 GRPO 的代理,在 blind/known 双设置下显著超越基线
- Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligence
用Agent+知识图谱+方法库自动发现AI模型机制,实现从解释到干预
- Ready Cohorts: Bounding GPU Opportunity and Avoiding Host Round Trips in LLM-Agent Control
给出 ready-cohort 边界量化 agent 控制面 GPU 可调度机会,并证明设备端决策比主机往返快 1.19–2.39 倍
- Spark-to-Paper: End-to-End Research Paper Generation as a Composable Skill
在现有编码助手中以13个可组合技能实现端到端论文生成,靠分离规划与报告、确定性校验抑制自我反驳循环
- Intern-S2-Preview: Scientific Agentic Foundation Model
构建科学多模态代理基础模型,融合强化学习训练与时间序列预测,支持长程科学任务
- Test-Time Optimization of Query Embeddings with Ranking Aware Reward Maximization
把 reranker/LLM 排序分数蒸馏成可复用查询向量残差,冻结权重与索引,MTEB 最高 +8.36 nDCG@10
- Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligence
冻结 VLM 通过外部可验证经验蒸馏可迁移教训,并用访问证据校准迁移可靠性分数,实现无参数更新的空间推理自进化
- LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation
将逐轮记忆巩固改为语义片段级批量编码,写侧 token 降最多 86% 且 LoCoMo/LongMemEval-S 精度 SOTA
- MindMemOS: A Portable and Self-Evolving Memory Operating Layer for AI Agents
提出实体-属性-时间三维记忆结构与四类自演化机制,实现可移植、自演化的 Agent 记忆层
- Total Recall at What Cost? Benchmarking the Serving Cost of Agentic Memory Systems
系统对比三种 agentic 记忆系统与滚动窗口/全量转录基线,发现成本不可由对话长度预测且成本-准确率无赢家
- Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval
将 Fashion-CLIP 多模态嵌入分解为四个命名属性槽并学习各自的 text-image gate,显著提升约束满足率
- Doubly Robust Estimation of Causal Effect on CVR with Targeted Regularization
为链式点击-转化结果构造双稳健因果效应估计器,并用目标正则化提升稳定性
- DARTree: Speculative Diffusion Decoding with Autoregressive Draft Trees
将扩散块草稿与树形自回归校正结合,训练无关地提升推测解码接受长度与加速比
- DrEM: Dual-Side Robust Ensemble Ranking from Noisy User Preference Predictions in Video Recommendation
提出 DrEM,用共享 logit 噪声模型同时校正 pxtr 噪声造成的监督侧偏好翻转和特征侧输出不稳定
- DTAMLP: Denoise Time-aware MLP for Session-based Recommendation
针对会话推荐中短 dwell time 的偶发噪声,提出可插拔时间权重融合与 FFT 滤波的全 MLP 模型 DTAMLP
- FSGR: Mitigating Token Frequency Bias for Fair SID-Based Generative Recommendation
提出 FSGR 框架,在 SID 构建与 LLM 训练两端联合缓解 Token 频率偏差,平均 Gini 公平性提升超 20%
- GEM: A Generative Embedding Model Bridging Reasoning and Retrieval
GEM 用单一生成式嵌入模型先对 query 推理再编码,使检索模型能理解推理而不仅是表面匹配,4B 模型超越更大 baseline
- Reduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference
提出训练无关、输入自适应的 RMM,通过激活 L2 范数 TopK 收缩乘轴,以可预测方式加速 LLM 推理
- STAR: Structured Tokenization and Target-Aware Interest Representation for PCVR Prediction
STAR通过结构化特征分词、DIN式目标感知序列解码与加权InfoNCE对比目标,在PCVR排序上稳定提升AUC
- RAGSieve: Self-Referenced Local Contrast for Knowledge-Poison Detection in Retrieval-Augmented Generation
提出自引用局部对比检测框架,在查询时和语料入库时无需投毒标签识别RAG投毒文档
- RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memory
把已召回记忆作为 cue,沿事件图局部扩展补全缺失证据,长期记忆 QA 精度显著提升
- Generative Universal Multimodal Retrieval with Dual-role Identifiers
DrIG 将同一残差量化 ID 同时作为顺序解码序列和无序集合先验,缓解前缀剪枝错误,并以 dense 重排补偿量化损失
- Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model
提出 MoT:在冻结对齐器脚手架中独立训练 Transformer 深度块并重组,验证模块化预训练可行性
- EviReform: Evidence-Guided Query Reformulation for Multi-Hop Graph Retrieval
利用已检索证据生成残差查询,分离查询重构与图证据聚合,提升多跳检索 Recall@5 与 F1
2026-08-13 30 篇 ★ 10 深度
- Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narratives
提出 NCP 任务与 NCP-Bench 基准,系统评测 LLM 在对抗性互动下维持长期叙事承诺的能力,暴露严重一致性缺陷
- NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs
用神经元级更新约束保护语言敏感神经元,在多模态微调中恢复94.5%语言能力下降且保持多模态性能
- UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models
用无标签校准集度量专家功能相似性,结合路由曝光保护高频专家,将训练后推荐 MoE 压缩为小 MoE 并保持 NDCG
- Don't Scroll Back: Missing-Evidence Memory for Streaming Dialogue Summarization
提出缺失证据记忆框架 ReMEMBER,在固定预算下针对当前窗口未解决依赖检索并提炼证据,提升流式对话摘要的缺口补全
- Decoding-Level Taboo: A Diagnostic Stress Test for LLM Robustness
在 logit 空间动态屏蔽词边界主候选 token,强迫模型迂回表达,揭示离路径鲁棒性受规模与指令对齐影响
- AdvFD: Boosting Visual Generation via Adversarial Fr'echet Distance Loss
提出对抗 Fréchet 距离损失(AdvFD),用可学习对抗表示与特征白化缓解 Fréchet hacking,提升视觉生成后训练
- BDH-CQ: In-Context Learning with Recurrent Latent Reasoning
BDH-CQ 以循环潜在推理避免逐 token 中间推理,150M 参数在 ARC-AGI-1 达 29.5% pass@2,成本 $0.0007/任务
- Sequential Modality Dropout for Robust Multi-Modal Sequential Recommendation
训练时整段历史独立擦除单模态,让多模态序列推荐在模态缺失时保持 HR@10 精度
- Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation
用GRPO加语言门控无参考质量奖励与SFT-RL权重插值,46语翻译12B模型超越多个闭源系统
- Deciding When to Rely on Visual Information: Gated Multimodal Fusion in Sequential Recommendation
提出 VisGate,通过门控机制逐项自适应融合视觉与协同信号,并分析视觉功效的上下文变化
- Your LLM, Your Style: Behavioral Mode Axes for LLM Behavioral Control
用情境化对比行为轨迹提取激活方向 BMA,发现 thought-derived 控制比 response-derived 更稳定干净
- Are We Really Making Progress in Group Recommendation? Unmasking the Tie-Breaking Illusion
揭示近期群组推荐提升源于 sigmoid 分数压缩与确定性 tie-breaking 的评测偏差,提出 tie-aware 评估使提升大幅缩水
- AI4AI at Test-Time: Strong-to-Weak Capability Transfer via Harnesses
强模型不更新弱模型参数,仅靠推理期脚手架将弱模型ToM平均准确率从0.49提至0.91
- From Overlooked to Explored: Recovering Item Relations via Mixture of Perspectives for Sequential Recommendation
识别并缓解自注意力相似性偏差,提出多视角透镜模块恢复同构与异质物品关系,序列推荐效果显著提升
- HCGRec: Hint-Conditioned Generative Recommendation with Semantic IDs
用训练期 target-prefix hint 恢复被 GRPO 零奖励样本淹没的生成式推荐信号,将零优势组从超 70% 降至 20% 以下
- One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL
识别单冻结 LLM 用户模拟器导致的 simulator collapse,并提出 Verbalized Sampling 与 Co-Training 两种解法
- Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus
首次系统揭示混合线性注意力LLM中巨量激活呈前注意力尖峰与尖峰间平台两种形态,并给出生命周期机制
- LazyTrain: Limited-resource Allocation toward Zero-waste Yield Optimization in Large Language Model Training
将checkpoint选择、激活放置、重计算与CPU-GPU-NVMe通信重叠建模为混合整数调度,并耦合混合8-bit算子提升单卡训练效率
- LODESTAR: Trustworthy Entropy Is Navigated, Not Merely Measured -- Reinforced Polarizer Keeps a Frozen LLM from Being Confidently Misled by the Wrong Evidence
用 RL 训练固定 prompt 干预串,提升冻结 LLM 在 RAG 答案选择中对误导证据的鲁棒性
- FunnelCausalNet: Funnel-aware Joint Conversion-Revenue Uplift for Multi-tier Coupon Allocation
硬耦合转化概率与条件价值的漏斗结构,配套预算分配与审计不确定性层
- MOON: Multi-Objective OrthoNormalized Updates for Multitask Learning
在矩阵几何下做多目标梯度操纵,用谱-核范数几何与正交归一更新提升多任务优化效率
- Making Collaborative Signals Count: Graph-Aware Large Language Models for Sequential Recommendation
将全局 item 共现关系分桶为可学习 attention bias 注入 LLM,无需外部图编码器即可联合建模语义与协同信号
- Sci-Surf: Navigating Scientific Literature Discovery through Human Feedback and Intelligent Summarizatio
集成LLM用户画像与多模态论文摘要的意图中心型学术推荐系统,在线评估提升10.4%
- SCOPE-Router: Cost-Aware Open-Set VLM Routing for Execution-Oriented Tasks
提出执行导向 VLM 路由基准、开集双塔路由器和成本感知训练目标 CRM+RCCR,在三个基准上取得最佳 Rank Score
- Token-Level Credit Assignment Optimization for Generative Document Retrieval
提出 TCA,用 gold hidden-state 轨迹对齐赋予每个 DocID token 细粒度奖励,并以 GRPO 位置归一化优化生成式检索。
- Claim-Level Reliability Assessment for Efficient Test-Time Reasoning
提出声明级证伪的测试时计算重分配框架CLR,用关键声明验证替代额外采样,提升推理准确率并节省37% token
- Convergent Detour Hijacking: Task-Preserving Resource Amplification in Skill-Based LLM Agents
提出 CDH 攻击,利用技能描述选择与指令体规划两阶段耦合,在任务完成率不变下放大 token 与执行时间消耗
- VAKRA: Evaluating Multi-Hop Reasoning Across APIs and Retrieval Under Tool-Use Policies
推出 8000+ 可执行 API 的企业 Agent 评测基准,发现模型失败集中在语言中介推理与策略约束
- Information Abundance Paradox: Long-Context Training Undermines Parametric Knowledge
提出信息丰度悖论:训练上下文越丰富,模型越依赖上下文而非参数知识,导致长上下文训练并非中性增益
- Asymptotic Risk Calibration for Selective Question Answering
模型无关的事后校准框架,为LLM选择性问答提供渐近错误率控制,无需训练即可搭配任意不确定性估计器
2026-08-12 30 篇 ★ 17 深度
- What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems
三阶段框架结合人工意图、点击偏好与源-目标视觉验证,将视觉不一致率从3.7%降至0.9%,在线CTR提升32.70%
- Omega-S: A Functional Resilience Index for LLM Fine-Tuning
仅从权重矩阵计算拓扑正则项,无需旧任务数据或旧权重,使 LoRA 微调保留率从 62.9% 提升至 84.1%
- Scaling Inherently Interpretable Language Models
将可解释性作为训练约束与语言建模联合优化,实现与规模同步提升的内建可解释性
- Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
通过工作流、子任务、函数三层记忆将大模型代理的工具使用经验蒸馏到小模型,无需训练,显著提升工具调用成功率
- Mendel Gödel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution
引入反应范型突变和跨谱系杂交,利用存档中多任务、多谱系比较证据提升自改进编码代理的性能与泛化性
- A Hybrid Nested Harness for Decoupling Structure and Parameters in LLM-Driven Optimization
提出外层LLM生成结构草图、内层数值优化器调参的混合框架,在科学任务中大幅超越纯LLM搜索
- OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
利用推测解码提前预测重要KV块,实现稀疏注意力与多级预取,在有限HBM下提升推理吞吐达2.1倍
- Ouroboros: A Self-Developing Frontier Coding Agent with Reviewed Core Evolution
一个自我修改运行时(harness)的编码 Agent,通过审阅提交通道持续演化,在 Terminal-Bench、OSWorld 等基准上取得最优结果。
- Business Arena: Benchmarking LLM Agents in a Realistic Marketplace
构建基于真实数据的跨境电商模拟环境,系统评估15个大模型,揭示最终净资产9倍差距和运营风格差异
- Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
提出三阶段分类法,梳理多智能体与环境协同进化逐步摆脱人工设计约束的研究
- Evo-Bench: Can Language Models Improve Agent Harness?
首个跨搜索、办公、通用领域的基准,评估LLM自主进化智能体harness的能力,发现搜索优势与早饱和现象
- SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring
构建多语言、大规模代码重构基准,通过严格清洗暴露模型短板,最佳解决率仅41.2%
- Intent Speaks Louder: Controllable User Simulation Beyond Response Imitation
提出 UserIDA,通过显式逐轮意图指令实现可控用户模拟,意图准确率大幅领先基线
- ConnectionMind: Leveraging Social Networks and Large Language Models for Personalized Recommendation at Meta
将社交推荐形式化为异构图上的路径探索,LLM策略选择性发现证据路径,在Meta线上提升观看时长0.43%
- DSAgentBench: Can Agents Automate End-to-End Data-Science Workflows in Real Computer Environments?
首个在真实 OS 中评估 agent 完成全流程数据科学任务的基准,揭示当前模型巨大能力鸿沟
- GenRec: An LLM-Backed Recommendation Ranker at Netflix
用 LLM 背骨替代手工特征工程,借明文上下文和奖励加权训练实现可竞争的业务排序效果
- Context Is Not Authority: Structured Runtime Governance for Financial Market Agents
为金融 Agent 提供类型化收据与动态权威控制器,防止正确的上下文被越权执行
- DualSpectralCF: Training-Free Sign-Aware Spectral Collaborative Filtering
两个即插即用的训练免梯度组件,将显式负反馈融入谱协同过滤,无需训练即超越多个骨干模型。
- SkillZip: Evaluation-Free Skill Compression for Self-Evolving Agents by Discovering Reusable Structure
用“一次性解释,多处引用”原则,在不依赖下游评估的条件下压缩自进化Agent的冗余技能文本。
- VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?
提出了首个衡量 LLM agent 在长期变化世界中主动性与持续性的评测基准,发现所有前沿模型得分极低
- SR-OPSD: Self-Referenced On-Policy Self-Distillation
通过参考锚定与 Rényi 投影解耦在线自蒸馏中的目标位置与投影几何,显著提升训练稳定性与多任务性能
- Multi Interests for Joint Search-Recommendation Modeling
提出从行为类型和查询语义两个视角提取多兴趣,解决搜索推荐混合序列中的兴趣耦合问题
- When Do Anchor-Based Pointwise LLM Rerankers Help? Retriever Quality, Statistical Scope, and Anchor Design
复现揭示锚点重排序的对比评分是核心,但结合标准得分仅对弱检索器有益,简单锚点优于复杂设计。
- Towards Efficient Reasoning in LLM-Based Recommender Systems via Model Merging
首次将模型合并用于慢思考推荐系统的推理压缩,在注意力头粒度选择性注入简洁行为,缩短推理长度最高24.3%且保持准确率
- Detecting an Effect Is Not Learning to Act on It: A Reward-SNR Floor for LLM Acquisition Agents
揭示LLM信号平均有效但无法学习按例决策的信噪比下限,噪声占位符可复现虚假增益
- Scheduling Mixed RL Rollouts Beyond Prefix Locality
路由层依据工作负载类型与 KV block-time 需求动态控制 session 准入,避免 KV 缓存击穿,吞吐提升超 50%。
- Sona Technical Report
用一个生成式模型统一召回与排序,通过教师蒸馏和Semantic ID在音乐推荐中实现显著在线收益。
- TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation
利用时间感知模态路由和基于扩散的图重构,动态调整多模态融合权重并抑制过时模态信号
- Post-Calibration Reliability Reranking of Relevance Decisions via Label-wise Monotone Projection
用标签条件单调函数将校准置信度映射为正确性可靠性,不改原始预测,改善搜索/推荐系统的 fallback 路由和选择性预测
- Actions Speak Louder than Words: Measuring Cross-Lingual Policy Retention in Tool-Using Agents
跨语言评估不应只看答案,需测量行动轨迹一致性;四个前沿模型保留自同一性的份额稳定在71–73%
2026-08-11 30 篇 ★ 24 深度
- MatrAIx: Simulating the World with 8.3 Billion Persona Agents
提出83亿虚拟画像的大规模用户模拟评估基础设施,在四种环境中完成18,189次试验,行为一致性达91.5%
- Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss
通过缓存教师 Top-K logits 和融合分块 KL 损失,实现单 GPU 上长上下文蒸馏训练,匹配在线质量且内存线性增长。
- SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation
通过稀疏探测关键位置并利用下游结果校准蒸馏目标,在有限预算下提升推理模型多样解覆盖。
- Relevant but Incomplete: Referential Dangling as a Paradigm-Level Failure Mode in Hard Prompt Compression
独立评分式硬压缩常割裂依赖对,导致答案片段存在但推理链断裂,多跳QA中广泛发生且可恢复
- When Privileged Guidance Misaligns: State-Matched Routing and Contextualized Self-Distillation for Multi-Turn Agents
提出状态匹配路由决定何时使用特权轨迹蒸馏,并构造状态上下文化教师语境,显著提升多轮策略效果
- Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning
发现简单增加环境数量并不能提升智能体训练,提出能力感知环境选择与层次化难度课程来优化环境分布
- SFT Conflicts, RL Coexists: A Theoretical and Empirical Analysis of Multi-Task Learning for LLMs
多任务SFT导致性能崩溃,RL因梯度近似正交而共存,基于此提出Parallel-RL解耦并行训练
- Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
提出按执行阶段划分能力分类,通过专才强化学习与权重合并-蒸馏实现统一多模态模型
- Zero Gap Is Not Restoration: Stratified Per-Question Probability Evaluation and Step-wise Mitigation of Benchmark Contamination
提出分层每问题概率差距指标SA-PPG与解码干预方法RailCap,更准确评估并缓解基准污染。
- Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection
提出多专家Agent分别分析纹理、光照、运动、物理伪造线索,以小型开源MLLM超越GPT和Gemini
- YOLO-PEFT: Parameter-Efficient Fine-Tuning on YOLO Family
将适配器放置形式化为可审计的约束规划问题,在实时检测器上实现结构化 PEFT,避免手动试错
- PushDualGen: Enabling LLMs to Generate Semantic IDs with Interpretable Copy for Industrial Push Recommendation
先生成SID再生成可跳过解释的轻量框架,在快手十亿用户推送中有效播放率+8.5%,不满意度-37.7%
- Not Worth Another Token: Marginal Value Estimation for Efficient Deep Research Agents
针对长程深度研究Agent,系统对比多阶段剪枝策略,发现剪枝位置比规则更关键,早期剪枝可减少73% token
- Structure-Preserving Projection for Mitigating Modality Bias in LLM-Based Sequential Recommendation
通过余弦相似度保持与序列感知对比损失,迫使投影后的协同嵌入保留原始结构,抵消LLM对文本的过度依赖
- Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA
提出冻结基座 + 可组合 LoRA 专家的 MoL 架构与递归自改进循环,实现代理模型部署后持续适应与协作
- Personalized Communication Skills for Agentic Recommender Systems
提出 why-what-how-who 技能库与个性化路由,让智能推荐代理通过外部用户互补证据纠正视角狭窄
- Motif 3: Technical Report
提出 GDLA 注意力及 384 选 8 稀疏 MoE,结合在线蒸馏实现高效 LLM 推理与多能力整合
- BOUND: Brief-Guided Corrective Preference Distillation at Search-Control Boundaries
通过任务锚定的搜索状态简报从学生交动中构造状态匹配偏好对,纠正持久搜索漂移
- Adaptive Semantic Capacity Allocation for Parallel Generative Recommendation
提出自适应分配语义槽的码本比特,动态决定ID长度与码本大小,提升并行生成式推荐准确性
- Beyond the Capability Boundary: Zeroth-Order Optimization for Self-Evolving LLM Agents
通过零阶梯度估计扰动LoRA参数,使Agent在困难样本上也能采样正确轨迹,突破能力边界。
- DREAM Technical Report
在推荐流水线上叠加感知与策略智能体层,通过意图引擎和元引擎实现可审计的自主优化
- Listwise Cross-Encoder Fine-Tuning vs. Agentic Instruction Tuning for LLM Rerankers: A Systematic Study in Medical Procedure Reranking
109M参数的交叉编码器微调ListNet后,NDCG@3比4B指令重排序模型高2.6点,参数仅1/37
- Test-Time Augmentation for LLMs: When Input Diversity Beats Output Diversity at Matched Compute
在固定推理预算下,语义改写聚合比自一致性更高效地将计算转化为准确率,性价比高约 1.8 倍
- IntHQ: Task-Interactive Hierarchical Query on Dual-Stream Representations for Generative Recommendation
通过双流解耦、自适应任务交互和层次查询机制,解决生成式多任务推荐的源坍塌、关系坍塌与层次坍塌,线下指标全面最优、线上UVCTR提升1.60%
- PreGress: Ranking-Native Pre-training and Prompting for Graph Node Ranking
首个排序原生的图预训练+提示微调框架,通过度中心性与属性重建预训练,配合任务特定提示,统一支持多种节点排序准则
- Se-DPO: Self-Evolving Token Credit for Direct Preference Optimization
通过在线从模型自身隐式奖励与参考熵中动态学习每令牌KL预算,解决DPO均匀加权的次优问题。
- TSPORec: Token Selection via Preference Optimization for LLM-Based Sequential Recommendation
通过偏好优化自动选择信息令牌,在提升序列推荐准确率31%的同时推理开销降低63%
- Learning Preference Adaptation for Large Language Model Personalization via Verbal Reinforcement Learning
从少量样例中归纳文本重写策略,将冗长通用偏好压缩为紧凑任务相关表示,模型冻结全适配
- MetaStrategy: Generative Ranking with Executable LLM Strategies
用LLM生成结构化排序策略而非物品序列,通过生产路径重放与蒸馏实现零延迟个性化排序
- ComboShoppingBench: Evaluating LLM Agents for Budget-Constrained Basket Shopping with Coupons
提出ComboShoppingBench基准,评估LLM代理在跨商品兼容性、预算和优惠券约束下的组合购物能力,最强代理仅61.2%成功率。
2026-08-10 30 篇 ★ 10 深度
- From Economic Agents to Agentic Economies: A Systems Blueprint for Economic World Models
提出六层经济世界模型能力阶梯,驱动多智能体从规则到自进化、制度内生与虚实对齐
- StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
提出小时级流式视频理解基准StreamArena和双层架构StreamMind,解耦实时交互与长期多模态记忆
- Pre-Inference Routing for Cost-Efficient Document Field Extraction
提出预推理路由:在文档提取前预测难度,动态选择廉价或强模型,成本降低31-77%且质量损失≤0.02 F1
- Modular TTT: Rethinking Test-Time Training as Composable Modules
提出模块化 TTT 框架,将内部学习器建模为有向无环图,系统消融组件并发现关键设计原则
- Skaling: Chinchilla's Exponents Meet Kaplan's Coupling
引入交互指数耦合模型容量与数据,解决标准缩放法则在极端区间的预测偏差,MAPE 降低 1.5–3 倍
- The Optimizer Is the Agent: Reasoning-Driven Search across Prompts, Programs, and ML Workflows
用单一工具使用智能体内部化搜索策略,替代外部启发式控制器,在三大领域 14 项任务中达到或超越专用方法。
- An End-to-End Agent Auditing Engine
提出A2E端到端评估引擎,通过ATP协议和多维指标系统揭示Agent框架能力差异
- Invisible to the Machine: Auditing AI Restaurant, Cafe, and Bar Recommendation Against a Complete Market Census
首次在全量市场普查下审计AI餐饮推荐,发现85.6%的场所从未被推荐,可见性由评论量、网站等数字足迹驱动,而非评分。
- Beyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction
提出直接预测终端状态的训练范式,避免递归误差累积,显著提升长时域预测精度
- CoBa: Cost-Effective Test-Time Scaling via Compute-Balanced Routing
提出计算均衡路由策略,动态分配生成与验证预算,以更少计算匹配多数投票准确率。
- CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG
通过离线提取细粒度信息块并复用其上下文KV缓存,在低延迟预算下显著提升多跳问答准确率
- CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity
通过在指令微调中引入 [StartCreativity] 令牌,使 LLM 在保持后训练质量的同时恢复基模型的创意多样性
- An Agentic Hybrid Top-Down and Bottom-Up Approach to Knowledge Graph Generation
提出结合 LLM 与 Wikidata 的代理式混合管道,实现多语言技能概念的自适应对齐与涌现
- DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding
提出三层记忆状态与贝叶斯页信念更新机制,将长文档推理建模为动态证据探索过程
- GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Tasks
构建覆盖12类地理时空任务的多维度LLM评测基准,揭示推理与模型规模对地理理解的关键影响
- Teacher Retains Full Tokens, Student Merges Efficiently: TM20K for E-Commerce Sequence Modeling in Ad Recommendation
通过全注意力和两阶段蒸馏,用三种Token合并将电商序列扩展到20K,在线广告收入提升1.036%,延迟仅增5.6%
- Diffusion LLMs as Targets and Adversaries: Mechanistic Safety Exploits
发现扩散LLM安全对齐稀疏且可迁移,提出SN-Guided Diffusion黑盒越狱框架,以极低成本实现高转移攻击成功率
- Hierarchical Quantization with Domain-Adaptive Sparse Routing for Generative Cross-Domain Recommendation
提出分层共享-路由量化与稀疏专家混合的生成式跨域推荐框架,结合路由一致性正则化,显著提升稀疏域性能。
- Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning
提出TRIAL,通过轨迹相对事后蒸馏将密集监督按轮次合理分配,显著提升多轮Agent的RL训练效率
- MISO: Model-Internal-State-Guided Optimization for Ranking Models
利用模型参数、激活、梯度等内部状态聚合出可解释信号,将排序模型优化试错成本降低84–94%
- PACE: Primitive-Aware Code Evolution for Automated Algorithm Design
将算法局部逻辑解耦为可执行原语,通过原语感知进化和汤普森采样实现代码级复用与有效评估
- SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent
结合闭环诊断验证与验证门控近端精炼,在表格任务上平均准确率超越最强梯度基线3个百分点
- TEPA: Revoking Stale Memories for Conflict-Robust Language Agents
引入冲突键撤销机制,解决长期记忆因陈旧证据污染 prompt 导致性能下降的问题
- Same Attention, Different Truths: Put Logit-Lens over Visual Attention to Detect and Mitigate LVLM Object Hallucination
发现物体幻觉并非视觉注意力不足,而是注意力区域无法解码为目标token,提出训练免的检测-缓解框架,取得SOTA。
- A Picture is Worth a Thousand Tokens: How Vision Language Models Cut AI Energy Costs While Improving Accuracy
将时间序列转为2D图表输入VLM,减少3.6-10.4倍输入Token,推理能耗降1.8-2.5倍且精度大幅提高
- Progressive Alignment of Recommender Foundation Model through Multi-Phase Post-Training
通过三阶段渐进后训练(LP→FFT→RFT)分离适配与对齐,用奖励模型引导策略优化,显著提升深度业务指标
- WebRider: Persona-Conditioned Intent Controllers for Live-Web Assistance
分层架构与意图契约让网页代理的路径可审计,揭示高任务完成率背后仅38.8%的合约忠实度。
- Exact Adaptive Hybrid Retrieval Without Fixed Top-L Cutoffs
提出可按需继续的精确稠密-稀疏融合方法,保证完全列表Top-K一致且避免固定截断,平均加速23-30倍
- Rhetorical-Role-Aware Retrieval-Augmented Generation for Legal Question Answering over Indian Supreme Court Judgments
提出修辞角色分块、混合检索与查询改写的领域RAG框架,提升法律多轮问答的上下文召回与答案相关性
- From Classification to Recommendation: Empirical Analysis of Audio Embedding Models Application for Content-Based Music Recommendation
系统评估6种音频编码器在内容推荐、序列推荐和生成式推荐中的效果,揭示预训练与微调下的表现差异及Semantic ID设计影响
2026-08-09 30 篇 ★ 1 深度
- Resume Means Resume: A Machine-Checked Conformance Contract for Checkpoint, Interrupt, and Resume Semantics in Workflow Persistence Layers
针对五个 Agent 工作流框架的 checkpoint/resume 行为,提出可机器检验的六项一致性契约并测量实际严重违规
- WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Models
利用可逆动作循环构造无标注长期监督,通过空间闭合与时间一致性奖励降低状态漂移并提升组合动作泛化
- SmartMage: Dynamic Modality Orchestration for 3D Scene Understanding
提出动态模态路由与模态感知专家混合,让MLLM按查询语义自适应选择模态,在3D场景理解中大幅超越固定模态组合
- Invisible Shortcuts: Why Vision Encoders Know Your Camera
揭示视觉模型利用像素级不可见元数据痕迹作为分类捷径,并提出缓解策略改善OOD泛化
- Adaptive Modality Reliability Diagnosis and Restoration for Robust Multimodal Intent Recognition
提出闭环诊断-修复-重评估框架PRIME,用异方差不确定性估计模态弱项并修复,提升多模态融合鲁棒性
- CLIP-CC-Bench: Evaluating Paragraph-Level Video Descriptions in Video-Language Models
提出首个面向段落级长视频描述的评估基准,通过嵌入模型集成与粗细粒度匹配衡量生成质量
- Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes
系统揭示多模态预训练中知识非对称流动、模态协同依赖任务复杂度、早期统一优于晚对齐,并给出高效配方
- The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing
揭示双边平台隔离实验中,匹配质量重尾分布导致生态成本恒定不随规模消失,并提供预检程序
- Robustness and User-Perceived Value of Popularity Calibration in Music Recommendation: A User Study
用户能感知推荐列表的流行度差异,但并不明显偏好校准列表,离线流行度校准指标与用户感知弱相关
- What Current AI Benchmarks Leave Unmeasured: Modality, Search, Citations, and Implications (for Safety Evaluations)
揭示LLM评估仅用API单次运行忽略搜索和模态差异,会掩盖高达21%的输出不一致与8%准确率下降
- AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games
融合方差缩减AIVAT与置信序列,实现证据充分即停的有保证评估,成本降低74倍
- The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeeping
视频语言模型在事件计数上呈现阶段性失效,瞬态事件几乎无法可靠计数,高频高计数下准确率仅0.2%。
- Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents
提出使用LLM评委自动评估对话Agent基准的一致性、复杂性和策略覆盖,经验证能区分基准质量水平
- F$^2$Agent: Financial Fusion of Agentic Intelligence for Multimodal Trading
提出层次化多模态Agent架构,通过自适应融合与噪声鲁棒正则化,实现金融交易年化收益平均提升超20%
- EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation
将情感因素解耦为氛围、语义线索与时间进程,在冻结视频扩散变换器中实现精细化情感控制
- FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India
构建LLM+规则混合语音代理,发布会话表单填写基准,揭示端到端评估与多目标权衡的必要性
- Benchmarking and Enhancing LLMs for Rule-Intensive Review of National Standard Documents
构建首个国家标准文档审查基准GB/T-Bench与多智能体GB/T-Reviewer,将最佳CMCS从0.3280提升至0.5094
- Schema-Guided Hierarchical Information Extraction and Semantic Evaluation Using Generative AI
用单一生成式模型零样本抽取嵌套属性,并通过路径语义匹配与分级评估实现自动化高精度信息提取
- Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era
通过互信息最小化生成不可学习扰动并解耦水印提取,同时防御非法模型训练与数据泄露
- Visual Grounding in Zero-Shot Vision-Language Control
输入消融实验揭示VLM零样本控制普遍缺乏视觉接地,对称共识守护者实现可靠危险检测。
- Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web Agents
多观察模式的路由收益被重运行噪声夸大,弱智能体因标签不足难以学习路由
- M$^3$Prune: Hierarchical Collaborative Pruning for Efficient Multi-Modal Multi-Agent Retrieval-Augmented Generation
通过分层学习稀疏通信拓扑剪枝多智能体冗余交互,在提升多模态 RAG 准确率的同时大幅降低 token 开销
- Domain-Grounded Candidate Selection for Agentic Image Editing: A Shadow Removal Case
将阴影物理先验注入Agent候选生成-评估-筛选流程,显著减少幻觉并提升编辑可靠性
- omni-macos: On-Device Omni-Modal Search on Apple Silicon
在Mac本地运行全模态语义搜索引擎,数据不出设备,通过内存预算与增量索引保证实时交互。
- Mapping Similarity Spaces across Embedding Models with Synthetic Query Probing
提出无参考合成查询探测方法,学习分数映射使不同嵌入模型的相似度可比,提升阈值可迁移性
- Tracing the Heart: An Evidence-Linked Pipeline for Heart-Failure Feature Engineering
多Agent协同生成可审计聚合特征,将心衰表型预测AUROC从0.895提升至0.963
- Learning visual representations for compositional analysis of artworks and photographs
对比人类启发的构图分析(对象分解+图注意力)与微调基础模型,前者可解释且数据高效,后者性能更强但泛化差
- A Six-Dimensional Taxonomy of Post-Training Adaptation Techniques with Applications in AI Governance
提出统一六维分类法,区分微调、RAG等训练后适应技术,支持模型变更治理
- Beyond Sequence Order: Syntax-Informed Positional Embeddings for Transformers
将依赖解析语法先验按架构特性注入位置编码,大幅提升句法及语义理解,且推理成本极低
- Innovation-Residual Auditing of Autonomous Analysis Agents: Localization, Detection Limits, Error Control, and Identifiability
对无监督代理错误审计进行理论分析,揭示评分选择对错误传播的影响并给出统计控制方法
2026-08-08 30 篇
- AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities
提出首个音视频耦合编辑评估基准 AVE-Compass,并设计模块化 Agent 框架提升跨模态编辑一致性与指令遵循度
- What AI Red-Team Evaluations Can and Cannot Prove
推导出红队评估的证据上限,揭示当前基准对高频危害足够但对罕见灾难性危害严重不足
- FinanceHarness: Autonomous Financial Deep Research Framework
提出面向金融领域的自主深度研究框架及点时间基准FinanceGym,将代理评分从25.3%提升至32.4%
- FactorJEPA: Factorizing Monolithic Futures into Layout-Agent-Interaction Channels for Crowded and Chaotic Global South Urban Worlds
将世界模型预测分解为布局、实体、交互三个因子,在拥挤南半球城市场景中显著提升预测精度与鲁棒性
- Lossless Tensor Compression as Program Synthesis
将无损张量压缩形式化为程序合成,合成紧凑DSL程序实现位精确重建,存储节省33.93%
- DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspaces
提出首个统一异构多模态证据发现、完整表格输出与确定性评估的数据智能体基准,最佳准确率仅 66.34%
- GDPevo: Evaluating Agent Self-Evolution on Real Business Tasks
基于企业工作流的可归因自进化基准GDPevo,通过规则杂交评估智能体从经验中持续改进的能力,揭示当前水平远未成熟。
- Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains
为低资源语言从头搭建检索增强生成系统,合成监督、微调嵌入与重排、适配生成,并发布基准HERA。
- WorldClaw: Agentic 3D Open-World Generation at Scale
利用规划代理和渲染代理从文本生成全局一致、可编辑的大规模 3D 开放世界,实现粗到细的生成
- Helping Music Co-Creation Agents 'Listen' Well: Hierarchical Self-Supervised World Models for Understanding and Generation
层次化自监督表征使音乐理解与生成解耦,小模型结合流匹配实现实时可交互的共创建议
- Agent Against Agent: An Agentic System for Automatic Prompt Injection Red Teaming
提出PIMiner,通过多任务训练构建可迁移策略库,实现跨LLM的高效提示注入红队测试。
- Continual Learning in Transition
提出三轴框架(何时、如何、何处)刻画持续学习从参数更新到系统级适应的演进
- ChronoVision: Temporal Reasoning via Latent State Reconstruction
通过重建潜在状态与强化学习对齐过程,增强多模态模型的时序推理能力
- GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?
提出全局时空视频理解基准,发现最强 VLMs 零样本得分仅 42.68(人类 79.08),长视频场景整合能力严重不足
- HarnessOpt-Bench: Evaluating LLMs at Harness Optimization
首个评估LLM端到端Harness优化的基准,揭示模型差异大于框架且原生框架不总占优
- Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay
将屏幕操作编译为缓存友好的结构化记忆,使 Agent 以极低 token 开销准确回答用户日常行为问题并量化例程成本
- Cross-platform epistemic verification for improving factual reliability in AI-generated news summarization
提出MECV框架,通过异构多源检索与多LLM陪审团共识打分修正摘要幻觉
- KVAE: Family of Tokenizers for Multimodal Generative Models
提出音频、图像、视频的连续潜在tokenizer,重建和生成质量匹敌前沿开源模型
- A Mechanistic Analysis of Gender Sensitivity in Dense Retrieval Models
揭示双编码器性别偏见源于输入嵌入并经少量后期注意力头传播,不同层级干预效果迥异
- On-Policy Delta Distillation for Multilingual Math Reasoning
提出 On-Policy Delta Distillation (OPD^2),用教师模型与基模型的概率差作为学习信号,在多语言数学推理上优于 OPD
- PaDoc: Layout-Grounded Parallel Decoding for Document Parsing
将文档布局建模为分支结构,通过前缀条件分解实现并行解码,将自回归深度缩减至最长分支,突破速度瓶颈
- Task-Conditional Flow Matching for Balanced Multilingual Text Embedding Adaptation
提出任务条件流匹配,对翻译任务用流匹配,其他任务用匹配目标,结合教师引导与课程学习,多语言嵌入达 SOTA
- WatchLens: A Configurable Platform for Online Video Recommendation Experiments
开源模块化平台,解耦 UI/内容/策略并绑定推荐上下文到行为日志,支持可控在线实验
- Beyond Top-K: Replacing Black-Box Retrieval with Interpretable Agentic Operations
提出READ,一种免嵌入的agentic检索方法,在表格密集文档上准确率远超密集检索且可审计
- DASH: Divergence-Adaptive Supervision Horizons for On-Policy Self-Distillation of Reasoning Models
提出DASH,根据局部发散与序列均值的差异自适应调整token级蒸馏权重,提升推理模型在线策略自蒸馏效果
- Align-RAG: Alignment Is All You Need for TSFM In-Context Learning
提出免训练的时序对齐方法Align-RAG,证明冻结模型自身即可动态利用检索上下文,无需训练适配器
- MACRO: Markov Chain Routing of Transformer Layers
不修改模型参数,通过马尔可夫链学习任务特定层路由,精度+5.0%,搜索时间降低9.4倍
- The Illusion of Visual Tool-Use: A Causal Audit of Thinking with Images
用因果干预审计多模态LLM视觉工具调用,发现总体增益微小且大部分轨迹中视觉证据无因果效应
- TS-RAG: Retrieval Augmented Generation for Time Series Forecasting
提出 TS-RAG,用参考令牌融合检索序列,提升时间序列预测精度
- "I don't know anything about laptops!" - User Perception of Digital Product Advisors Adapting to Their Knowledge Levels
在聊天机器人产品推荐中,兼顾技术信息、性能分类与属性解释的 TCE 设计最能提升新手体验且不妨碍专家
2026-08-07 30 篇 ★ 14 深度
- When Many Answers Are Valid, Voting Fails: Symbolic Verification for Best-of-K Causal Reasoning in LLMs
提出 CALVER,用因果公理的符号验证器替代投票,在允许多个因果有效答案的推理中准确率大幅提升。
- Self-Evolving Coding Agents
系统综述自进化编码代理,定义概念并提出对象为中心的演变分类法,分析软件工程的天然演进特征与挑战。
- FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memory
在潜在记忆中因子化内容保留、状态条件读出和信任门控,解决 GUI Agent 记忆压缩损失与无关干扰问题
- Recursive Synthesis for Long-Horizon Terminal Tasks
递归扩展验证式合成,每任务$0.05且难度持续攀升,显著提升Agent长程执行能力。
- SciRet: A Compute-Aware Empirical Study of Retrieval and Reranking for Scientific RAG
在科学问答RAG中,混合检索更鲁棒,跨域重排序可能有害,且生成忠实度随语料规模增大而提升。
- AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning
将自蒸馏的token级log概率差聚合成信念状态,通过贝叶斯递归更新定位关键回合,重塑轨迹级优势函数
- From Trajectories to Evidence: Auditable Experimental Records for Industrial Research Agents
提出将研究智能体实验轨迹转化为可审计、带边界的证据记录,用于可控的跨任务复用
- Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval
提出UniME-R1,基于检索反馈生成思维链纠正嵌入器混淆,借助难负样本与强化学习提升检索
- CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks
通过对抗性多求解器校准生成难度适中的终端任务,显著提升agent训练效果与泛化能力
- EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
让策略自身扮演环境生成响应,内化交互动力学,实现不依赖外部环境的智能体RL训练
- Filtered Vector Search in a Disaggregated Lakehouse: Composing Table-Format Pruning with Per-File ANN
将IVF索引嵌入Parquet文件尾部,复用Iceberg表已有的文件剪枝能力,先按过滤条件剪枝文件再执行向量搜索,避免独立的过滤步骤
- AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents
提出增量代码世界模型,将GUI变化预测为可执行HTML更新,实现高保真模拟和策略自适应提升
- BaKron: Efficient Quantization with Kronecker-Factored Hessians
利用双侧Kronecker-factored Hessian信息加速自适应舍入量化,复杂度与GPTQ同为立方级但精度更高
- Cleo: A Transparent and Controllable Chatbot for Conversational Commerce
通过混合架构分离确定性排序与 LLM 生成,实现可审计的产品推荐与决策支持。
- Comparative Approaches to Agent Retrieval over Large Skill Libraries
在技能检索中,知识图谱因边候选源于同一嵌入邻域而无法扩展排名器的召回边界
- Is Personalized Modality Weighting Actually Personalized? A Controlled Audit of Per-User Weighting Claims in Multimodal Recommenders
通过两个受控对比审计六种每用户加权方法,发现全局模态权重已捕获全部增益,个性化加权无一致效用,且普通置换测试会给出虚假个人化信号
- EXCISE: Query-Side Exclusion for Late-Interaction Retrieval
用查询端轻量模块识别排除主题并重排,无需修改索引,大幅提升排除查询准确率。
- The Bitter Lesson of Tool Calling
11/14 模型程序化工具调用匹敌或超越 JSON 调用,并行与长链场景下优势显著
- Gryphon-v2: One Model in Place of a Cascade - Generate-and-Rank Recommender with Rollout Distillation
通过Rollout Distillation将高成本排序教师蒸馏到生成式推荐 Ranking 模块,单一模型替代多阶段级联并获在线收益
- Personalized Deep Research Query Refinement with Graph-Scaffolded Evidence Grounding
利用意图引出图学习澄清策略,在平衡目标覆盖与证据成本下生成个性化查询,用户提问减少三分之二
- Training-Free Token-Level Steering for LLM Personalized Co-Writing
提出免训练的token级引导方法,在小数据集上实时控制LLM生成,显著降低人工编辑量
- NeSy-RAG: Neuro-Symbolic RAG for Explainable Question Answering
将检索文本块合成为可归因的Prolog模块并引入知识缺口检测,实现透明可溯源的RAG推理
- RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction
将生成式奖励模型从标量评分转为利用其排名能力构造奖励信号,解决RL中比较优势与评分范式不匹配的问题
- Learning When to Trust via Selective Context Preference Optimization
提出选择性信任基准 MIST 与平衡 DPO 训练 SCOPE,使 LLM 在利用上下文时抵御误导信号
- Unified Agent: Managing Interactions across Devices
提出携带紧凑跨设备状态的统一智能体,利用交互证据解决设备未指定的请求,性能显著优于无状态与多智能体基线
- TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories
提出TrajDebug,以多粒度历史压缩和证据驱动错误识别追踪错误生命周期,定位关键失败步骤
- RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer
通过对比有无英文参考解答的教师分布,定位推理枢轴并引导特权蒸馏,提升多语言数学推理能力
- On-Policy Self-Distillation without Any Supervision
用模型多路采样投票伪标签实现对未标注数据的高效在策略自蒸馏,在数学推理上超越有监督方法
- The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents
利用下一帧截图作为特权信息,通过门控蒸馏将未来知识注入前缀策略,显著提升GUI代理任务成功率。
- Causal Episodic Memory for Feedback-Driven Agent Repair
利用双极性因果记忆与类型条件检索,使冻结LLM在修复时复用过往成功修正,提升Text-to-SQL准确率
2026-08-06 30 篇 ★ 15 深度
- Distill Where You Fail: Recovering Learning Signals of Negative RL-Groups from Adaptive Teacher Guidance
针对GRPO中全错样本的梯度消失,用教师置信度加权OPD并选择高价值token蒸馏,辅以正确轨迹SFT,修复学习信号。
- AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling
解耦表示与生成,用高容量可解码连续潜在空间实现高质量文本扩散
- Quo Vadis, World Modeling?
将世界模型重构为以智能体为中心的世界代理,通过六种功能形式和三个赋能级别驱动智能体持续改善
- Search, Inspect, Fetch: Exploiting Boolean Retrieval for Deep-Research Agents
SIEVE 通过布尔查询语言实现网页结构感知的按需抓取,较传统全文检索减少 20-50% 上下文 Token 并提升准确率
- When Attention Goes Blind: Numerical Failure in ALiBi Positional Encodings
发现 ALiBi 的线性偏置在长距离下因浮点下溢导致注意力权重为零,提出 log 缩放距离等缓解方法
- When Teachers Mislead: Spurious-Signal-Aware On-Policy Distillation
提出 SA-OPD,通过过滤教师信号中输入无关的虚假成分,提升在线策略蒸馏的可靠性与效果。
- OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents
统一分解、记忆与验证的长周期 Agent 框架,跨多后端 LLM 泛化并达 SOTA 0.821
- SKILL-KD: Contrastive Skill Distillation for LLM Agents
将教师-学生行为差异蒸馏为可验证文本技能补丁,结合漂移感知整合维护紧凑技能库
- Know When to Stop: Segment-Level Credit Assignment for Reducing Overthinking
利用推理链中的中间答案承诺作为廉价代理,分段分配信用以抑制无益自我反思
- The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads
揭示所有大模型在个性化任务中系统性过度推理(35-49%),且自监测排名与真实忠实度负相关
- K-EXAONE 2.0 Technical Report
开源750B MoE多语言模型,通过upcycling和难度聚焦训练提升智能体编码与长上下文能力
- Toward Skill-Native LLMs: Skill Entropy for Benchmarking and Training Long-Horizon Reasoning
提出技能熵量化技能切换难度,构建Skill^2-Bench基准并设计Skill-Entropy RL训练框架,显著提升LLM长程跨技能推理性能
- ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation
通过后训练统一多模态模型,实现推理、工具调用与图像生成的端到端Agent策略优化
- ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignment
提出答案回溯的细粒度信用分配框架,为搜索代理的每一步提供密集步骤级监督,4B模型性能超越同规模甚至比肩30B模型。
- Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning
一种带角色分工与验证门控的Agent运行时,允许目标修正同时防止目标漂移,在固定模型下实现状态自进化
- Reasoning Core: Designing Broad Procedural Data for Completion-Supervised Reasoning Training
构建50个生成器的Reasoning Core,揭示紧凑目标和校准难度对完成监督推理训练的关键作用
- DEGR: Dual Exploration-Driven Generative Re-Ranking for Adaptive Cross-Request Context Bridging
提出双探索生成式重排序,通过混合监督-强化学习与探索性奖励模型自适应平衡即时与探索价值,提升电商推荐效果
- EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
将代理程序(harness)的本地进化成果跨客户端聚合,通过范围类型与行为证据解决程序编辑冲突
- Agentic Reinforcement Learning with Observation-Calibrated Self-Distillation
通过对比含/不含未来观察的结构化重放视图消除支架混杂,为GRPO提供校准的令牌级更新信号
- Caching for the Future: Scrub Jay Episodic Memory Principles for Agent Memory Systems
将灌丛鸦的What-Where-When记忆与类型条件时间衰减引入LLM Agent记忆,有效处理过期事实
- Skills Know Their Neighbors: Cluster-Contrastive Capability Pages for Skill Retrieval
通过聚类对比生成包含正触发、负边界和判别体的能力页,在不改变在线模型的情况下提升技能检索与路由性能
- Reward Structure Shapes the Interaction Between Episodic Exploration and Neural Memory in Reinforcement Learning
揭示探索奖励与记忆架构的互补关系取决于奖励结构而非密度
- Optimizing What Policies Learn From: Recoverability-aware Rollout Intervention Learning
将 rollout 干预建模为在线 bandit,从 reward contrast 增益学习在何处、如何分支,提供更强的训练信号并节省算力
- Chained Recursive Language Models for Multi-Iteration Reasoning
将长上下文推理拆成多轮新鲜调用,通过摘要与黑板传递状态,避免错误累积
- MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning
在Muon正交化前加入行/列对角预处理,以极小开销缓解曲率各向异性,配合噪声自适应步长显著提升LLM预训练性能
- MemoryCPT: An End-to-End Agent Memory Framework for Cost-Performance Trade-off
通过离线蒸馏记忆构建 + 在线GRPO摘要优化,在长对话问答中同时提升答案质量并大幅降低推理成本
- Hierarchical Graph Memory for LLM Agents with Path-level Localization and Rewrite
提出分层图记忆框架HiGram,通过MicroGraph路径级定位与协调重写,提升长程对话问答质量并大幅降低Token消耗
- OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling
通过递归检索代码依赖构建富含长距离依赖的长上下文数据,仅占12%训练数据即大幅提升长程检索与Agent任务
- Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?
提出 Skill-Use 基准,从触发、合规、边界三维度评估 LLM Agent 在渐进式披露下自主检索并遵循技能的能力,发现最高 SU 仅 0.613,触发与合规是独立瓶颈,排名依赖框架。
- Multi-Objective Ranking for Live-Streaming: Balancing Fresh and Delayed Signals with Segment-Aware Targeting
通过延迟窗口、双模混合新鲜/延迟信号与MMoE,实现直播推荐多目标平衡及用户分群定向,DAV+0.09%
2026-08-05 30 篇 ★ 18 深度
- Compute Globally, Materialize Locally: The Memory Contract of Sparse Event-KV
从服务中省略源观测,下游事件的KV缓存仍能携带上游计算结果,且可被程序化写入
- Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures
提出基于组件交互边的Agent失败分类法,41种模式指定故障方,使评估直接指向可修复组件
- AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?
提出在流式任务流下评估自进化LLM代理的框架,揭示能力、方法与场景的交互规律
- DiffusionGemma Technical Report
通过微调 AR 模型结合 RL 与采样器蒸馏,实现离散扩散文本生成,速度达 ~1500 TPS,远超自回归模型
- MerchantBench: Benchmarking LLM Agents for Long-Term Coherence in E-Commerce Operations
提出首个电商卖家长期运营模拟基准,评估LLM智能体在365天中维持连贯决策的能力,揭示LLM远逊于人类
- Relax Within, Balance Across: Geometry-Guided Load Balancing for Vision-Language Mixture-of-Experts
提出ReBA,通过模态分离与图像内放松路由,解决视觉语言MoE在不同token混合下的负载失衡
- PCSD: Persistent Consistency for Self-Distillation in Agentic Reinforcement Learning
通过教师信号局部持久性计算token级权重,联合GRPO缓解Agent稀疏奖励问题
- DAPD: Dual-Anchored Policy Distillation
识别 OPSD 中信息不对称为特权幻觉根源,提出双锚点蒸馏框架 DAPD,在多个任务和尺度上大幅提升性能。
- DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents
通过多模态事件图合成中间视觉依赖的推理数据,训练Agent主动获取视觉证据驱动多轮搜索。
- GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoning
在 Transformer 层插入可优化隐状态,利用因果注意力将奖励梯度直接赋予隐状态,提升推理精度与鲁棒性
- Progressive Agent Skill Generation via Reinforcement Learning
用 RL 将技能生成为局部编辑序列,以 rollback reward 提供信用分配,显著超越基于流水线或启发式的方法
- LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks
通过管理-执行-审计(MEA)循环显式维护任务状态并独立审计,在 WeaveBench 上将完成率从 51.8% 提升至 80.7%
- Wnuan: Staged Post-Training for Question Answering over Proprietary Enterprise Knowledge
三阶段后训练流程将企业 QA 可接受率从 52.76% 提升至 91.51%,其中残差错误采样 RL 显著优于全量采样
- Knowledge-Geometry Decoupling: Refreshable Pretrained Transfer for Streaming Recommendation
通过解耦预训练知识刷新与任务几何学习,使每日更新不干扰下游模型,在电商搜索中提升GMV 1.75%
- Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State Injection
利用 SSM 固定大小隐藏状态实现 O(1) 预填充的语料检索与记忆巩固,在边缘设备上实现 4500 倍加速
- Beyond the Final Prompt: Measuring the Effect of Within-Conversation Context on AI Answers
实验证明忽略对话前置上下文会导致44.7%的回答发生实质性变化,压缩前缀仅部分弥补
- PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agents
构建受控实验揭示代理改进并非必然源于正确的经验路径,并设计 Hermes+ 强化 save-retrieve-update 机制
- SkillJack: Persistent Skill Backdoors in Self-Evolving Agents
首次揭示自进化智能体的经验到技能转换如何将中毒经验固化为持久、可路由的后门技能
- TurnSight: Turn-Level Hindsight Self-Distillation for Tool-Integrated Reasoning
利用多前瞻视野的执行条件后见信号调制 RL 优势,实现多轮工具推理的精准轮次信用分配
- Field Aware Agent Skill Retrieval
保留技能的多字段结构分别计算相似度并学习得分融合,显著提升技能检索召回
- ATLAS: Learning to Recommend Across Unseen Domains
通过对抗对齐 + Gromov-Wasserstein 对齐 + 残差矢量量化,在不接触目标域的条件下实现零样本推荐。
- ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
构建动态评估框架,揭示顺序执行提升性能但技能库维护未显著超越纯上下文学习,技能泛化仍难
- Attacking and Defending Multi-Agent Collaborative Filtering Systems Through Connectivity
系统揭示候选数与目录集中度如何不对称地调制攻击与防御效能,发现语义攻击更持久,静态图度量可预估风险
- LLM-Derived Priors for Thompson Sampling in Cold-Start Comment Recommendation
将评论文本的LLM语义信号转为Beta先验,使分段Thompson采样在稀疏反馈下CTR提升可达9.5%
- Conditionally Identifiable Latent-Environment Modeling for Out-of-Distribution Recommendation
提出可识别潜在环境的推荐框架,利用条件指数族和特征索引多项式建模偏好偏移,并通过边际化预测提升OOD鲁棒性
- ReflectRL: Learning from Golden Negative Trajectories via Reflective-to-Direct Reasoning
利用专家模型失败轨迹(黄金负样本)进行反思式推理,并通过策略过渡将能力迁移至直接推理
- SITA: Semantic Interest Tokens for Target-Aware Compression in Long-Sequence Recommendation
通过语义码本组织兴趣令牌,在离线压缩的全局兴趣中实现目标感知选择
- Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent
首个统一视频深度研究数据、训练与评估的框架,通过解耦感知-探索与GRPO纠正模态偏见,35B模型超越闭源SOTA
- Position Bias Undermines Preference Consistency in Listwise LLM-Based Reranking
提出成对/全局/输出三层一致性指标,揭示LLM重排序的排列敏感性远超曝光偏差修正所能解决
- Training Documents Reranker with Search Rubrics for Deep Research Agent
提出层级式搜索评分标准,指导文档重排序器训练,提升智能体检索质量并减少搜索调用次数
2026-08-04 30 篇 ★ 30 深度
- Weak-to-Strong On-Policy Distillation
通过对比弱模型提取能力方向并锚定到学生基模型,构造代理教师实现弱到强蒸馏,使强学生超越弱教师
- Constitutional Midtraining: Content Presence Drives Alignment Gains
仅在中训阶段插入少量宪法性文本,即可获得经下游微调后仍持久的对齐泛化收益,且能力无损
- SAF-OPD: Stable Advantage Fusion for On-Policy Distillation
通过稀疏压缩控制量级、预热退火调度时间,稳定GRPO与OPD优势融合,避免熵崩溃并提升生成质量
- Don't Offer What Can't Be Done: Deterministic Executability Gating for LLM Skill Selection at Scale
在LLM技能路由中,用技能内部退出条件做确定性过滤,避免推荐不可执行的技能,节省59%的上下文token并减少7.8%的错误选择
- Search-GRT: Guided Retrieval Training of Search Agents to Optimize for Complex Question Answering
在 RL 训练中利用 ground truth 约束检索候选集,提供更强学习信号,多跳 QA 性能提升超 40%
- SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
提出SKT数据合成流水线,通过多阶段验证生成可执行任务与忠实轨迹,SFT后模型技能利用率显著提升。
- Tevatron Meets Megatron: Expert-Parallel LLM Reranker Training on an Academic Budget
为Tevatron重排序工具包引入Megatron训练后端,通过专家并行实现30B MoE重排序器训练,同时保持HF兼容。
- UEmbed: Unified Sparse and Dense Multimodal Embeddings
首次在纯因果解码器架构中同时产出稀疏词汇表示与密集语义向量,统一多模态检索。
- Collaborative Memory Augmentation for Generative Recommendation
提出 OMEGA 框架,通过潜在压缩记忆库和目标感知检索将全局协同信号显式注入生成式推荐
- Control Under Compression: Reliability Frontiers for Tool-Using Agents
代理控制上下文压缩存在非线性可靠性前沿,环境执行验证揭示从近全保留到脆弱的三个区域
- Global Optimization and Inference-Time Region Grafting for Agentic Workflows
在推理时对离线全局工作流进行局部区域替代,利用无标签质量信号实现单输入自适应,无需重训练
- Can AI Agents Simulate A/B Test Outcomes? A Validation Framework for Agentic Experimentation
提出 S-RCT 框架并验证:预校准和 within-subject 设计可将 Agent 模拟 A/B 测试的平方误差降低约 77 倍
- Douyin Multimodal Embedding Model Technical Report
通过隐证据推理与跨条件重构,使 bi-encoder 嵌入兼具细粒度语义充分性,在 MMEB-v2 和抖音搜索中取得显著增益
- HindSearch: Trajectory-Level Hindsight Critique for Search-Augmented Reinforcement Learning
利用黄金答案生成失败轨迹的指令性批评,通过on-policy distillation使搜索RL获得密集信号,平均EM提升至39.4%
- HyperAgent4POI: Dynamic Semantic Message Passing on Multi-Agent Hypergraphs for Missing-Modality Recommendation
在超图层内用冻结Llama+LoRA联合完成模态补全与软关联细化,有效应对POI多模态缺失
- IACM-RL: Intent-Aware Context Management and Reinforcement Learning for Complex Tool Invocation under Dynamic Intent Fluctuations
提出自生成上下文管理器与分层意图奖励,解决动态意图噪声下工具调用中的状态漂移和无限循环问题
- Self-Improving Large Language Models via Progressive Experience Evolution
统一显式经验演化与隐式RL优化的两阶段后训练框架,通过全局经验池萃取可迁移知识并内部化,提升数学推理与数据效率
- Cross-Domain Hybrid OPD for Generalizable Search Agents
结合搜索RL与多领域专家在线策略蒸馏(OPD),同步优化搜索能力与通用推理,有效缓解对齐税
- Advancing Relevance Measurement with Vision-Language Models for Web-Scale Search
用微调VLM替代人工标注,结合分层采样,将搜索A/B实验的MDE降低6倍且成本降至近零
- LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
通过并行循环记忆分支和上下文更替训练,使LLM在证据离开工作上下文后仍能依靠记忆状态保持推理连续性。
- PredAct-Bench: Benchmarking Tool-Augmented Dialogue under Controlled Tool Noise
提出首个在预测工具噪声下评估对话智能体的基准,发现LLM过度依赖工具而人类能更校准地采纳建议
- Qwen-CUA: Native Computer Use for (almost) Everything
仅凭截图与键鼠的原生计算机使用Agent Qwen-CUA,在八大基准上全面超越Qwen3.7并媲美GPT-5.5与Claude Opus 4.8
- RoMeRL: Balancing Feedback Coverage and the Memory-Reward Trap in Self-Evolving Agent Memory via Reduced-Order Utility States
用四个固定语义坐标替代轨迹级效用,将反馈密度提升6倍,记忆量减少84%并阻断噪声奖励
- SmartGR: Hierarchy and Beam-Aware Knowledge Distillation for Generative Recommendation
提出层次感知SID蒸馏与束感知排序蒸馏,解决生成式推荐中蒸馏难度不均衡和束搜索前缀误剪枝问题。
- SPEAR: Selection-aware Personalized End-to-end Adaptive Rewriting and Retrieval for Community Search
通过梯度隔离双嵌入、乘性门控和动态选择器,解决改写-检索错位与通用词主导效应,点击召回@10提升99.5%
- Unpaired Modality-Agnostic Generative Recommendation
让生成式推荐从配对、纯图、纯文混合数据中学习统一的语义ID空间,消除多模态配对瓶颈
- Fetch-then-Explore: Decoupling Selection from Extraction over a Persistent Workspace for Search Agents
将文档选择与证据提取解耦到文件系统工作区,搜索代理可反复回查已选页面,准确率大幅领先传统浏览接口
- Requirement--Evidence Alignment for Compositional E-Commerce Queries
将查询需求与商品证据显式对齐,通过需求感知分组策略优化,大幅减少组合查询中的近线失误
- Diagnosing Search Behavior and Failure Modes in Long-Horizon Search Agents
通过轨迹级诊断揭示搜索努力与答案质量弱相关,证据检索召回率才是核心,失败可拆分为检索缺口与利用缺口
- A Self-Triggered Agentic Push Recommendation System
将推送推荐建模为自触发闭环决策,用DT联合优化时机与是否推送,显著提升活跃度并降低计算开销
2026-08-03 30 篇 ★ 15 深度
- From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement
借用自监督学习的任务变换思想,将开放任务重构为基于信息不对称的自我博弈游戏,自动产生可验证训练奖励
- VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System
用可执行 Blender 代码作为过程级思维链,将物理推理与视觉生成解耦,显著提升视频物理一致性
- QQWorld: Quantile-Quantile Matching for World Model Regularization
用分位数-分位数匹配替代Epps-Pulley检验,解决世界模型潜在表示重尾控制失效问题
- ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction
首个同时评估值准确率、记录完整性、溯源和成本的模式引导提取基准,揭示长文档截断与成本权衡
- LLM-Based Generative Retrieval for Snapchat Content Recommendation
首次部署 LLM 生成式检索:多模态 PPR 行为 SID + 两阶段词汇接地 + 推理优化,线上观看时长提升 0.37%
- Evaluation-Verification Reward for Consistent Multi-Reference Image Editing
提出多维度评估-验证奖励(EVR),用 MLLM Evaluator 和 Verifier 产生可靠细粒度信号,通过 RL 微调提升多参考编辑一致性
- Scaling Properties of Text Conditioning in Visual Generation
扩散损失随结构化提示的信息量线性下降,而非标记数,引导出更强的提示器和模型
- Beyond Retrieval: Analytic Memory for Multimodal Agents
提出分析记忆,将多模态交互历史结构化为可查询表以支持过滤、聚合等分析运算
- Beyond Component Testing: Validating Agentic AI Systems
提出五维验证分类法(行为/安全/时序/监管/多智能体),揭示轨迹级验证是关键空白
- From Code Review to Code Critique: Intent, Drift, and Spotlight for AI-Generated Diffs at Scale
提出意图预测、漂移检测和代码聚光灯三大机制,革新 AI 编码代理的代码审查流程
- Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation
将多轮工具调用交互分解为逐角色生成与验证,用高质量合成数据让 0.6B SLM 无需 CoT 即超越 4B 基座。
- Knowing When to Quit: Diagnosing and Training LLMs to Abort Futile Reasoning
提出CaRL框架,通过能力校准奖励与事后拒绝增强,让LLM在超出能力时学会放弃而非生成看似正确的无效推理
- EvoReason: Self-Evolving Reasoning Primitive-Guided On-Policy Distillation for Latent Reasoning in Generative Recommendation
提取可复用推理原语并自演进,引导结构化链式思考,通过在线蒸馏将推理能力迁移到潜在表示,实现高效生成式推荐。
- GALA: Generative Aligned Learning for Adaptive Multimodal Representation in the Taobao Shangou Recommender System
三阶段流程:行为感知预训练、GRPO行为对齐、自适应门控融合,使多模态嵌入动态匹配用户意图,提升排序效果
- LEMUR: Learning to Align with Multi-Objective Reinforcement Learning from Preference Feedback
通过多人偏好反馈联合学习多奖励模型与策略,无需预定义奖励函数即可平衡多个竞争目标
- Learning Latent Reasoning Traces for Scalar Reward Models End-to-End
将推理链视为隐变量,端到端最大化标量RM的数据似然,统一生成与判别目标,提升OOD泛化。
- PaletteID: Prototype-Composed Semantic Identifiers for Multimodal CTR Prediction
用原型选择替代量化编码,保留连续相似性信号,提升CTR预测和长尾表现
- QASP: Query-Adaptive Robust Vector Search Policy
通过学习预测每个查询的召回进度曲线,以极低推理开销实现查询自适应搜索,显著降低方差与数据访问。
- Bridging the Question-Answer Gap in Retrieval-Augmented Generation: Hypothetical Prompt Embeddings
将假设内容生成从查询时移至索引阶段,用预计算的假设提示嵌入将检索变成问题-问题匹配
- Don't Contrast the Impossible: Region-Constrained Batching for Contrastive User Modeling on a Local Community Platform
提出区域约束批采样(RCBS),通过构造区域同质mini-batch将地理不可能负样本替换为可行负样本,提升用户表征质量与下游推荐效果
- RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems
用Thompson采样选择编辑方向,LLM负责具体代码修改,在有限预算下稳定优化推荐模型
- ResKV: Reconstructing Omitted Attention Contributions for Fixed-Budget KV Cache Compression
将KV缓存预算分为精确主缓存与紧凑残差缓存,同框归一化复原被丢弃token的注意力分子分母贡献,广泛提升长上下文性能。
- Think2Go: Generative Next POI Recommendation with LLM Reasoning
统一SFT与RL推理,用时空不确定性校准优势估计,大幅提升LLM对语义ID的理解和跨域泛化
- TransX: Scaling Transformer-based Recommendation via Behavioral and Serving Stream Crossings
用Encoder-Decoder解耦行为流和服务流,结合分组稀疏交叉注意力与近线缓存,在LinkedIn实现CTR+6.0%且在线计算降低80%
- Zero-Mem: Zero-Token Memory Operations for LLM Agents
提出零Token记忆框架,用实体图和时序层次替代生成式抽象,全部记忆操作不占用LLM调用或Token。
- Know It, Act on It: Investigating Memory Utilization in LLM Personalization
解耦“知道”与“行动”的评估范式揭示:LLM agent 能记住用户偏好却常不据此行动,健康领域尤甚。
- Role-Break in Attention Heads: Understanding and Detecting Hallucinations in VLMs
发现幻觉使注意力头偏离忠实上下文行为(角色断裂),基于此构建轻量线性检测器,AUROC 达 93.23%
- The Parts Are Greater Than the Sum: Automated Task Sequencing for Efficient Training of Multi-Policy LLMs
提出自动化任务分组与排序框架,用独立 QLoRA 解耦优化路径,在固定参数预算下提升异构任务微调性能
- Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember
让技能记忆在工具增强的自对弈中与任务生成协同演化,失败案例蒸馏为可复用技能写回记忆
- Adaptive FastOPD: Progress-Aware Rollout Horizon Expansion for Efficient On-Policy Distillation
通过监测 OPD 训练进度并仅在边界区域进展停滞且充分利用当前长度时扩展 rollout horizon,自适应加速训练达 71.2% 并保持最优性能。
2026-08-02 30 篇
- AI Tour Meeting: Group Travel Planning by LLM Agents
用多个具有不同人格的LLM Agent通过对话协商制定满足群组约束的行程,提供模拟与分析平台
- Is Deep Research Reliable? Misleading Knowledge Induces False Conclusions
构建误导性知识评估框架,发现深度研究智能体易受虚假信息影响,错误结论采纳率高达54.7%
- OmniScope: Modality-Decoupled Token Compression for Omnimodal Large Language Models
训练无关的模态解耦压缩框架,解决音视频跨模态显著度错配,实现高效全模态推理
- Fairness Pruning: Locating Demographic Bias in GLU-MLP Layers via Differential Activations
提出一种轻量级结构干预方法,利用差分激活定位LLM中与人口偏见相关的极少神经元,剪枝即可解耦偏见与能力
- LEDGERMIND: Provenance-Constrained Multimodal Agentic Reasoning with a Structured Evidence Ledger
将多模态Agent轨迹构建为溯源约束状态机,用结构化证据账本限制推理,提升准确性与轨迹忠实度
- PhiZero: A World Model Built Around Physical Language
从野生视频自监督学习紧凑离散物理语言,先推理后渲染实现物理一致生成与零样本动作迁移
- THGFM: Dual-Branch Temporal Heterogeneous Graph Fusion Model
双分支架构融合共享与类型特定时序注意力,配合旋转时序注意力,实现高效跨类型迁移与关系感知特化
- Change2Task: From Repository Changes to Executable Coding Agent Tasks and Environments
利用合并 PR 逆向重建健康代码库上的可验证编码代理任务,成功率达 79.6%,比 PR 基线多恢复 29.2%
- Beyond a Single Judge: Simulating Social Persona Panels for Generative UI Evaluation
用多角色证据锚定与社交加权面板评价生成式UI,与人类评分的相关性从0.716升至0.922
- Beyond Frame Selection: Generative Latent Evidence Aggregation for Long-Video Understanding
通过查询条件分布引导隐式证据聚合,在帧选择后生成紧凑跨帧证据,以极低成本大幅提升长视频理解准确率
- LLMs struggle to simulate human belief updates in controlled environments
LLM 仅在给定真实初始立场时可匹配人群分布,自身生成初始立场与更新过程均不忠实
- When Derived Measurements Mislead: Quantifying and Mitigating LLM Over-Trust with Privileged-Modality Reliability Evidence
定义衍生特征过度信任(DFOT)问题,提出特权模态蒸馏缓解LLM错误信任,在医学时序数据上修复误差率提升1.82-6.69个百分点
- Dynamic Exploration Graph: A Novel Approach for Efficient Nearest Neighbor Search in Evolving Multimedia Datasets
提出动态图索引 DEG,以连通性保持顶点删除和分布无关扩展实现高效动态 ANNS
- EMBL AI Librarian: Life-Sciences Knowledge Layer for AI Agents
将结构化文献搜索升级为自然语言证据检索层,大幅提升科学代理的问答、验证与综合性能
- FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval
提出自动化细粒度五元组数据集构建与两阶段解耦微调,显著提升MLLM零样本复杂图像检索性能
- SCOPE: Supply-Chain Operations through Coupled Policies for End-to-End Coordination
将供应链多阶段决策实体化为token,通过共享表示和顺序解码实现端到端协调。
- A foundation model of numerical intelligence with cross-disciplinary generalization
提出 UNICON,以图结构示例作为上下文学习数值系统预测关系,实现跨学科零样本泛化,结合 LLM Agent 可超越专家模型
- Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees
提出自适应预期策略树,在空闲时提前规划 GUI 动作分支,事件触发时即时匹配执行,消除自回归解码延迟
- Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPO
用三个动作令牌(回应/倾听/忽略)与 GRPO 强化学习,让语音助手自主决定是否开口
- Stage-Replay Divergence Follows the KV Cache: Fixed-Prefix Precision Controls and Bidirectional Cache Transplantation
发现推理阶段回放的分歧由KV缓存状态决定,FP32可消除BF16下的解码分歧,双向缓存移植证实因果性
- Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning
CoRA 利用输出信息构建条件空间,无需微调即可将冻结编码器转为任务导向检索器,支持端侧多模态示例选择
- GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation
微调图语言模型检索器在多跳知识图谱RAG中取得跨领域SOTA,泛化性优于GNN和向量检索
- ORCA-bench: How Ready Are Language Model Agents for Oncall?
在真实微服务系统中评估LLM Agent的根因分析能力,最佳准确率仅25.3%,暴露严重幻觉与代码依赖
- PAIChecker: Uncovering and Checking PR-Issue Misalignment in SWE-Bench-Like Benchmarks
提出多智能体系统PAIChecker,三阶段渐进式验证PR-Issue错位,准确率达92%
- Same Graph Cross-Task Transfer in GNNs: Protocols and Predictors
提出无泄漏评估协议并揭示节点分类与链路预测跨任务迁移的方向性和可预测性
- VAD: Attributing Visual Evidence for Target Reconstruction in Multimodal On-Policy Distillation
通过反事实目标重构分离教师修正中的视觉可归因部分,提升多模态细粒度蒸馏效果
- VIG-RL: Learning to Search and Insert for Verified Image Grounding
将验证性图像基础建模为动态决策过程,用强化学习优化搜索-选择-插入的 agent 循环
- VisualRouter: Query-Grounded Visual Sampling for Long Video Understanding
区分全局/局部查询的自适应视觉采样框架,即插即用,无需训练,显著提升多模态大模型的长视频理解能力。
- An Exploration Graph with Continuous Refinement for Efficient Multimedia Retrieval
提出 crEG,快速构建紧凑且连通性保证的图索引,专为探索搜索优化,推荐场景价值突出
- Explaining Image Similarity with Automatically Extracted Concept Activation Vectors
用稀疏自编码器自动发现概念方向,通过嵌入扰动解释图像相似度的全局因素
2026-08-01 30 篇 ★ 5 深度
- Multi-Head Attention Residuals
将注意力残差的单头路由查询改为多头,零参数提升模型跨度,单头在大模型退化成有害
- CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition
首个多模态上下文学习基准,解耦上下文定位、信息应用与知识学习三维度,揭示模型严重不足
- Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainability
系统探索文件系统记忆,证明组织能显著降低检索成本,但难以维持且无法直接提升答案质量
- MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis
自动化将开源命令行程序转为无源码训练环境,用教师轨迹微调小模型,使编程从零构建性能大幅提升
- See2Think: Do Multimodal Models Really Use Intermediate Visual States?
构建统一评估框架See2Think,诊断多模态推理中中间视觉状态的生成、渲染与利用瓶颈
- β-OPSD: Deriving with Policy Optimization, Training with Self-Distillation
将on-policy自蒸馏统一为KL正则化策略优化族,通过可控的logit插值目标与return-to-go信用分配替代直接教师模仿,显著提升推理模型训练稳定性与性能。
- BayesAME: Bayesian Active Model Evaluation
通过贝叶斯序列设计自动停止,用信息增益选评估项,以历史模型相似性为先验,实现高效基准评估
- Beyond Geometric Complementarity: Coherent Overlap in Sparse Mixture-of-Experts Routing
发现MoE路由中专家子空间大量重叠,但多专家计算仍具功能增益,称“一致重叠”。
- Beyond Borrowed Histories: Person-Aligned User Simulation for Interactive Role-Playing Evaluation
提出基于用户模拟器的个性化评估框架,解决现有基准使用固定对话史和通用评分的问题
- Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers
提出混合扩散 Transformer 及异配缩放规则,在图像/视频生成中实现 7.3× 计算效率提升与 30 秒零样本长度外推
- Can Large Language Models Execute Parent Orders?
首次系统研究用LLM做母订单执行,提出分层框架PACE,零样本超越传统和学习型基线0.65基点
- Hierarchical Reranking for Scalable Financial RAG System
通过预检索优化、两阶段层级重排序与自适应长上下文管理,显著提升金融RAG的检索精度与事实一致性
- KAMR: Grounding Generation via Knowledge-Aligned Multi-hop Retrieval
区分锚点与链接三元组,通过全局召回与局部扩展提升图多跳检索的证据完整性
- RefCaptioner: Multi-Reference Image-Grounded Video Captioning
提出多参考图像指导的视频描述任务,用分层覆盖折扣GRPO实现短语级绑定与干扰拒绝
- Σ-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems
提出在线维护 peer 能力与关系的可靠性记忆,通过残差引导、路由与投票复用,无需重训模型
- ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadow
通过影子对与跨影子预测解耦外观与动作,使视频世界模型零样本复用任意演示动作。
- SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them
提出三阶段框架让 VLM 学会调用空间工具,再将工具能力内化到自身,推理时无需工具仍高性能
- DenseOn with the LateOn: Fully Open Dense and Late-Interaction Models for Multilingual, Long-Context, and Code Search
开放训练数据与 recipe 下,翻译训练使 late-interaction 比 dense 模型对未见语言泛化更好
- Rethinking Inference-Time Scaling in Local Computer-Use Agents: Failure Modes and Compute Tradeoffs
系统实证表明,推理时扩展在本地 CUAs 中收益递减且会改变失败模式,需选择性地分配计算
- Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B
在相同生成token成本下,所有自我审视方法均不优于简单重复采样,且模型增大后改写类方法仍显著落后。
- DualG-MRAG: Decoupling Macro-Reasoning and Micro-Matching for Multimodal Retrieval-Augmented Generation
双层次图框架解耦宏观拓扑推理与微观证据匹配,抑制多模态RAG中的检索噪声
- Would You Walk to the Car Wash? Revealing the Salience Bias of Large Language Models in Commonsense Reasoning
LLM在常识推理中易被无关显式干扰项劫持,实为知识被抑制而非缺失,轻量提示即可大幅恢复。
- On-Policy and Off-Policy Learning for Large Action Spaces
通过结构化贝叶斯先验与优化友好的目标,使上下文老虎机在万亿级动作空间下高效探索与安全离线学习
- Capturing Token Tendencies for Training-Free Token Pruning in Multimodal Large Language Models
通过捕捉注意力流动量实现动态可逆的视觉Token剪枝,避免“晚期绽放”关键token被过早丢弃
- (Towards) Scalable Reliable Automated Evaluation with Large Language Models
利用多LLM成对比较与Elo评级系统,实现可扩展且可靠的文本质量自动评估,减少人工干预。
- CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance
提出CACHE-UK框架,通过低秩适配器、领域优先模块和稳定性控制器,缓解4-bit量化LLM在序列编辑中的灾难性遗忘
- OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
揭示VLM评判器普遍存在宽松偏差,并推出低成本开源奖励模型OS-Shepherd实现可靠自动化评估
- Measuring Alignment With Reader Highlights Net of Position and Length
提出剔除位置与长度偏差的评估框架,发现LLM重要性排序与读者高亮对齐接近人类个体水平
- WIDE: Boosting Adaptive LLM Inference via Token-level Dynamic Width Pruning
首个端到端可微分的 token 级动态宽度剪枝框架,支持预填充与解码场景,细粒度分配注意力头组与 FFN 通道组
- SVR: Self-Verifying Refinement via Joint Verdict-Confidence Reinforcement Learning for Adaptive Test-Time Compute
学习自验证与置信度作为内部控制信号,在推理时自适应分配计算预算,无需外部验证器
2026-07-31 30 篇 ★ 19 深度
- CADENCE: Closing the Reasoning Gap via Coverage-Adaptive On-Policy Distillation
用覆盖自适应调度、分叉提升与稠密奖励等六个组件,在单台 Mac 上将 0.5B 学生推理提升 21%+
- Memory for Large Language Models
提出以架构为中心的LLM记忆分类框架,沿表征、更新、持久性三轴统一碎片化研究。
- GPT-Red: Automated Red Teaming via Self-Play at Scale
训练自博弈红队代理自动发现提示注入攻击,对抗训练出最强鲁棒模型GPT-5.6
- Metis: Memory Foundation Model
首个记忆基础模型原型,将记忆内化为原生参数化状态和计算过程,用中间训练获得自主记忆能力
- SpecFirst: Behavioral Specification Elicitation as a First-Class Step in Agent-Based Program Synthesis from Scratch
将需求工程引入LLM Agent,先提取行为规范再合成代码,从零编程通过率提升6.9%-21.3%
- Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation
提出探索式建模,在训练中探索多个候选生成并选择最佳匹配,将探索作为预训练新轴,提升多模态生成模型效率与性能
- Revisiting Lossy Verification in Speculative Decoding: Mechanisms, Trade-offs, and Failure Modes
将有损验证方法分为截断式和协作式两类,揭示截断式分布失真的性能衰退风险与协作式需控制过度超出的关键准则
- AskChem: Claim-Centered Infrastructure for Chemistry Literature Synthesis
将文献检索单元从论文改为携带出处的原子声明,构建分面分类与证据图,提升AI代理答案可追溯性
- Beacon: Knowing When and How to Perform Agentic Visual Reasoning
提出必要性感知自适应奖励与提示引导能力扩展,使模型能自适应调用工具并获真实性能增益
- BM25 Wins at Scale: A Scaling Study of Retrieval-Augmented Generation Paradigms
在450倍语料规模扩展实验中,BM25在大约1000万词元后全面超越文件系统Agent和图RAG,成为准确性最高且成本最低的默认检索方案
- Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory
将参数化长期记忆模块扩展至 6.9B 参数、300B 令牌预训练,小 backbone 搭配大记忆在多项基准上超越更大纯骨干模型且总参数更少
- Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
通过协同演化循环构建有深度、可自适应修复的合成环境,显著提升计算机使用智能体的性能与迁移能力
- Flux-OPD: On-Policy Distillation with Evolving Contexts
通过反向KL分解揭示蒸馏目标为几何平均,用进化上下文进行校正和加权,解决开放域任务缺乏可验证奖励的问题
- Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering
通过执行反馈训练 Draft/Improve/Debug/Crossover 原子算子并组合长程进化搜索,在有限 GPU 预算下将 MLE-Bench Lite 奖牌率从 39% 提升至 71%
- MemHarness: Memory Is Reconstructed, Not Replayed
提出记忆重构范式,让LLM Agent基于当前状态改编检索经验,端到端GRPO训练,防止负迁移并提升OOD鲁棒性
- Harness-G: A Graph-Structured Harness for Search Agents
用有限动作菜单替代自由形式查询,消除检索等价崩溃,并在同一状态下进行结构化信用分配,训练更稳定的RL搜索Agent
- OneShot: Index-in-Ranking with Neural Scoring for Large-Scale Retrieval
首个端到端可训练的检索索引框架,将索引学习与排序目标对齐,并通过神经评分突破点积瓶颈,已在 Instagram 全量部署。
- Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents
统一移动/电脑/网页的 GUI 代理,结合真实设备环境与数据飞轮,实现多平台 SOTA 性能。
- ReToken: One Token to Improve Vision-Language Models for Visual Retrieval
用单个可学习Token从视觉KV缓存中检索稀疏相关token,大幅提升长视觉上下文中的问答准确率
- LoopMemGR: From Behavior Logs to Evolving Memory for Generative Recommendation
首次将系统侧推荐决策轨迹建模为可跨请求复用的经验内存,提出三视图压缩读写机制,在工业级数据上显著提升生成式推荐效果
- CCFormer: Efficient Cross-Field Interaction and Hierarchical Sequence Compression for Industrial Recommendation at Tencent
统一特征域分离交叉注意力与子空间token混合,实现长序列推荐的高效交互与2.21×训练加速
- From Understanding to Action: Feedback-Grounded Policy Discovery for Generative Recommendation
识别理解-行动差距,提出反馈驱动的策略发现与关系蒸馏框架,将LLM决策知识迁移至轻量SID生成器,实现高效推荐
- Heterogeneous Ranking in Industrial-Scale Recommender Systems: A Case Study
提出 HA-MoE 架构将内容类型异构信号显式注入门控与专家调制,通过 LENS 可观测框架与 DL-AUC 指标打破负迁移并保障跨类型排序公平性。
- Lightning OPD 2.0: Mitigating Style Bias in Cross-Teacher On-Policy Distillation for Large Reasoning Models
通过交叉拟合风格残差化消除教师不一致带来的风格Token偏差,使OPD不再依赖教师一致性
- Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation
提出先解耦后量化的SID生成框架,将LLM纠缠隐状态分离为地理与语义槽再分别量化,大幅降低SID冲突并提升推荐效果
- MANTA: Multi-Agent Network Topology Adaptation for Self-Evolving Multi-Agent Systems
提出推理时拓扑自进化框架,根据任务和过程信号动态调整多智能体协作结构,在五个基准上平均得分74.0,超越最强基线5.8个百分点
- A Structured Knowledge Infrastructure for Domain-Specific Data Asset Discovery
基于知识图谱引导检索和场景感知排序,将广告数据资产命中率从19.1%提升至96.6%,Token降低71.6倍
- Hierarchical Latent Reasoning for LLM-based Recommendation
HiLaR 用残差量化和时间窗口监督构建粗到细用户偏好,对齐LLM潜在状态并以过程奖励优化层级贡献,在Amazon数据集上超越SOTA。
- ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation
通过GLM和DCA延迟交互并复用请求侧计算,配合IKBO内核优化,在不损失质量下最高获得3×QPS提升
- Restoring Collaborative Signals in Semantic-ID Generative Recommendation via Personalized Natural Language
在冻结的生成式推荐模型上,利用自然语言标签重建协同因子,层级重排候选,修复语义ID缺失的协同信号
2026-07-30 30 篇 ★ 14 深度
- Keep It InMind: Benchmarking the Implicit-Association Blind Spot in Agent Memory
提出 InMind 基准,揭示基于检索的记忆系统在间接查询中因缺乏相似线索而系统性地遗漏关键记忆,差距从 84% 跌至 14%
- Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model
利用类视频编码的 I/P 帧运动向量选择性编码动态区域,减少 75% visual token 并实现 3.5 倍推理加速的流式 VLM
- CAST: Game Solvers as Turn-Level Teachers for LLM Agents
将求解器状态价值变化转为回合级优势信号,缓解长程游戏中的信用分配难题
- CoRT: Counterfactual Replay for Token-Level Rubric-Guided Policy Optimization
提出反事实回放计算令牌级信用权重,在不引入辅助模型的情况下改进 GRPO 的令牌级优势分配
- DecoEvo: Score-Decoupled Co-Evolution of Solver and Rubric-Generator Skills in Text Space
提出解耦共进化框架,分别优化求解器与评分准则生成器,避免评估准则退化并提升性能
- MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities
提出解码器仅有的任意模态到任意模态统一框架,无需特定头或损失,支持链式生成与自我验证
- OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs
提出无训练的意图感知+内容感知双层动态预算分配,在不改变总压缩比下提升全模态LLM效率
- Visual prompt engineering for video models
自动修改任务图像(视觉提示)可显著提升视频模型推理性能,超过文本提示和测试时扩展
- Shieldstral
3B小模型通过二元问答统一异构审核任务,文本安全性能比肩7倍大模型,多模态达新SOTA
- SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution
将相关任务序列化并用单一策略交替执行任务解决与技能文档演化,以解耦信用分配实现跨任务技能迁移
- ASARL: Autonomous Social-Aware Relevance Learning for QQ Search
通过多智能体协同数据治理与分阶段偏好对齐训练,实现社交搜索相关性理解的自动化与社交感知
- Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents
提出 TSDS,集成轻量收敛探针与困惑度推迟规则,通过 LTT 联合校准,在边缘 ReAct 智能体上显著减少思考计算量并保证性能
- Learning from the Future: Privileged Self-Distillation for Sequential Recommendation
将未来交互作为训练特权信息,通过双视图自蒸馏提升序列推荐性能,不增加推理成本
- DIRECTOR: Dynamic Index-based Recommendation with Transport-Optimized Retrieval
用连续动态索引替代逐位自回归,通过最优传输耦合实现无重复、全局协调的平行重排。
- Multi-Decoder OneRec: Controllable Generative Retrieval for Multi-Objective Industrial Recommendation
用共享编码器+多 LoRA 解码器+约束束搜索,在统一生成式检索框架下实现多目标候选配额可控、梯度隔离与互补去重
- Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents
将工具获取形式化为代价感知的前缀停止,用后悔加权目标学习截止深度,以更少工具实现更高收益
- GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding
将 GPTQ 自适应舍入扩展到双边情形,通过反对角线并行化实现立方时间复杂度
- Embedding Items at Scale: Comparing GNN-Based and ID-Based Item Embeddings in the Yandex Ecosystem
大规模工业系统对比表明,GNN预训练嵌入仅在数据有限时有益,数据充足时端到端ID嵌入无差异
- CMT-RAG: Complementary Memory Traces for Multi-turn Multi-hop RAG
用子问题级记忆痕迹对齐对话记忆与检索,通过 SSM+DAG 实现跨轮依赖跟踪和证据复用
- IMFuse: Instance-Aware Multi-Layer Fusion for LLM-Enhanced Sequential Recommendation
自适应聚合LLM多层语义表示,以全局维度偏好与实例感知调制解决最终层坍塌,提升推荐质量
- InferScale: GPU-Native KV Injection for Personalized LLM Serving
通过 GPU 驻留的记忆 KV 缓存与 Chunked RoPE,使 TTFT 几乎不随检索上下文增长,吞吐提升 3.7–4.5×
- Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising
提出DASH,通过异构上下文折叠和思维轨迹联合建模,提升广告用户仿真的动作准确性及诊断价值
- Enhancing Generative Information Extraction with Two-step Validation: A Product Attribute Use Case
将小型PLM预测结果作为LLM的校验输入,提升低显著性实体的抽取效果,减少对大型模型的依赖
- NMKFR: A Robust Framework for Time-Aware Cold-Start Recommendation
提出神经记忆卡尔曼融合推荐器,利用后验协方差校准语义-时间融合以应对冷启动
- PSG: Pair-Space Generation for Efficient Generative Reranking
将生成式重排的原子从单品提升为有序物品对,解码步数减半,实现1.83倍加速且性能显著提升
- SERPO: Self-Evolving Rubric Policy Optimization for Open-Ended Test-Time Reinforcement Learning
提出自演化评分标准闭环,替代答案投票,实现开放式文本生成下的测试时强化学习,无需外部奖励
- Setoka: A Benchmark for Hierarchical User Understanding in Personalized Agents over Heterogeneous Data
首个心理学驱动的分层基准,评估记忆 Agent 从显式事实到人格特质的跨源推理能力
- Improving Item Discoverability in e-Commerce Search via Related Intent Generation
用 LLM 生成替代/补充/主题意图扩展召回,通过两阶段架构在头部用闭源模型缓存、尾部用蒸馏 SLM 覆盖,将流量覆盖率从 60% 提升至 80% 且成本仅 30%
- WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Models
将显式思维链压缩为可学习的潜在 token,在保持推理语义的同时提升 10 倍以上吞吐量
- CaIRec: Calibrated Modality Imputation for Incomplete Multimodal Recommendation
通过两阶段校准框架解决模态缺失导致的跨模态结构失真与偏好适应差距,提升多模态推荐鲁棒性
2026-07-29 30 篇 ★ 22 深度
- Codifying the Judge: Scalable Evaluation via Program Distillation
将LLM评判逻辑蒸馏为可解释的程序委员会,实现低成本、透明评估,匹配13B模型性能,并产生廉价奖励信号
- TRACE: Business Rule-Grounded Reasoning Curriculum for Knowledge-Preserving Parametric Tool Retrieval in Enterprise LLMs
通过两阶段课程与业务规则推理轨迹,在保持工具知识的同时实现单束解码的高召回工具检索
- A Vocabulary for Multi-Agent Automated Research Systems
为多智能体自动化研究系统定义八个可独立变化的架构坐标,分离生成式与评估式品味
- A New Role for Relevance: Guiding Corpus Interaction in Agentic Search
RARG 将检索相关性转化为 grep 遍历的文档顺序与匹配片段重排信号,以更少交互步数提升搜索收敛效率
- Memory Layer: Train the In-Model Cache for Recommendation Models
将物品嵌入缓存变为训练-服务共享的可写组件,消除表示不一致,冷启动提升5-6%,NE gap降低86%
- AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding
针对负载异构,专业化MTP与块扩散drafter,配合自适应验证深度,在Hy3-21B上实现1.98–2.40倍加速
- Spend Experts Where You Are Unsure: Confidence-Adaptive Routing for Mixture-of-Experts LoRA
利用路由器分布作为 token 置信度信号,动态分配专家数量,在匹配预算下提升 MoE-LoRA 性能
- Pass the Baton: Trajectory-Relayed On-Policy Distillation
通过检测前缀失败并让教师短暂接管生成修正轨迹,将错误前缀转化为有效蒸馏信号,显著提升小模型数学推理性能
- LLM-as-a-Judge for Evaluating System Responses in Conversational Music Recommendation
首次实证验证LLM评判者与人类在对话推荐响应评估中的对齐度,发现中等正相关且优于参考基线
- Tools Are Not Islands: Set-Level Tool Retrieval for LLM Agents via Query-Conditioned Hyperedge Prediction
将工具检索重构为查询条件超边预测,以工具集合整体为单位评分,并捕捉基数依赖的工具交互
- Grevo: A Unified Generative Recommendation Framework with Evolutionary Item Indexing
用统一多任务吸收tokenizer角色,通过后验驱动的离散索引进化持续缩小语义-行为鸿沟,无需额外模型或交替优化
- Hypothesis-Driven Shelf Generation for Personalised Recommendation
将推荐界面货架抽象为自然语言假设,解耦生成规划与目录检索,离线批量产出高质量个性化推荐行
- Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation
提出SharpRec,用平坦最小值对齐和重尾分布恢复解决LLM跨域推荐的参数干扰与性能饱和
- Reward Guided Decoding for Generative Recommendation
提出RGD框架,将业务价值注入解码过程,解决生成推荐中似然与价值不匹配问题,无需重训模型
- Localized Adaptation Reveals Distinct Learning Signatures in Transformers
不同层应用 LoRA 会形成各异的学习特征:词法绑定重早期层,事实关联偏后期层,行为策略学后期动作、中期门控
- MARS: Multi-Agent Re-ranking for Repeat-Order Food Delivery Recommendation
结合轻量级协同召回与 LLM 分阶段重排序,证明预训练 LLM 在复购推荐中可匹敌专用模型。
- MemLens: A Value-Aware Memory Management System with Interactive Analytics for LLM-based Agents
提出基于Shapley值的记忆价值评估方法,实现细粒度、可解释的智能体记忆管理
- MemSFT: Mitigating Alignment Tax with an External Parametric Memory
通过外部参数化记忆和token级动态路由器,在不修改基座模型参数的前提下注入领域知识,完全避免通用能力遗忘
- Structure-aware Relative Policy Optimization for Ranking
用 top-weighted Kendall-tau 距离归一化奖励差,使 RL 排序的优势估计偏向高效局部调整
- The Case Against Generation for Retrieval: Discriminative Language Models as Effective Retrievers
将LLM作为共享背板的双塔检索器,配合蒸馏与连续思考,性能匹敌生成式推荐且可规模化部署
- PILA: Plug-and-Play Insertion for LLM-native Advertising
将广告插入解耦为条件响应改写,作为轻量级 sidecar 模块,实现模型无关、即插即用且强度可控的广告融入
- RecoReward: Recommender-Guided Multimodal Description Generation for Recommendation
利用行为反馈训练内容生成,实现推荐感知的共享描述,推理时无用户成本
- SPARC: Sequence-aware Progressive Attribute Routing and Compression Framework for Generative Recommendation
在生成推荐中,先对多字段行为历史做上下文建模再压缩,使每个交互仅占一个 token 且不损失关键信息
- TopoGR: Revealing and Preserving Latent Structure of Semantic ID in Generative Recommendation
提出Bit-decomposable Semantic ID暴露汉明拓扑,在输入、监督、推理三阶段利用该结构,解决生成式推荐中tokenizer与generator的结构性不匹配
- TWICE: Two-Clock, Two-Window Learning for Long-Horizon Conversion Prediction in Online Advertising
将点击时钟与转化时钟解耦,用历史 pCVR 质量加权延迟分布学习长周期 CVR
- UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams
受互补学习系统启发,用路由令牌解耦识别与执行,稀疏任务走检索、重复模式自动参数化,实现流式记忆扩展。
- VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
从LLM原生词表直接构建可变长语义ID并用并行token集预测替代自回归,实现高效语义对齐的生成式推荐
- TRWH: A Text-Driven Random Walk Heterogeneous GNN for Semantic-Aware Sparse Recommendation
融合LLM用户/物品画像与异质GNN,通过随机游走增强稀疏图,发现LLM嵌入对图增强敏感
- WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing
提出面路由概念并构建基准,分离评测智能体选择知识源与使用知识源的能力
- The User Asks, Platforms Compete: How Agentic Recommendation Markets Take Shape
在用户代理中介的竞争中,宽访问带来注意力瓶颈,而结果问责可重新校准平台解释的影响力
2026-07-28 30 篇 ★ 17 深度
- DataPrep-Bench: Benchmarking LLMs as Training Data Preparators
首个端到端基准评估 LLM 数据构建与质量预测,提出 DAS 评分和技能引导代理
- Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making
通过读取冻结LLM的隐状态轨迹,轻量控制头在推理时做出模型选择与干预决策,大幅降低大模型调用成本。
- Interactive Training 2: Auditable Control Plane for Live Model Training
提供开源控制平面,通过共享协议让人类和智能体对训练过程进行实时、可审计的操控
- Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text
提出ProVisE框架,将图像生成模型的视觉答案解析为结构化预测,实现像素级空间推理的公平评测
- StateAct: Program State, before Pixels, for Long-Horizon Computer-Use Agents
提出以代码优先、程序状态为接口的多智能体架构,显著提升长周期任务成功率并降低成本
- Unsupervised Multimodal Intent Discovery via MLLM-Guided Concept Generation and Semantic Propagation
用MLLM生成高层语义概念并通过图传播产生伪标签,实现可解释的无监督多模态意图聚类。
- JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents
将可编辑画布作为智能体的记忆、动作空间与共享项目状态,支持长程多模态创作中的持续规划、生成、修订与人工干预。
- ClawRec: A Claw-Native Recommender System
提出Claw原生推荐范式,用证据关联的用户状态和边际策展实现跨平台互补推荐。
- Offline-to-Online Creative Optimization with Generative Models and Adaptive Testing
用历史A/B数据训排序模型引导创意生成,结合自适应在线实验筛选,AI最佳创意较人工最优提升45%
- Kimi K3: Open Frontier Intelligence
开源2.8T参数MoE模型,融合KDA、AttnRes和Stable LatentMoE架构,通过多领域多推理努力强化学习达到封闭前沿水平
- The Intruder Threshold: A Spectral Law for LoRA Fine-Tuning
推导逐层临界更新强度,无参数预测LoRA微调产生灾难性遗忘的侵入维度
- Escaping the Euclidean Void: Manifold-Informed Flow Matching for Sequential Recommendation
指出连续生成推荐中的欧氏空洞问题,提出训练时利用共现图锚点校正路径中间态几何的 MIRAGE 框架
- From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Search
提出结构化JSON协议作为中间表示,将闭源多智体的推理策略蒸馏到开源学生模型,显著缓解风格漂移和幻觉。
- CALMRec: Causally Aligned Language Memory for Long-Horizon Recommendation
用冻结 LLM 离线编译语义原子,通过三时间尺度记忆与倾向性校正分离持久偏好和曝光偏差,保守重排提升长周期价值
- Strategy-Aware Parameter-Efficient Adaptation for LLM-based Auto-Bidding
SAGE通过位置增强、文本对齐与约束门控LoRA,仅用不到10%参数实现策略感知的LLM自动出价最优决策。
- CogRec: Structure-Cognitive Fast-and-Slow Reasoning for Generative Recommendation
将推荐推理定义为SID空间内的Match/LateralJump/Explore操作,实现结构认知的快慢组合推理
- ConAlign: Conditional Alignment Framework for Balancing Biased and Unbiased Recommendation
提出条件门控对齐机制,选择性传递有偏知识,在流式训练下平衡有偏环境准确度与无偏偏好估计。
- CORE: A Unified Cascaded Ordinal Relevance Estimation Framework for E-commerce Search
将多级相关性预测重构为题序二分类级联,用步级GRPO优化LLM推理并蒸馏至BERT,线上坏例率降低15.94%
- D-Score: A Spectral Hidden-State Signal for Hallucination Detection in Large Language Models
提出D-Score,利用隐藏状态奇异值方向数检测LLM幻觉,单次前向传播无需外部工具
- The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillation
构建可控环境系统分析LLM智能体多轮长程规划的获取、塑造与集成机制
- LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendation
通过步骤级对齐与过程方向对齐提供细粒度隐式监督,结合个性化高斯混合引导的 RL 探索,实现高效且多样的生成式推荐
- Agentic Permissions Policy Algebra for Taint Confinement in LLM Agents
通过上下文分支与前瞻权限检查,将 LLM Agent 的数据泄露攻击成功率从 31-50% 压至 0-7%
- MEMOIR: Temporal Behavioral Memory for Recommendation Across the Preference-Drift Spectrum
用LLM编码时间窗口语义记忆并显式建模偏好进化轨迹,在高低偏好漂移用户上获得排序质量提升
- Mosaic: A Fleet of User Embedding Specialists for Recommendation at Meta
设计四种异构专家模型分别捕捉用户行为侧面,结合MRM与CRL消除冗余,离线NE与线上多面指标均提升
- OxygenREC-v2: Internalizing Discrimination into Generative Recommendation
通过行为指令条件生成与熵感知特权自蒸馏,将点击/加购/下单信号直接注入生成式推荐,无需外部奖励模型
- SpecFormer: Mitigating Embedding and Attention Collapse via Spectral-Aware Transformer for Recommendation
揭示推荐数据异质长尾引发谱坍缩恶性循环,用动态谱软化与谱感知注意力打破瓶颈
- Unifying Generative Recall and Multi-Objective Ranking in a Single Decoder-Only Sequence
用单个解码器Transformer和双查询前缀因果注意力统一生成式召回与多目标排序,表示耦合而优化隔离
- Looping Is Not Reliability: State-Bound Evidence and Typed Revision Contracts for Agentic Code Repair
揭示代码修复循环中正确补丁易丢失,提出状态绑定证据和类型化契约以保障代理可靠性
- LOCKS: Page-Local Compact Key Summaries for Efficient Long-Context Decoding
通过页面局部光谱摘要和稀疏选择,大幅减少长上下文解码中 KV cache 读取量,保持质量
- One Graph, Multiple Gains: Single High-Quality Item-Item Graph for Multimodal Recommendation
预处理构建高质量item-item图,在表征增强、交互图增强和优化增强三阶段复用以全面提升推荐性能
2026-07-27 30 篇 ★ 8 深度
- VisCo: Leveraging Large Language Models as Intrinsic Encoders for Visual Token Compression
提出 VisCo,把预训练 VLM 重用为内在视觉令牌压缩器,用参数共享自编码器和记忆令牌实现高压缩比下的领先性能。
- Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning
一个轻量PyTorch原生框架,通过异步循环实现策略训练与展开,代码简洁且性能与Megatron堆栈相当
- ICAE-Bench: Evaluating Coding Agents as Interactive Project Builders
提出首个从模糊需求出发交互式构建项目的编程代理评估基准,包含480个任务与自动用户模拟
- IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
多智能体框架将研究想法生成建模为质量-多样性联合搜索,记忆与修复机制大幅提升产出
- Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills
通过可进化的技能库充当任务生成的结构化接口,在工具调用与逻辑推理上显著超越无引导自我对弈
- LAMAR: An Open Language-Aware Multilingual Alignment Reranker
提出语言感知多语言重排序器LAMAR,通过英语锚定蒸馏和偏好对齐,同时优化语义相关性和语言一致性。
- Scaling Native Multimodal Pre-Training From Scratch
发现原生多模态预训练的损失、模型大小与数据量遵循幂律,数据配比影响计算最优分配,且存在跨模态正向迁移
- DWT-Fusion: A Signal-Based Framework for Training-Free LLM-Generated Text Detection
用离散小波变换分析 token 级对数概率序列的多分辨率特征,结合校准融合投票,实现免训练零样本 LLM 文本检测
- Bringing GRACE to Recommendation: Fine-Tuning for Sustainable and Accurate Personalization
提出 GRACE,用 Gumbel-softmax 可微排序近似与梯度投影在预训练模型上微调,不增推理开销地提升推荐可持续性
- Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs
发现RL训练通过on-policy数据、优势衰减与正负联合优化显著减轻模型合并时的任务冲突
- HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding
分层 token 与元素双粒度重要性感知压缩,结合可重构硬件排序器,在 1% 精度损失内实现 7.95 倍加速和 90% 能耗降低
- J-CoT: Chain-of-Thought in J-Space
在Transformer的词汇索引坐标系中传递系数状态作为递归边界,替代显式文本或全量隐藏状态
- Local-Global Geometric Insights for Graph Neural Networks via Entropic Curvature
引入全局熵曲率统一图神经网络的过平滑与过挤压,并提出E-Gate聚合、ENT编码和MCR重连三种机制。
- Agentic Root Cause Analysis through Evidence-Grounded Reasoning
零样本Agent框架结合数字孪生与LLM推理,迭代收集证据并评估假设,实现可解释工业根因诊断,性能比肩全监督方法
- Cross-Tokenizer On-Policy Distillation via Byte-Prefix Marginalization
在共享字节空间将教师分布边缘化到学生词汇,无损对齐概率质量,大幅提升跨分词器蒸馏性能
- Teaching LLMs to Self-Evolve: Cultivating Core Meta-Skills with Reinforcement Learning
通过合成进化轨迹和进化感知的RL,教会LLM自我反思等元技能,大幅提升跨领域迭代优化能力
- \k{appa}-LoRA: Condition Numbers Reveal Which LoRA Matrices Worth Updating
基于权重矩阵的条件数选择性更新LoRA参数,在匹配标准LoRA精度的同时减少约一半的参数量和16.2%的训练时间
- The Regression Tax: Decomposing Why Skills Help and Hurt LLM Agents
添加技能库带来的回归抵消了 59% 的增益;三种回归机制以 grounding displacement 为主,且技能描述即使不被调用也可通过上下文渗透改变行为
- From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models
基于认知科学构建14领域/91子技能的多层LLM能力分类,并量化15934篇论文的研究覆盖与盲点
- MoE$^2$-LoRA: When MoE Models Meet MoE-style Low-Rank Adaptation
首次用MoE路由思想做LoRA微调,复用预训练路由器激活动态选择全局共享的LoRA专家
- Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode
3B参数的紧凑模型在代码、办公、工具使用等智能体任务上全面超越9B/12B模型,同时保持强推理能力
- PinEqualizer: Full Funnel Content Exploration and Debiasing System at Pinterest
提出覆盖语料、召回、排序的全漏斗冷启动解决方案,通过去偏与探索结合高效测量框架显著提升新鲜内容分发与用户参与
- The Prompt Is Not the Query: How Request State Evolves Across Multi-Turn AI Conversations
多轮对话的最终提示仅含少部分词汇与状态维度,历史信息常丢失,必须采用会话级评估
- TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI
用任务级上下文Bandit路由替代请求级路由,通过延迟奖励统一优化Agent工作流的准确率与延迟。
- Why Large Language Models and Humans Converge and Diverge in Evaluating Creativity
揭示LLM创造力评估依赖更窄的新颖性标准且忽视上下文信息,模型选择显著影响对创意的识别
- Unboxing Diffusion Models for the Arts: Interactive Model Bending and Practice-Based Explainability
通过交互式弯曲与检查界面,让艺术家操控扩散模型内部层以产生可预测的视觉效应
- Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings
提出反转生成流水线的评测基准,揭示记忆架构排名随对话历史长度反转,开源分层记忆库Veracium
- Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation
小VLM的口头置信度近乎恒定且无法检测错误,但内部token概率却能有效分离正确与错误答案
- SIREN (Luring LLMs onto the Rocks): PAIR-Driven Preference Manipulation in Web-RAG Recommenders
使用PAIR自动攻击框架,通过固定检索源下的内容投毒迭代,将目标实体推至LLM推荐排名第一
- Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic AI
提出协议有效性和HackDetect审计,发现15个基准67%的任务存在奖励黑客,分数膨胀0.45–1.00
2026-07-26 11 篇 ★ 1 深度
- Dataset Distillation by Influence Matching
通过结果对齐合成数据的影响力,替换传统的梯度或轨迹匹配,性能显著提升
- EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation
提出情感惯性引导的监督对比学习模块,无需额外数据即可提升多模态对话情绪识别
- Answer-Reconstruction Search Density: Measuring the Query and Source Work Compressed by Conversational Answers
提出 ARSD 度量,用最小查询次数覆盖答案信息单元,量化对话系统对搜索工作的压缩程度
- Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning
基于场景语法与可执行任务程序构建可控、可验证的多域视觉推理数据,RL微调使VLM跨24基准平均提升3.5–4.1个百分点
- K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMs
构建课程知识图谱并衍生多任务基准,暴露大模型在前提推理等课程认知上的短板,并以图引导数据高效微调
- Adaptive Bayesian Online Learning via Expert Aggregation
将不同超参的贝叶斯更新规则视为专家并在线聚合,实现自适应预测,无需预选最佳模型
- Beyond Sufficiency: Time Series Explanation with Counterfactual Necessity
提出 TimePNS,利用反事实干预量化时间序列解释的必要性,过滤虚假子序列,提升解释保真度
- Euclid-MCP: A Model Context Protocol Server for Deterministic Logical Reasoning via Prolog
通过MCP暴露Prolog推理引擎,让LLM委托确定性逻辑推理,弥补语义RAG在规则执行上的不足
- Progressive Cramming: Reliable Token Compression and What It Reveals
逐token扩展压缩目标直至重建失败,定位可靠压缩边界,并揭示早期层交互致下游崩溃
- KroQuant: Kronecker-Structured Block Transforms for Efficient Post-Training Quantization of Diffusion Transformers
提出KroQuant,用学习的Kronecker结构化块变换对激活做32元素块量化,比SmoothQuant更快且精度更高
- Expanding Flow Maps
提出扩展流映射(EFM),将生成模型从固定维度/长度解放,支持可变大小图和序列的少步生成
2026-07-25 30 篇 ★ 3 深度
- Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
提出Anchor-Align,用表示锚定和语言-动作对齐防止VLA微调中的灾难性遗忘,提升机器人操作泛化能力
- FVAttn: Adaptive Sparse Attention with Runtime Load Balancing for Video Generation
提出训练无关的自适应稀疏注意力系统,通过运行时头迁移与空闲填充解决多GPU序列并行的负载不均,推理加速超2倍
- An Exam for Active Observers
提出 ActiveVision 基准,发现前沿多模态模型在需要多次视觉交互的任务上近乎失败,与人类差距悬殊
- From Modalities to Propositions: A Language-Centric Framework for Multimodal Intelligence
提出将任意模态数据表示为原子命题集合,通过全局语义码本实现可解释、可组合的跨模态理解与检索
- Subliminal Clocks: Latent Time Modelling in Diffusion Language Models
发现无显式时间条件的扩散语言模型内部编码了隐式去噪时间步,可通过探针提取和方向操控来调制模型行为
- Scaling Laws for Hypernetwork-Based Knowledge Injection in Large Language Models
发现超网络生成 LoRA 适配器进行知识注入的损失、准确率和 OOD 泛化遵循幂律缩放规律
- Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluation, and Challenges
全面综述多模态LLM在视觉幽默理解与生成上的能力层级、基准与建模范式,揭示评估捷径等核心挑战
- FinanceComplexQA: Benchmarking Agentic Reasoning on Industrial-grade Financial Documents
提出一个包含2026道深度研究题、2000份合成专业文档的金融文档QA基准,用于评测Agent与RAG系统的复杂推理能力
- ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models
提出首个用于多模态上下文夹带探测的双模分类基准 ENTAP-VL,以文本和视觉独立诱发夹带现象。
- PLAID-PRF: Pseudo-Relevance Feedback with Centroid-like Tokens in PLAID
利用多向量检索索引中的质心向量进行伪相关反馈,以很低计算开销提升检索效果
- LLMs Get Lost in Evolving User Intent
将静态单轮任务转为带意图演化的多轮对话,发现前沿模型追踪用户意图变化时性能大幅下降
- Spectral Biclustering-Driven Scalability for Post-Hoc Explainability in Recommender Systems
提出用谱双聚类将用户-物品分块,以块删除诊断替代逐个观察删除,在保持后验解释能力的同时大幅降低重训练成本
- Tencent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Construction
提出跨Code/Web/Office/Security四域的抗污染编程Agent评估套件,任务由真实场景改写且完全开放可审计
- HARP: The Human--AI Research Platform
提出可精细控制LLM行为并记录键入、删除等微观交互数据的实验平台,支撑系统研究AI设计选择如何影响用户
- Cardinality-Decomposed Loss: Matching Training Objectives to Relation Structure in Heterogeneous Recommendation Graphs
在异质图中按关系基数分解损失——BPR给一对多,交叉熵给一对一——根治属性嵌入崩塌且不影响排名指标的无声失败
- Statistical Inference for Rank Allocation in Low-Rank Adaptation
将秩分配视为假设检验问题,利用p值驱动剪枝,实现更稳定的参数预算分配
- Sample-Efficient Learning from Agent Experience
提出经验蒸馏,无需额外环境交互即可将 ICL 增益蒸馏到模型权重,保留 64.8% 增益,比 SFT 高 17 倍,比 RL 节省 9.6 倍样本
- When Trivia Is Not Trivial: Everyday Knowledge Failures in Multilingual LLMs
引入多语言基准TriviaRoomQA,发现LLM在流行文化等日常知识上显著弱于学术知识,且跨语言性能不一致
- Transparent by Design, Usable in Practice? A Formative Usability Study of a Conversational Product Advisor
在笔记本电脑推荐对话系统中,设计上透明的排名解释功能反而引发了最严重的可用性问题,且用户需要额外的直接操控控件。
- Detecting LLM-Generated Tokens in Human--LLM Coauthored Text
提出基于自适应带宽核平滑的token级检测方法,无需标注数据即可定位LLM生成片段。
- Controllable and Content-Based Recommendations
通过在协同过滤中嵌入文本瓶颈,让用户通过文本直接控制推荐方向,且文本概要从物品内容(图像/音频/视频)自动生成。
- Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
在固定计算量下,通过早期评分并逐步剪枝扩散去噪轨迹,显著提升生成质量
- Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach
用子空间分解建模多专家提示,以低秩因子通信替代全量专家,在差分隐私下平衡个性化与泛化
- MIRROR: Learning from the Other View for Multi-Modal Reasoning
通过视图间互惠强化学习,利用多模态行为差异提升几何推理准确性与跨模态一致性
- QuantiBias: Benchmarking Quantization-Induced Bias in LLMs
量化模型通过标准安全检测却常在开放式生成中输出刻板印象,须单独评估
- RUMBA: Russian User Memory Benchmark
提出多维度诊断性长期记忆基准 RUMBA,涵盖俄语及英文,细粒度分解问题类型以分析记忆机制薄弱点
- Context-weighted Discrete Flow Matching
通过局部上下文密度重加权训练损失与采样过程,将文本生成困惑度降低最高63%。
- Token Budget Saturation and Mechanistic Early Detection of Reasoning Non-Convergence in Chain-of-Thought Models
CoT推理呈双峰收敛,内部表征可早期预测失败,为提前退出开辟路径
- Hilbert Operator for Progressive Encoding (HOPE): A Mathematical Framework for Deconstructing Learned Representations in Deep Networks
将网络压缩从离散域搬进希尔伯特空间,用秩1算子统一剪枝与合并,实现无数据无超参数的跨层架构决策
- Emergent Misalignment Recruits a Pre-existing Persona Subspace
窄域不良微调泛化源于激活了模型内预先存在的跨领域角色子空间,而非学习新行为
2026-07-24 30 篇 ★ 10 深度
- Beyond Euclidean Clipping: Overcoming Exploration Collapse in LLM RL via Riemannian Isometric Policy Optimization
发现 PPO-Clip 的欧氏度量与策略黎曼流形不匹配是探索崩塌的根本原因,提出 RIPO 实现等距更新以平衡探索与利用,大幅提升推理 RL 性能
- Predictive Divergence Masks for LLM RL
提出预测散度掩码替代 PPO 比率方向测试,用散度变化预测决定是否屏蔽 token
- SciForma: Structure-Faithful Generation of Scientific Diagrams
通过结构轴分解与多维度合取偏好优化,实现科学图表的结构忠实生成,超越开源模型与GPT-Image-1.5
- Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
通过 tokenizer-骨干-系统协同设计,以 4B 规模实现高效高分辨率图像生成与编辑
- Where Should Optimizer State Live? Tiered State Allocation for Memory-Efficient Mixture-of-Experts Training
针对 MoE 三种参数群体,差异化分配优化器状态,使内存降至原来的 2.6%,且困惑度更优
- Moving Alphabet: A Controlled Study of Training Data for Text-to-Video Generation
用程序化字母视频揭示数据分布与标注质量对文生视频模型泛化与训练效率的关键影响。
- DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations
构建可确定性验证的文档操作基准,揭示前沿代理在长程耦合任务中状态跟踪崩溃、浅层验证等关键失效模式
- NVIDIA-labs OO Agents: Native Python Object-Oriented Agents
将Agent抽象为Python对象,方法即动作、类型即契约,统一开发者与模型的编程接口
- PAGE-RAG: Evidence-Grounded Adaptive Graph Retrieval for Long-Document Question Answering
将图视为文档语义骨架,通过任务自适应路由和知识边界控制提升长文档问答的可靠性和效率
- AREX: Towards a Recursively Self-Improving Agent for Deep Research
利用发现-验证不对称性,将部分验证的解递归地转化为更聚焦的研究问题,实现长视野深度研究。
- GraphVid: Interactive Graph-Controllable Video Generation
提出用可编辑场景图作为条件,实现精确多对象交互的图像到视频生成
- SalesLoop: Reinforcement Learning from Performance Feedback for Sales Lead Ranking
通过闭环强化学习与位置感知奖励+判别式GRPO,解决销售线索排序中离线-在线指标不对齐、逐点-列表目标错位及分布漂移三大断层
- Agentic Context Management: Solving Agent Memory and Cost by Treating Them as Lifecycle and Architecture Problems
提出 Agentic 上下文管理五原语(架构、摄入、范围界定、预判、压缩与巩固),将上下文从存储问题重构成全生命周期,实现了线性 token 成本且精度不降
- How Many Bits Can an Adapter Write? Measuring the Capacity and Memorization of Parameter-Efficient Fine-Tuning
通过压缩方法直接测量 LoRA 适配器的记忆容量,揭示容量取决于插入位置和基座结构,SFT 会记忆秘密而 RL 不会。
- Windowed-MTP: Removing the Full-Context Draft-KV Tax at Million-Token Context
对推测解码草稿头施加窗口注意力,训练免费、无损地将长上下文草稿 KV 读取量降低 99%,推理加速 28–44%
- Anti-Periodic Positional Encoding: Möbius Boundary Conditions Make In-Context Retrieval Reliable
提出反周期频率阶梯的 Möbius RoPE,以零困惑度代价消除检索种子彩票,使准确率从 63% 升至 90%
- GRADRAG: Cross-Component Prompt Adaptation for Coordinated Multi-Agent RAG
将RAG管线建模为计算图,通过评估反馈反向传播优化上游Agent提示,取得12-15pp偏好提升
- Probabilistic Residual Learning for Online Recommendations
提出即插即用的因果贝叶斯框架PRL,通过概率用户聚类与do-calculus去偏,显著提升基础推荐模型的跨域冷启动性能。
- One More Turn, Less Regret: A Regret-Based Multi-Turn Benchmark for LLMs' Clarification Policies
提出基于后悔值的多轮澄清基准RegretBench,衡量LLM助手澄清策略的效率与效用,避免仅看最终成功。
- Error Certificates for KV-Cache Eviction via Randomized Design
随机化 KV 缓存驱逐使系统能给出每步注意力误差的置信区间,用于归因缓存导致的失败
- LO-FAR: A Cost-Aware Local Filter for Sparse Feature Ranking in Industrial Ad Recommendation
仅用CPU的局部过滤方法独立评估稀疏特征预测信号,实现低成本快速排序并保持下游CTR/CVR竞争力
- MemTools: A Unified Research Framework for Interoperable Agent Memory
提出模块化、可互操作的智能体记忆框架,解耦生命周期与评估,支持异构记忆统一接口
- Bridging the Structural Gap: Adapting Autoregressive Generation for Recommendation
通过恢复 item 边界、路径重排与双路解码,缓解生成式推荐中的语义漂移
- Fast and Efficient Approximate Nearest Neighbor Search for High-Dimensional LLM Embeddings
通过EVP量化与1D预排序优化图索引构建,大幅提升LLM嵌入向量搜索的构建速度与缓存效率
- Diffusion Language Model for Recommendation
提出离散扩散替代自回归生成,通过迭代去噪和协同感知 token 化实现更优推荐
- OpenForgeRL: Train Harness-native Agents in Any Environment
一个开源框架,通过远程容器化与轻量代理解耦,支持用标准 RL(veRL)在任何智能体框架与任何环境中端到端训练 agent
- Visual Contrastive Self-Distillation
通过对比原图与内容擦除图的教师分布差异,无需外部教师或特权信号即可高效训练多模态LLM
- SHIFT: Self-reconstruction Harnesses Implicit Fine-grained Thinking for Retrieval
用细粒度自重建缓解对比学习与隐式推理的目标错配,提升推理密集型检索性能
- Test-Time Scaling via Error Localization
利用反馈在 token 级定位错误,保留正确前缀分支执行,大幅提升推理时搜索的 token 效率
- Adaptive Depth Sparse Framework: Similarity-Driven Resource Allocation for Pre-Trained LLMs
利用层间余弦相似度自适应分配token保留率,将预训练LLM转为深度稀疏模型,无需全量微调即大幅降低推理FLOPs
2026-07-23 30 篇 ★ 12 深度
- DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environment
在确定性 Wikipedia 离线环境中,通过 scaffold 教师轨迹生成与监督自蒸馏,让 9B 搜索智能体自进化至开源领先水平
- SeerGuard: A Safety Framework for Mobile GUI Agents via World Model Prediction
通过预执行指令筛查与动作风险评估,结合多任务世界模型,显著提升GUI Agent的安全效用并降低风险成本
- DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines
通过类型化增量突变和MCP落地,引导LLM代理构建可持久编辑的数据流水线DAG,成本与延迟大幅降低。
- AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents
提出闭环调试框架AgentDebugX,其多轮根因诊断方法DeepDebug在Who&When上严格归因准确率28.8%优于单次方案21.7%,在GAIA上单次重试修复13/73失败任务。
- ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Search
通过解耦算法与数据结构,实现灵活组合的图基 ANNS 框架,性能与专用系统相当或更优
- AutoIndex: Learning Representation Programs for Retrieval
将文档索引视为可优化程序,用Agent迭代搜索最佳预处理代码,BM25召回提升8.4%+
- Stale but Stable: Staleness-Adaptive Trust Regions for Stabilizing Asynchronous Reinforcement Learning
用 detached log-ratio 作为陈旧度代理,自适应收缩 PPO 区间端点,稳定异步 RL 训练
- FinSAgent: Corpus-Aligned Multi-Agent RAG Framework for Evidence-Grounded SEC Filing Question Answering
将SEC文件问答重塑为语料对齐检索规划,通过注入语料侧条件解决先验-语料错配,提升证据检索与回答正确性
- H^2SD: Hybrid Hindsight Self-Distillation
提出H^2SD,根据轨迹成败分别用重述增强和参考提示进行教师信号调制与蒸馏,提升推理训练稳定性和效果
- Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a Benchmark for Factual Completeness
提出双层元评分框架,将结构化回答要求编译为二进制检查表,构建首个多模态日常深度研究事实完整性基准GAMUT
- Beyond Noisy Signals: Dual-Level Denoising for Multi-modal Sequential Recommendation
提出图低通滤波和频域自适应滤波的双层去噪,联合清洗多模态特征与序列行为噪声,显著提升推荐鲁棒性
- ISO: An RLVR-Native Optimization Stack
发现 RLVR 中的谱继承现象,提出等谱优化框架,固定奇异值只优化奇异框架,加速训练与模型合并。
- Exposure-Based Reinforcement Learning to Rank
通过曝光分布抽象与基线校正,实现能自动微分的RL排序,显著提升收敛速度与稳定性
- Topology-Aware Tokenization for Generative Recommendation
提出多级蒸馏框架 TopoTok,在量化过程中保留项目拓扑结构,缓解失真,召回率最高提升 9.42%
- Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking
提出文档集评估基准 SetwiseEvalKit 和无训练选择方法 Rubric4Setwise,以更少文档提升 RAG 生成质量
- NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs
提出需求驱动的任务合成框架 NexForge,自动生成多样化可执行 agent 训练数据,显著提升 LLM agent 性能
- An Epistemic Position-Based Click Model: From Interactions to Epistemic Distributions of Relevance and Bias
提出首个证据深度学习点击模型,输出相关性与位置偏差的 Beta 分布以量化认知不确定性
- SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD
在昇腾NPU超节点上实现万亿参数MoE模型全参数后训练,达34.22% MFU,并构建运筹优化领域专用模型
- SLPO: Scaling Latent Reasoning via a Surrogate Policy
提出替代潜在策略优化(SLPO),用经验密度和自适应停止将结果奖励RL引入潜在推理,实现测试时扩展
- TSGR: Taobao Search Generative Retrieval
查询感知并行Semantic ID与价值感知排序模块让单一模型兼具召回与粗排,离线HR@1000提升9.16%,线上GMV+1.64%
- CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search
构建代理式对话搜索系统,比较两种澄清需求预测模型在混合主动搜索中的效果
- Efficient Clustering with Provable Guardrails for LLM Inference at Scale
两阶段聚类通过贪心集合覆盖确保每用户与代表相似度达标,实现50倍LLM推理成本缩减
- Diverse-Intent Multi-Turn Fashion Image Retrieval
提出支持多意图切换与回溯的多轮时尚检索基准 DIM-Fashion,并设计三阶段 MLLM-VLP 框架 FashionAM 避免文本化瓶颈
- Zero-Observation User Reactivation with Gap-Driven Dimensional Gating
冻结序列推荐骨干,用维度门控融合历史与全局先验,从长间隔中恢复预测性能。
- Personalized Recommendation Tool Learning via Autonomous Language Agents
用LLM代理调用多个推荐模型作为工具,通过反射机制个性化选择工具,实现全排名推荐。
- User-Centric Modeling of Transactional Sequences with Explainable State Space Models
用 CoLES 预训练用户向量初始化 Mamba 隐藏态或作为前缀 token,加速收敛并提升序列建模效果
- Look Less, Think Faster: Joint Token-Compute Adaptation for Multimodal LLMs
提出SmartVL,联合动态控制视觉token数量和LLM计算量,实现多模态LLM的精度-效率帕累托最优
- OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills
构建含263个真实风险技能的基准,揭示LLM智能体在规避第三方工具风险时的不足
- Solar Open 2 Technical Report
通过混合注意力与多专家蒸馏,以1/6参数量达到1.6T模型韩文办公Agent水平
- UniRank: Benchmarking Ranking Models for Unified Sequential Modeling and Feature Interaction
首个面向 Token 化统一排序模型的开放基准,标准化多任务点式自回归评估并降低训练成本
2026-07-21 30 篇 ★ 9 深度
- AsySplat: Efficient Asymmetric 3D Gaussian Splatting for Long-Sequence Scene Modeling
解耦几何与外观建模的非对称架构,大幅降低长序列新视角合成中冗余计算
- SVR-R1: Bootstrapping Multi-modal Reasoning with Self-verification in Reinforcement Learning
在RL rollout中嵌入多轮自验证循环,让VLM自我纠正并提升推理准确率,无需外部监督
- ReflectWorld-MM: An Entity-Oriented Multimodal Memory System for Open-Ended Video Streams
以实体为中心的分层多模态记忆系统,在六个长视频与终身记忆基准中全面超越现有方案
- Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization
用对比分歧替代熵作为优势信号,实现RLVR中更细粒度的token级正确性感知和策略优化。
- RESOURCE2SKILL: Distilling Executable Agent Skills from Human-Created Multimodal Resources
从视频、代码、文章等资源蒸馏可执行技能,以层次化多模态技能维基提升智能体在7个创作领域的表现,平均总分提升11.9个百分点
- Group Entropy-Controlled Policy Optimization
提出分组熵控制优势塑造方法,解决多任务 RL 训练中探索-利用失衡与优势不可比问题
- Environment-free Synthetic Data Generation for API-Calling Agents
仅凭 API 规范,用 LLM 模拟世界模型生成完整交互轨迹,无需可执行环境即可训练 API 调用 Agent
- Beyond Fixed Depths and Widths: Optimizing Textual Decoding Tries in LLM-based Generative Recommendation
提出BONSAI框架,通过最小集合覆盖构建自适应、低分支的文本解码Trie,将推荐准确率提升最高21.6%
- Distilled Reinforcement Learning for LLM Post-training
通过逆向重要性采样将教师知识注入RL梯度,实现选择性token级信用重分配
- Uncertainty as Remedy: Mitigating Satisfaction Label Bias in Short Video Multi-Objective Ensemble Ranking
用高斯分布建模预测,以方差捕获多目标冲突不确定性,设计不确定性感知的自适应加权,缓解短视频排序中行为信号带来的满意度标签偏差
- Learning Sparse Representations of Multimodal Content for Enhanced Cold Item Recommendation
用稀疏嵌入替代稠密向量,以更低存储成本显著提升内容冷启动推荐准确性
- Adapting Embedding Models for Agent Capability Retrieval
微调通用文本嵌入模型实现跨目录的 Agent 能力检索,并在未见数据集上验证迁移有效性
- Kernelized Linear Attention: Breaking the Capacity Wall with Symmetric Cones
提出 KATA 框架,利用自对偶锥保证非负注意力权重,大幅提升线性注意力的联想记忆容量与吞吐量
- HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enchancement
统一处理 inter/intra-subject 的视频个性化框架,通过 MLLM 全局引导注意力提升人-物交互保真度
- Teach it to stop, not just to click
发现CUA-RL结果被上游方差(数据抽取为主)误导,提出k种子报告协议并揭示修复难度由动作约束决定
- LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks
将 LLM 评估从标量奖励升级为细粒度经验反馈,通过上下文蒸馏提升开放任务的后训练效果
- WHALE: A Scalable Unified Model for Recommendation with Wukong-HSTU Architecture
通过逐层注意力融合将Wukong特征交互与HSTU序列建模统一,实现可扩展的工业推荐模型
- C$^2$KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference
联合优化KV压缩与拼接,实现位置无关的可组合缓存,长上下文推理加速达17倍
- Calibrating Semantic Uncertainty from Observable Language-Model Probabilities
提出语义映射框架,将语言模型词汇概率校准为可验证的语义后验,在改写下保持稳定
- Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
通过分析推理轨迹的潜在状态转移并注入状态特定的残差流方向,无训练地打破LRM的自循环失败模式
- DeLIVeR: Decomposed Learning for Information-grounded Veracity Recognition via Reinforced Knowledge Graph Exploration
将声明分解为多个查询,用强化学习优化知识图谱探索策略,事实核查 F1 提升 10–15%
- jina-reranker-v3.5: An Efficient Listwise Reranker with Hybrid Attention and Self-Distillation
0.6B列表重排器通过混合窗口/全局注意力与三阶段自蒸馏,在保持重排质量的同时大幅降低延迟并提升结构化数据理解
- Zero Hallucination, by Construction: Hallucination-Aware Layered Oversight for Trustworthy Enterprise AI
提出HALO六层防御架构,将幻觉视为可容错系统属性,通过接地生成、证据信心和校准拒答实现企业AI零幻觉
- MADA-RL: Multi-Agent Debate-Aware Reinforcement Learning for Parameter-Efficient Reasoning in Compact Models
通过辩论感知RL训练紧凑模型作为生成器和评论家,利用反事实优势函数让评论家超越生成器共识,参数效率提升16倍
- MagicSelector: Joint Optimization for Agent Tool Selection via Counterfactual Decomposition and Progressive Reranking
提出反事实任务分解、自蒸馏重排和动态Top-K,联合优化Agent工具检索,显著提升精度和效率
- The Matryoshka Hypencoder
提出支持多种Q-Net大小的Matryoshka Hypencoder,域内参数减少7倍,吞吐提升1.6-3.4倍。
- RAMP: Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways
用双塔输出掩码分离个性/非个性化监督,配合蒸馏对齐路径,在隐私受限下提升 CTR/CVR 预测
- Enhancing Rubric-based RL via Self-Distillation
用 on-policy 自我蒸馏同时解决 rubric RL 的未被探索准则和压制准则问题,消除训练推理不匹配
- Evidence-in-the-Loop: Trace-Driven Optimization for Customer-Service LLM Agents
提出基于多路召回、交叉编码重排和跟踪分析的生产级客服Agent,重排序瓶颈大于LLM扩展
- Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
证明通过维度适配和比率控制,无需训练直接加权平均即可有效合并参数量不同的LLM
2026-07-20 30 篇 ★ 6 深度
- VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
用冻结视频基础模型特征 + 轻量自编码器压缩为连续/离散潜变量,SOTA 生成且收敛快 5 倍
- xHC: Expanded Hyper-Connections
通过时间特征增强和稀疏残差流(仅更新k=4/N=16)突破HC的N=4瓶颈,在MoE模型上大幅提升性能并降低计算开销
- Recursive Harness Self-Improvement
提出RHI,通过提示级迭代优化智能体循环,仅需少量样本即可超越最大推理设置并降低60%成本
- DSWorld: A Data Science World Model for Efficient Autonomous Agents
提出数据科学世界模型预测操作结果,实现代理训练加速14倍、推理加速3-6倍
- VarRate: Training-Free Variable-Rate KV Cache Compression for Long-Context LLMs
提出无训练可变秩KV缓存压缩方法VarRate,按显著性分配预算并保留所有token,实现接近无损的长上下文推理
- Understanding Reasoning from Pretraining to Post-Training
以国际象棋为受控实验,揭示预训练损失可预测RL后性能,RL在困难任务中涌现新推理能力
- Loop the Loopies!
提出层循环MoE架构与计算匹配扩展方案,在相同预训练计算量下首次超越非循环大模型。
- RecGPT-V3 Technical Report
通过记忆中心、混合模态SID和潜在推理,线上IPV+1.28%、CTR+1.00%、GMV+3.97%,成本降52.4%
- BayesPO: Bayesian Prompt Optimization via Parallel-Tempered Gradient-Guided Discrete MCMC
将提示优化建模为离散提示令牌上的贝叶斯后验采样,用梯度引导MCMC与并行回火提升指令归纳准确率
- Which Hyperparameters Matter? A Game-Theoretic Framework for Interpretable Hyperparameter Sensitivity Analysis
用 Shapley 效应与 Pareto 前沿分析多目标场景下超参数对各目标的影响,识别关键超参数以缩小搜索空间
- From Plausible to Actionable: A Position on LLM Self-Explanations
区分自我解释的合理性、忠实度与可操作性,提出兼顾三者的评估框架
- CRAFT: Clustering Rubrics to Diagnose Weak LLM Capabilities and Generate Targeted Fine-Tuning Data
将评分标准视为能力探针,聚类构建能力树诊断模型薄弱能力,针对性生成微调数据,在专业领域显著提升性能。
- When Model Merging Rivals Joint Multi-Task Reinforcement Learning: A Task-Vector Geometry Analysis
合并独立RL专家在AppWorld上匹敌联合多任务RL,因任务向量近正交使精细合并方法退化为均匀平均
- When Do Multi-Agent Systems Help? An Information Bottleneck Perspective
用信息瓶颈理论揭示多智能体增益源于上下文压缩与通信损失间的权衡,弱模型更难从冗余上下文中获益
- Better Starts, Better Ends: Bootstrapped Iterative Self-Reasoning Distillation for Compressed Reasoning
提出 BIRD 两阶段自蒸馏,先引导模型生成简洁推理再在线蒸馏,显著减少推理长度同时提升精度
- Process Reward Informed Tree Rollout for Effective Multi-Turn RL
基于中间过程评分引导树展开,使多轮Agent RL训练更高效,SWE-Bench提升5.0点
- Candidate Attended Dialogue State Tracking Using BERT
利用预训练BERT和候选注意力实现多领域零样本对话状态跟踪,显著提升可扩展性
- PCTD: Preference-Guided Counterfactual Task Decomposition for Agent Tool Retrieval
通过反事实奖励消除虚假相关、偏好建模约束结构质量,缓解 RL 任务分解中的奖励黑客与重复生成
- Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QA
构建非均匀时间树并训练智能体通过显式回溯操作实现自纠正搜索,显著提升长视频问答与定位性能
- Adaptive Multi-Step Lookahead Decoding for Diffusion Language Models
提出自适应前瞻解码框架,动态决定前瞻深度,在扩散语言模型上实现更优的准确率-步数权衡
- LLMs Encode Relevance as a Layer-Wise Cross-Lingual Signal
线性探针可从 LLM 残差流激活中解码查询-文档相关性,中间层最准,且常优于模型直接生成的判断
- When Does Muon Help Agentic Reinforcement Learning?
稀疏奖励智能体 RL 中,Muon 仅作用于隐藏矩阵,在低学习率下使成功率最高达 0.901,远超 AdamW
- PagedWeight: Efficient MoE LLM Serving with Dynamic Quality-Aware Weight Quantization
通过运行时动态量化 MoE 专家权重,在 KV 缓存压力下平衡精度与内存,最高节省 72% 显存并提升 1.94 倍吞吐
- Frontier Language Models Struggle to Copy: Text Can Be Better Viewed in 2D
提出2D-RoPE将文本组织为二维网格,大幅提升LLM复制任务的长度泛化能力
- RECAP: Feedback-Driven Streaming Semantic User Profiles for Short-Video Recommendation
闭环框架通过清洗隐式反馈训练双塔评估器,用GRPO优化流式结构化用户画像生成,提升推荐对齐度
- SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
将82万社区技能文件策展为9.6万高质量语料,并在三个真实Agent基准上实现一致增益(最高+13.4pp),揭示覆盖与Harness边界
- Distributional Matching for Vector Quantization: A Unified Theoretical and Empirical Framework
通过分布对齐统一解决向量量化中的训练不稳定和码本坍塌
- Before the Action: Benchmarking LLMs on Prospective Hypothesis Discovery
提出前瞻假设发现任务与HypoArena基准,评测LLM在证据不足下自主构建可检验假设空间的能力。
- Induction in Both Directions: A Mechanistic Analysis of In-Context Learning in Masked Diffusion Language Models
发现扩散语言模型用双向归纳电路实现上下文学习,且以全局掩码比例作隐式时间步
- What Do Chinese-Language Generative Search Engines Cite and Surface? A Large-Scale Empirical Study
大规模实证分析中文生成式搜索的引用选择、品牌曝光及跨接口差异,揭示品牌选择率仅8.3%
2026-07-19 14 篇
- Length Penalties Make Chain-of-Thought Less Monitorable
带长度惩罚的强化学习压缩思维链时优先移除影响答案的线索,降低可监控性
- Rethinking the Evaluation of Harness Evolution for Agents
自动 Harness 进化在公平比较下未超越简单测试时搜索,且泛化有限,呼吁新评估协议
- Certified Domain Consistency for Multi-Domain Retrieval: Label-Free Per-Domain Contamination Control with Conformal Risk Guarantees
提出 C3R,一种即插即用的共形控制层,无标签情况下逐域认证污染预算,在最难域上保证污染降低。
- RxBrain: Embodied Cognition Foundation Model with Joint Language-Visual Reasoning and Imagination
将语言推理与视觉想象统一为一个规划序列,实现具身任务的耦合文本-视觉规划与执行
- DeepLoop: Depth Scaling for Looped Transformers
针对环式 Transformer 参数共享提出新的残差缩放规则,将 DeepNorm 指数从 1/4 提升到 1/2 以保证稳定训练
- ViHoRec: A Quality-Controlled Vietnamese Hotel Recommendation Dataset and Cold-Start Benchmark
贡献面向低资源越南语的酒店推荐数据集,通过跨平台对齐、质量控制和冷启动基准揭示稀疏数据下的难题
- Accuracy Without Grounding: Diagnosing Visual Dependency Dissociation in Video LLM Benchmarks
提出视觉依赖差距(VDG)审计视频LLM,发现模型黑屏下准确率相当,帧多样性而非时序贡献视觉增益
- MeanFlowNFT: Bringing Forward-Process RL to Average-Velocity Generators
构建诱导瞬时速度预测器,使MeanFlow能用前向RL优化奖励,实现快速少步生成且性能超越多步模型
- VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding
提出膨胀3D ViT与自适应帧分辨率,结合三阶段合成数据,4B参数即超越更大模型,实现高效通用视频理解。
- Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understanding
提出ViPS框架,通过高效代理和动态融合将多个视觉模型的互补先验集成到MLLM中,显著提升空间推理性能
- CoTu at EXACT 2026: Neuro-Symbolic Reasoning for Transparent Educational QA
4B 模型将推理外化为 Z3/Python 程序,物理满分、总技术分最高
- The Energy Society: A Simulation Environment for Studying Agent Cooperation under Survival Pressure
构建极小生存经济模拟环境,揭示推理成本与模型规模挂钩时合作激励如何改变多智能体行为
- Plover: Steering GUI Agents through Plan-Centric Interaction
通过将任务计划外化为可编辑的交互工件,让用户能局部修正 Agent 行为而保持进度
- SceneBind: Binding What and Where Across Vision, Audio and Language
提出一种全模态场景表征,联合语义与3D空间理解,实现跨模态检索与目标定位
2026-07-18 19 篇
- Token Time Continuous Diffusion for Language Modeling
提出连续空间上token级时间可变的扩散语言模型,解决高加速比下离散模型并行采样不准确问题
- Spectral Rewiring for Exploration, Purification, and Model Merging
仅保留0.58%参数的频谱核心,维持RL微调推理能力并增强探索与多域融合
- Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
系统梳理多模态遗忘的干预点、方法、数据集与基准,建立跨架构的统一分类体系
- GRASP: GRanularity-Aware Search Policy for Agentic RAG
用强化学习训练 Agent 自适应选择语义搜索、关键词搜索与段落阅读,提升多跳推理的检索与问答性能
- Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
提出自校正耦合马尔可夫跳过程(SC-CMJP)与训练自由采样器CO₂Jump,实现多模态生成中跨模态实时纠错
- KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation
首个系统性关键帧视频生成评估基准,分解六项执行度指标并揭示模型在忠实度与自然度间的权衡
- Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answers
将 LLM 品牌推荐的非确定性分解为语言、模型、提示改写和重采样四类方差,指出扩展语言和模型比重复采样更有效提升可靠性
- Partition, Prompt, Aggregate: Statistical Self-Consistency in Language Models
揭示LLM在上下文条件推断中普遍违反全概率公式,提出无参考的统计自洽性评估准则
- Heavy-Tailed Flow Matching via Random Clocks
将重尾源分布分解为时钟条件高斯混合,使流匹配适配稀有事件生成并支持尾部校准。
- Video = World + Event Stream
将视频重新解释为持久世界与事件流之和,提出通用预训练任务,并实现低延迟实时全双工音视频交互
- Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence
提出仅依赖查询通过合成成对证据自动演化出有效检验标准的框架,无需外部标注或训练。
- Project Kaleidoscope: Contextual, Human-Aligned Evaluation for Real-World AI Applications
集成角色测试、定制化评分与人类审核的可靠性门控自动评估方法
- OmniaBench: Benchmarking General AI Agents Across Diverse Scenarios
构建覆盖ToC/ToB/ToE多领域、支持细粒度能力评估的通用智能体基准,前沿模型Pass@1仅约58%
- Does generative AI supersede supervised XMLC? A Benchmark Study on Automated Subject Indexing with German Scientific Literature
在极多标签分类中,整体指标监督 XMLC 更强,但长尾与分级相关性上 LLM 生成式方法更优
- Symbal: Detecting Systematic Misalignments in Model-Generated Captions
利用现成基础模型双阶段审计 MLLM 生成标题的系统性错误,实现 63.8% 准确率,比基线提升近 4 倍
- T^2MLR: Transformer with Temporal Middle-Layer Recurrence
在Transformer中层引入跨时间步的隐状态循环,缓解自回归信息瓶颈,提升推理性能
- Long-Context Fine-Tuning with Limited VRAM
用分层全局注意力、分段反向传播和分级KV缓存,在16GB显卡上将可训练上下文长度从2K扩展到16K,评估时支持131K tokens
- In-Place Tokenizer Expansion for Pre-trained LLMs
通过继续 BPE 合并和两阶段微调,无需重训即可扩展分词器,将低资源语言 token 数压缩 2-4 倍,解码提速 2.2-3.7 倍
- Optimal Self-Distillation for Rectified Flow via Linear Probing
提出整流流中通过混合真实与教师速度的自蒸馏可严格改进教师,并给出最优混合系数的闭式解
2026-07-17 30 篇 ★ 10 深度
- Towards Autonomous and Auditable Medical Imaging Model Development
提出 AMID 多智能体框架,通过数据条件方法规划与验证引导两阶段优化,实现医学影像模型开发自主化
- Boogu-Image-0.1: Boosting Open-Source Unified Multimodal Understanding and Generation
通过数据/训练管线优化和Agent式推理扩展,在极低计算预算下实现逼近闭源的多模态生成性能
- Vinci2: Providing Proactive Assistance in Continuous Egocentric Videos
构建首个大规模主动式辅助基准 EgoServe,提出免训练记忆增强智能体 EgoMemo,实现基于多尺度记忆的自主干预决策
- PalmClaw: A Native On-Device Agent Framework for Mobile Phones
将手机能力封装为结构化工具,任务成功率相对提升11.5%,完成时间锐减94.9%
- Self-Improvements in Modern Agentic Systems: A Survey
提出系统级框架,将自改进Agent形式化为对模型参数或脚手架的自诱导更新,并整理论坛。
- AgentCompass: A Unified Evaluation Infrastructure for Agent Capabilities
通过解耦 Benchmark、Harness、Environment,实现灵活组合、故障容忍与细粒度轨迹分析的 Agent 评测框架
- Discrete Diffusion Models: A Unified Framework from Tokenization to Generation
提出将离散扩散模型视为离散状态空间构建问题的统一框架,揭示设计权衡与未来方向
- KnowAct-GUIClaw: Know Deeply, Act Perfectly, Personal GUI Assistant with Self-Evolving Memory and Skill
提出 KnowAct-GUIClaw 框架,通过可插拔的 GUI 子智能体与经验归因记忆、自演化技能库,实现跨平台长程任务自动化,性能超越闭源模型
- Deep-learning Causal Retrieval Optimization for Efficient e-commerce Distribution in Pinterest
将检索级触发决策建模为因果提升问题,利用随机化数据与双重稳健多任务学习,离线重放选择阈值,线上大幅缩减购物触发并提升整体参与度
- Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel
通过字节精确的KV缓存嫁接,无需训练即可将冻结小模型能力提升13%的同时推理成本降低6500倍
- DevicesWorld: Benchmarking Cross-Device Agents in Heterogeneous Environments
构建统一跨设备基准,含6140个任务,现有最佳Agent成功率仅12.5%
- Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs
通过在多模态推理的物体、上下文和推理阶段引入显式偏好监督,抑制错误传播并减少幻觉
- DS@GT ARC at LongEval: Citation Integrity and Factual Grounding in Scientific QA
前沿模型即使不使用检索文档也能高相关性回答,校正管道小幅提升引用忠实度,强调评估需奖励严格答案根基
- SearchOS-V1: Towards Robust Open-Domain Information-Seeking Agent Collaboration
用关系模式补全、状态外部化与流水线调度构建稳健多Agent搜索系统,大幅提升信息收集完整性与效率
- Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)
系统拆解生成式引擎优化全流程,揭示现有技术仅作用于已检索内容,缺乏可复现的有机发现与长期效果证据
- Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning
提出模型无关的下游奖励框架,用会话级代理信号近似长期留存,在 Pinterest 多表面 A/B 测试中稳定提升活跃度与深度参与。
- SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
SEED通过从在线轨迹提取后见之明技能并蒸馏为密集token级信号,弥补了结果奖励与token策略之间的监督鸿沟
- Long-History User Transformers for Real-Time Ad Ranking
异步离线编码全量历史+轻量在线编码近期事件,在实时广告排序中恢复72–80%全历史模型质量,生产指标提升超2%
- AlphaWiSE: Adaptive Weight Interpolation for Continual Multimodal Representation Learning
提出后处理权重插值方法 AlphaWiSE,为每个参数张量学习一个标量系数组合新旧检查点,实现多模态持续学习的灵活稳定性-可塑性权衡
- CoSimRec: Measuring Coordinated-Content Penetration in Recommender Feedback Loops
提出基于智能体的闭环模拟框架与渗透率指标族APR,量化协调攻击通过反馈循环放大对非机器人用户的影响
- Kernel weighted importance sampling for off-policy evaluation in contextual bandits
将核平滑引入加权重要性采样,在行为策略误设时显著提升离线评估的准确性与稳健性
- LLM-Based Re-Ranking for Real Estate Search
用 LLM 融合多轮对话上下文重排房屋候选,线上 CTR +5.3%, 预约看房 +4.8%
- Bridge Evidence: Static Retrieval Utility Does Not Predict Causal Utility in Multi-Step Agentic Search
在多步 Agent 搜索中,静态低相关文档可能通过提供区分性实体成为关键的“桥梁证据”,静态效用与因果效用近乎独立。
- Mutable Low-Rank Sketches for Retrain-Free Recommendation
用KP-tree存储用户偏好,固定低秩投影,新评分到达时动态更新嵌入,无需重训
- Accelerating A/B-Tests with Counterfactual Estimation: Reducing Variance through Policy Overlap
将随机流量分配视为元策略,用Δ-OPE利用策略重叠达成严格方差缩减,并提供最优流量与排名扩展
- Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation
先指令微调再与原始推理模型合并,低成本提升在难验证领域的性能
- LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget
通过分离长提示状态捕获和串行响应回放,在固定GPU数下将GRPO训练上下文扩展至200万token以上
- SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generation
提出 SAGA 训练无关框架,通过模式约束接地解决智能体 SPARQL 生成中的类型盲问题,显著提升 KBQA 性能并消除空查询。
- Mask-Aware Policy Gradients for Diffusion Language Models
将扩散语言模型生成分解为“选词”与“选位置”两步,策略梯度自然拆分成两项,联合优化在数学与代码推理上达到SOTA
- On-Policy Delta Distillation
用教师与其基模型输出的差异(delta信号)替代直接模仿,更高效传递推理能力增益
2026-07-16 30 篇 ★ 7 深度
- NeuroCogMap Reveals Cognitive Organization of Large Language Models
将 LLM 内部表征脑图式分区,解释行为失败并关联人脑反应与决策策略
- What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulness
探针LLM内部表征可大幅提升预测校准、揭示思维链不忠实,并能通过预推理分布路由节省30-47%推理token
- A Theory of Contrastive Learning with Natural Images
证明对比学习最优表征为傅里叶正弦基加部分白化,可用注水算法解析计算
- SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding
通过合成数据系统控制文档长度、布局、模态和问题类型,揭示VLMs在长文档上的三种失败模式
- AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
构建首个面向高级数学证明的生成-验证双任务基准,揭示前沿LLM在严谨推理上的严重瓶颈
- Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable
通过静态分析+LLM自动构建行为手册并引导渐进披露,解决Agent harness修改中的行为定位瓶颈
- MonkeyOCRv2: A Visual-Text Foundation Model for Document AI
面向文档图像的视觉-文本预训练模型,通过联合生成与重建策略提升多任务性能,冻结后可作为高效的多模态LLM视觉编码器
- Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning
通过算法与系统优化,将Zero RL稳定扩展到1T参数,发现涌现的高级推理行为。
- ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation
基于短到长的在轨蒸馏,消除冗余后缀以加速剪枝LLM的生成恢复训练
- Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering
提出ChartCynics双路径Agent框架,通过视觉诊断与OCR数据验证解耦,大幅提升小模型对误导图表的鲁棒QA性能
- Towards Vision-Free CIR: Attribute-Augmented Scoring and LLM-Based Reranking for Zero-Shot Composed Image Retrieval
通过属性增强混合评分和LLM重排序,实现视觉无关的零样本组合图像检索,CIRR R@1 44.04%(+8.79%)
- AspectCLIP: Optimizing CLIP Representation Space via Aspect-Guided Consistency Regularization
提出方面引导的一致性正则化,解决图像-文本对信息不对称导致的全局对齐扭曲
- Do Agent Optimizers Compound? A Continual-Learning Evaluation on Terminal-Bench 2.0
两阶段持续学习协议揭示:仅回归感知的优化器 RELAI‑VCL 能同时实现正向迁移与二次提升,终身平均通过率达 76.4%
- DeepStress: Stress-Testing Deep Search Agents
提出DeepStress框架,通过控制检索证据的可信度、相关性和事实性来测试搜索代理对低质量信息的鲁棒性
- Personalizing Incremental Video Search with Hybrid Text and ID Embeddings
通过混合语义和协同嵌入为增量搜索提供个性化排序,在意图模糊时收益最大
- Consensus as Privileged Context for Label-Free Self-Distillation
用多票共识充当特权上下文,将投票信号转化为逐token的密集监督,替代RL并接近带标签蒸馏
- Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
将 Agent 记忆访问建模为 MDP,用在线 contextual bandit 学习自适应策略,零额外 LLM 调用且后端无关
- Cluster with Auctions for Vector Search
联合学习平衡分区与神经探测函数,通过拍卖算法优化查询分布下的检索吞吐,OOD 场景提升 4.7 倍吞吐
- Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations
系统分析 OPD 作为探索催化剂的两大病理(师生失配与长度剥削),并提出简易信号调控予以克服
- Experience Memory Graph: One-Shot Error Correction for Agents
通过图匹配失败与成功轨迹,提取编辑操作实现零试错的Agent错误修复
- Analogical Deep Research: Retrieving and Integrating Historical Analogies for Foresight Analysis
提出因果类比研究框架CANA,通过结构分解与交叉确认将类比发现提升10%
- MyAG: A Graph-Based Framework for Designing and Analyzing Composable LLM Agent Systems
将Agent系统解耦为组件图、工作流图和搜索图三层图抽象,支持灵活复用与层级组合,并提供监控分析工具。
- SPyCE: Skill-Policy Co-evolution for Multimodal Agents
将多模态推理轨迹蒸馏为层级技能库,与策略在强化学习中协同进化,形成自我改进闭环
- TMallGS: Scaling Unified Feature and Sequence Modeling for Generative E-commerce Search
通过解耦语义交互与信号保留的Transformer架构,首次在搜索排序中实现Scaling Law并带来显著GMV提升
- Data-Efficient Adaptation of LLMs via Attention Head Reweighting
提出注意力头重加权(AHR),每个头学一个标量权重,参数减少200-1000倍,小样本分类超越LoRA
- TRACE: Turn-level Reward Assignment via Credit Estimation for Long-Horizon Agents
用冻结参考模型的金标答案对数概率变化作为工具调用步骤的即时信用信号,无需 Critic 或过程标签,显著提升长程 Agent RL 训练效率与效果
- Can We Steer the Black-Box? Towards Controllability-Centric Evaluation of Recommender Systems with Collaborative Agents
首个多智能体协同可控性评估框架CtrlBench-Rec,量化推荐系统在目标发现、画像塑造、偏见缓解上的可引导性,揭示长尾内容顽固抵抗
- Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape Pre-, Intra-, and Post-CoT Calibration
揭示SFT、RL、OPD在推理前/中/后校准特性迥异,并提出位置感知置信度PosConf大幅提升聚合与早停性能。
- Self-Evolving Agent Harnesses via Gated Semantic Quality-Diversity
将修改提议与可信度评估分离,通过统计检验和质量多样性归档实现harness稳健演化,跨七领域密封测试增益+9~+15.5pp
- The Dynamic Verifiable Multi-Agent Human Agentic Loyalty Loop (DVM-HALL) Model and the Net Human-Agent Score (NHAS) in Autonomous Commerce
提出多智体忠诚模型与可审计指标,将人类情绪、机器效用、信任、委托与链上执行风险联合建模品牌选择
2026-07-15 30 篇 ★ 7 深度
- ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory
提出通用Agent OS层,通过多模态图记忆与失败驱动自进化,提升长期具身任务执行能力
- Tool-Adaptive LLM Reranker
将点式重排序建模为 Agent MDP,通过成本感知强化学习动态调用工具,平衡精度与效率
- Normative Alignment of Recommender Systems via Internal Label Shift
提出NAILS方法,通过内部标签偏移在不重训模型的情况下使推荐输出属性分布对齐规范性目标,同时保持用户偏好
- Stream-aware Side Adaptation for Large Pre-trained Multimodal Embedding Models in Sequential Recommendation
提出流感知侧适配框架Stresa,用SHAF保留历史记忆和ReSA选择性残差更新,根治深层侧适配退化
- Boolean queries are all you need?
LLM搜索代理自动生成布尔查询,基于子串匹配密度无监督排序,NDCG@10=0.6863超越主流稠密/稀疏检索器
- Beyond Semantic IDs: Encoding Business-Value Ranking into Document Identifiers for Generative Retrieval
提出 CRID,将DocID解耦为语义聚类与业务价值序数排名,实现无冲突、可增量更新的生成式检索,线上GMV提升1.06%
- Score-Only Distillation for Compact Dense Retrieval
仅用教师模型输出的分数向量蒸馏学生模型,无需教师隐藏状态,实现 4.7× 查询编码加速
- Multi-Agent LLMs Fail to Explore Each Other
发现LLM agent在多智能体环境中普遍探索不足,提出MACE通过上下文赌博机显式引导探索,显著提升协作质量
- Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals
用轻量代理模型探索相对改进信号并解耦式传输,实现异步、可复用的跨模型后训练
- Explaining When PRF Fails: Participatory Auditing for Selective Query Expansion
通过用户审计量化PRF的损害并优先避免,用LLM重排序器自动预测选择性决策并给出可解释证据
- User Preference Induction with LLMs for Offline Top-N Recommendation Evaluation
两阶段 LLM 先归纳用户偏好再补充缺失判断,降低评估中的流行度偏差
- Designing Agent-Ready Websites for AI Web Agents: A Framework for Machine Readability, Actionability, and Decision Reliability
提出三个维度的agent-ready网站设计框架,使AI浏览器代理任务成功率从49.3%提升至89.3%
- MMRM: A Multiplex Multimodal Representation Model for Product Ranking in E-commerce Search
用共享MLLM加任务特定token,一次推理生成四种解耦商品向量,并设计多路用户表示提升多目标排序
- Prompt Generation Technical Report
通过配置驱动框架解耦生成式检索中的特征处理与模型架构,实现快速实验、统一部署和低延迟推理
- Enhancing LLMs through human feedback: a journey towards self-improvement
用辅助RAG系统收集并整合详细人工反馈,驱动主RAG回答的自我优化
- Do AI Agents Know When a Task Is Simple? Toward Complexity-Aware Reasoning and Execution
提出 E3 框架让 Agent 先估算任务难度,最小化执行,仅在验证失败时扩展,减少认知冗余
- Not Only NTP: Extending Training Signal Coverage for Generative Recommendation
提出NONTP框架,通过时序对比学习和跨域学习增强NTP训练信号,提升生成式推荐效果
- Tracing Agentic Failure from the Flow of Success
仅用成功轨迹训练,通过神经控制微分方程建模动态,高效定位代理失败步骤。
- RecRec: Latent Interests Recursive Reasoning for Sequential Recommendation
解耦推理与预测,用兴趣压缩和递归推理模块在隐空间逐步精炼,深度可调且无需RL
- What Would You Click? Personalized Video Thumbnail Generation with Preference-aware Highlight Retrieval
提出个性化视频缩略图生成任务,结合用户偏好高亮帧检索和VLM引导扩散生成,显著提升点击偏好
- Cheaper is Better: A Discount-Aware Network for Conversion Rate Prediction in E-commerce Recommendation System
DANet通过傅里叶频谱、分布去偏和回归辅助任务建模商品折扣率对转化率的影响,离线AUC提升1.61%。
- Function-Aware Fill-in-the-Middle as Mid-Training for Coding Agent Foundation Models
用函数调用结构的自监督中间训练增强编码智能体,在复杂任务上提升超3%并缓解能力侵蚀
- Where Reasoning Matters: Rethinking Latent Reasoning in Semantic ID-based Generative Recommendation
按语义ID位置的信息增益自适应分配推理计算量,实现精度与效率平衡
- Evidence-Grounded Verified Agentic Reasoning: A Path Toward Eliminating LLM Hallucination in Empirical Inference via Tool-Attested Kernel Proofs
提出 EG-VAR 架构,用 Lean 证明内核确保 LLM 推理每一步有可靠证据来源,实现 100% 验证精度。
- A JoLT for the KV Cache: Near-Lossless KV Cache Compression via Joint Tucker and JL-Residual Allocation for LLMs
将KV缓存视为三阶张量,用部分Tucker分解+JL旋转低比特残差联合优化,实现近无损2-3倍压缩
- MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
将对话记忆评估从黑盒问答转为显式操作诊断,揭示记忆失败的结构化原因
- MESH: Scaling Up Retrieval with Heterogeneous Content Unification
提出模块化门控偏置校正框架MESH,缓解多内容层级检索中的扩展偏置,大幅提升稀疏内容召回能力
- SlimPer: Make Personalization Model Slim and Smart
将个性化排序重构为紧凑知识库的迭代精炼,实现 O(N) 每层成本,解耦深度与用户历史长度
- Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents
在没有可靠评估指标时,让评估指标与Agent技能协同进化,保持自我改进效能
- Learning to Forget: Satiation-Aware Long-Sequence Transducers for Mitigating Post-Purchase Redundancy
提出饱足感感知机制,建模兴趣退出与唤醒周期,将购买后重复推荐率降低超60%
2026-07-14 16 篇 ★ 4 深度
- LightMem-Ego: Your AI Memory for Everyday Life
一个可部署在手机和AI眼镜上的层次化多模态记忆系统,支持连续积累、组织与检索日常经历
- WSqD: A Horizon-Free Learning Rate Schedule for Large Model Training
提出结合逆平方根基底与线性退火的 WSqD 调度,理论证明其最优 O(1/√T) 收敛,并在 LLM 续训中无需重调优就能超越调优的 WSD
- Metacognition in LLMs: Foundations, Progress, and Opportunities
系统综述 LLM 元认知研究,提出监控与控制双过程框架,总结评估与增强技术
- Single-Teacher View Augmentation: Enhancing Knowledge Distillation with Student-Guided Perturbations
用学生动态特征引导无参数循环移位生成多样视角,实现单阶段高效知识蒸馏
- Diversified Multinomial Logit Contextual Bandits
将多样性作为子模函数直接嵌入MNL选择概率,利用无黑箱oracle的UCB算法实现近似最优的集合推荐
- An Explainable Agentic System for Detection of Conversational Scams with Summary-Based Memory
以可解释 Agent 融合单消息与对话级检测,引入摘要记忆跨消息推理,在基准上达 97.8% 准确率
- Interaction Scaling: Grounding the Third Axis of Test-Time Compute
提出测试时计算的第三轴——交互缩放,用外部工具反馈打破内部计算天花板
- MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
提出首个多图像、多轮、状态化视觉工具调用基准,揭示视觉精度是前沿模型的主要瓶颈
- RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
将知识图谱构建拆分为抽取与整合两步,用7B语言模型超越32B模型,实现更完整的证据检索
- Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias
从隐藏状态几何揭示LLM评判偏差的可控子空间,实现因果转向与失败预测,超越文本方法
- Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming
提出AHA框架,通过假设-伪造-验证循环自动发现代理漏洞,构建跨模型可复用的漏洞概念图
- Extending LLM Context via Associative Recurrent Memory
提出 ARMT 训练方案,在长文本任务中用 30% 更少计算量保持性能并泛化到更长序列
- Think Through a Bottleneck: Hourglass Reasoning for Rigorous Induction
提出 Hourglass 推理框架,通过阶段隔离与符号化状态压缩,大幅提升 LLM 少样本归纳推理能力
- Evidence-Backed Video Question Answering
提出 E-VQA 任务,要求模型同时输出语义答案与精确时空证据(时间段+稠密分割掩码),并构建基准与数据集以弥合推理与细粒度接地的鸿沟
- Active Offline-to-Online Reinforcement Learning
提出基于上置信界主动选择策略以平衡离线到在线强化学习中评估与微调的交互分配
- Playful AI in Professional Email: A Field Experiment on Tone and Recipient Engagement
AI改写邮件语气不直接影响打开/回复,而是通过提升情感积极性间接驱动参与行为。
2026-07-13 37 篇 ★ 6 深度
- Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning
利用事件间弱局部依赖重构解码依赖图,实现无损并行生成,大幅提升密集视频描述效率与性能
- Trust Region Policy Distillation
动态构建近端教师将在线策略蒸馏转化为稳定训练,理论保证梯度方差控制且零额外开销
- VaseMuseum: Digital Intelligent Museum for Ancient Greek Pottery
通过证据级与响应级双重可靠性控制及无训练 GRPO 选择,缓解 VLM 在专业检索中的幻觉与过度自信
- KronQ: LLM Quantization via Kronecker-Factored Hessian
引入梯度协方差实现双向非相干处理与混合精度分配,显著提升2-bit量化性能
- Infinite Worlds with Versatile Interactions
支持无限时长实时交互的世界模型,通过因果预训练、模型蒸馏与双代理架构实现丰富动作与环境生成
- Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Grading
提出长周期终端基准LHTB,细粒度子任务与密集奖励评估智能体长程能力,最强模型仅15.2% pass@1
- From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models
冻结 DiT 并加 LoRA,直接从 patch token 线性读出深度/法线等密集场,避免生成 RGB 再解码
- fog: Expressing Motion and Emotion through Function Composition of AI-Generated Code
利用LLM生成可组合的运动函数类,实现Heider-Simmel风格动画中的语义动作与情感表达
- Beyond Backpropagation: Monte Carlo Method Can Train Deep Neural Networks
用最简单的随机突变-保留蒙特卡洛算法在单GPU上训练深层网络,无需梯度、归一化或残差连接
- A Statistical Test for the Benefits of Personalizing Interventions
提出一种统计检验,用历史数据评估个性化策略是否优于最佳单一干预,提供严格错误控制
- Scalable Visual Pretraining for Language Intelligence
直接在视觉文档上预训练可超越纯文本预训练,为语言智能提供高效可扩展路径
- A Sovereign, Open-Source Foundation Model for German and English
混合MoE与Mamba架构激活3B参数即匹配14-27B稠密模型,长上下文吞吐大幅领先
- ProjAgent: Procedural Similarity Retrieval for Repository-Level Code Generation
提出程序化相似性作为显式检索信号,结合 Agent 工作流与静态分析反馈,提升仓库级代码生成效果
- Experimental Evidence on the Learning Impact of Generative AI
随机实验表明,用生成式AI辅助学习可使知识测试分数即时提高0.27标准差,且延迟收益集中于增强式使用者
- Self-Guided Test-Time Training for Long-Context LLMs
模型自适应前先自选相关证据片段,只在选中的片段上做测试时训练,长上下文推理最高提升15%
- AgentKGV: Agentic LLM-RAG Framework with Two-Stage Training for the Fact Verification of Knowledge Graphs
结合动态路由、迭代查询改写与双阶段训练,提升 KG 事实核查准确率并大幅降低检索成本
- Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation
通过校准置信度的拍卖机制,将复杂推理任务动态分配给最合适的专家模型,实现成本-质量可控。
- Super-Tuning: From Activation-Aware Pruning to Sparse Fine-Tuning
复用剪枝中的激活感知重要性分数来固定稀疏可训练参数,提出Super和Supra实现高效微调
- Failure as a Process: An Anatomy of CLI Coding Agent Trajectories
首次大规模实证分析LLM CLI编程代理的失败轨迹,发现失败主要由认知错误驱动且早期隐蔽。
- From Raw IDs to Semantic Planning: How Recommender Systems Utilize Information at Scale
提出推荐系统正从原始 ID 经语义 ID 走向语义规划,将曝光目标显式化以协调多方利益
- CtrlVTON: Controllable Virtual Try-On via Visual-Instance-Prompt Segmentation
提出VIP-SAM实例分割与CtrlVTON图像编辑框架,首次实现试穿中服装风格、尺寸和位置的像素级控制
- DKCD: Domain Knowledge-Enhanced Causal Discovery from Unstructured Data
引入领域知识强化LLM因果推理,解决潜在因素识别不全和标注不可靠问题
- Multimodal Reward Hacking in Reinforcement Learning
揭示多模态RL中奖励信号不完美导致的系统性破解,提出NRFR指标并比较算法与奖励设计的影响
- All Explanations are Wrong, But Many Are Useful: Exploring the Rashomon Explanation Set with Large Language Models
将解释与预测耦合,通过 LLM 代理的“解释-预测-反思”循环生成多个忠实且有用的解释,在提升可解释性的同时提高了预测精度。
- Scoped Verification for Reliable Long-Horizon Agentic Context Evolution under Distribution Shift
提出图正则化上下文演化(GRACE),将指令表示为类型化语义图并局部验证更新,使长程Agent可靠性提升7倍
- GatedLinear: Adaptive Routing of Complementary Linear Bases for Time Series Forecasting
用三因子融合门将互补线性基动态路由到异质时序模式上,轻量且可解释
- Mach-Mind-4-Flash Technical Report
35B MoE仅3B激活参数,通过多专家RL与MOPD蒸馏融合,在Agent基准上超越10-30倍激活参数的大模型
- Towards Detecting Inconsistencies in End-to-end Generated TODs
将任务型对话建模为约束满足问题,利用CSP求解器自动检测不一致并建议最小修复
- Spectrally Deconfounded Gradient Boosting
通过频谱损失与早停相结合,在梯度提升中实现非线性隐藏混淆校正
- Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models
引入复杂社会行为数据集,评估十年间VLM场景描述准确度提升,并分析五类错误演变
- Robustifying Vision-Language Models via Test-Time Prompt Adaptation
提出分布级最优传输对齐与动态缓存的测试时提示适应方法,大幅提升VLM对抗鲁棒性且无损清洁性能
- WILDTRACE: Benchmarking Natural Evidence Trails in Long-Context Reasoning
从真实事故报告与小说中抽取文档内在的因果、时序证据链,构建多步推理基准,揭示长上下文模型的整合推理短板
- Test-Time Scaling for Small VLMs on Multilingual Visual MCQ
揭示可解析性和解码预算才是小VLM测试时缩放的关键,而非复杂搜索或验证
- An Emergent Mirage: Is Emergent Misalignment and Realignment Indeed a Robust Phenomenon?
发现 Emergent Misalignment 与重对齐对数据集表层特征高度敏感,先前声称的机械签名不可靠
- Semantic Pareto-DQN: A Multi-Objective Reinforcement Learning Framework for Financial Anomaly Detection
用 LLM 编码交易描述作状态,多目标解耦效益与摩擦,打破零召回成规
- Shared Selective Persistent Memory for Agentic LLM Systems
将智能体会话中的可复用上下文提炼为四种结构化记忆,丢弃推理痕迹,实现跨会话协同与零Token数据刷新
- Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers
模拟人眼中央凹视觉,动态选择重要 token 并融合多尺度信息,在 50% 预算下超越 DeiT-S 且计算量降低 34.57%
2026-07-12 9 篇
- LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment
用原型对齐正则化和语义锚定层路由在冻结Whisper上实现0.36 RMSE,媲美十亿参数大模型
- Vidu S1: A Real-Time Interactive Video Generation Model
实现语音控制数字角色的无限时长实时视频生成,消费级GPU上540p/42 FPS
- Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs
通过识别并操控稀疏神经元或注入方言向量,在推理时无微调控制LLM方言输出
- RoboTALES: Learning Reasoning-Guided Robot Policies via Task-Aligned Simulated Futures
提出层次LLM规划器与VLM批评家联合引导视频生成,使机器人策略在长视野操作任务上显著优于现有方法
- Mathematical methods of reinforcement learning
用概率、优化和算子理论统一现代RL算法的收敛性与样本复杂度分析
- ShapeTalk: Combining Natural Language and Sketch for Time-Series Pattern Querying
提出用自然语言和草图互补查询时序模式,LLM解析语言为可编辑的形状约束
- DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models
提出视觉更新范式,增量预测变化令牌替代全图生成,减少55.6%视觉令牌并提升多模态推理3.3%
- Conversational Retrieval and On-the-Fly Knowledge Modeling of Historical Penitentiary Repression Records
在图结构上动态建模专家知识,充当LLM记忆实现跨文档推理与对话式检索
- The Context Access Divide: Interaction-Level Architecture as a Complementary Dimension of Agentic Inequality
提出“上下文访问鸿沟”概念,揭示动态检索与手动附加上下文在知识工作中的任务成功概率差异
2026-07-11 27 篇
- CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation
通过剪枝-蒸馏-量化三阶段优化,将大型视频扩散模型压缩至移动端,实现40倍加速的电影运镜生成
- AgentLens: Production-Assessed Trajectory Reviews for Coding Agent Evaluation
提出基于LLM审查完整交互轨迹的编程代理评估基准,提供可解释评价用于诊断与回归检测。
- Multimodal Video-to-Music Recommendation via Semantic Retrieval and Temporal Reranking
提出语义检索与时序重排序两阶段框架,在视频到音乐推荐中同时建模全局语义和细粒度时序对应
- Linear Attention Architectures: Mechanisms, Trade-offs, and Cross-Layer Routing
比较四种递归线性注意力并提跨层值路由,Kimi Delta Attention+Muon损失最低
- Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learning
将评估反馈作为纠正信号融入模仿学习,在序列决策环境中实现离线对齐,最多减少 98% 未对齐行为
- LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models
利用预训练视频扩散先验统一处理事件相机的视频重建、预测与插帧,引入自回归展开与自适应上下文切换抑制长期漂移
- InductWave: Inductive Multi-Hop Logical Query Answering on Knowledge Graphs
用图小波变换的归纳式嵌入,以更少消息传递层数实现大规模知识图谱上的多跳逻辑查询回答性能超越现有方法
- Enhancing In-context Panoramic Generation via Geometric-aware Pretraining
通过几何感知预训练和 token 级任务统一,提升全景图像生成的几何一致性与任务覆盖度
- OpenCoF: Learning to Reason Through Video Generation
提出 Chain-of-Frame 推理范式,通过多样化时序监督和显式推理 token 增强视频生成模型的推理能力
- Learning social norms enhances compatibility in dynamic human-AI coordination
量化行人交互中的社会规范三原则(结果可预测、价值对齐、优势意识)使LLM协调得分超基线4倍,超人类43%
- AutoPersonas: A Multi-Timescale Loop Engine for Open-Ended Persona Evolution
发现并缓解长期角色智能体的自我锁定行为——事件看似合理但生活坍缩,通过分离事件、观察与状态并引入发散目标减少重复
- Stop Guessing When to Stop Testing: Efficient Model Evaluation with Just Enough Data
提出自适应顺序测试框架,用 CI 宽度和递减收益动态停止评估,节省最高 80% 计算成本并保持统计显著性
- When the Judge Changes, So Does the Measurement: Auditing LLM-as-Judge Reliability
揭示评估器更换导致的测量歧义,发现模型升级路径不可互换且偏差犹存,强调审计实践
- DocMaster: A Hierarchical Structure-Aware System for Document Analysis
保留文档层次结构,构建结构感知语义索引,提升复杂文档过滤与问答性能
- Reinforcing the Generation Order of Multimodal Masked Diffusion Models
用GRPO学习生成顺序控制模块,提升文本到图像对齐与多模态理解
- Workflow as Knowledge: Semantic Persistence for LLM-Mediated Workflows
将工作流定义、实例、推理记录等作为可持久化的知识对象,支持工作流的可检查、可恢复和可审查
- ICDAR 2026 HIPE-OCRepair Competition on LLM-Assisted OCR Post-Correction for Historical Documents
组织多语言历史文档 OCR 后校正竞赛,评估 LLM 在不同噪声和语言下的校正能力与过校正风险。
- Dimensionality Reduction Meets Network Science: Sensemaking on UMAP's kNN Graph
用PageRank、k-core、聚类系数等图算法挖掘UMAP的kNN图,发现被2D投影掩盖的数据结构
- When Structured Sparse Autoencoders Learn Consistent Concepts Across Modalities
在视觉语言模型中,通过图像块分组与结构化稀疏正则化,解决稀疏自编码器概念碎片化问题,提升跨模态概念一致性与单义性
- When Synthetic Speech Is All You Have: Better Call GRPO
在合成语音ASR域适应中,GRPO强化学习比监督微调大幅降低WER 40-45%
- Log-Insight: Automating Microservice Incident Diagnosis via Neuro-Symbolic Log Analysis
通过符号化压缩将百万行日志精简为紧凑证据,再由LLM生成根因报告,MRR=0.790且90%+的Top-3命中率。
- Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-Research Source Attribution
对比8个LLM裁判在引用质量评估中的表现,发现便宜模型即可胜任,且标量F1掩盖的方向性偏差会误导RL训练
- SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling
利用Agent工作负载的会话内局部性,通过会话首请求负载均衡+后续请求缓存亲和路由,在不牺牲KV重用下实现高吞吐
- Token-Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents
针对持久化 AI Agent,通过 token 流语义防火墙实现全覆盖预执行审计,将攻击成功率压至 12.5%
- Prompt Compression via Activation Aggregation
将固定指令提示压缩为单个激活向量并注入 LLM 早期层,准确率下降小于 2%
- Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures
大规模实验表明 CosineAnnealingWarmRestarts 与 CyclicLR 普遍优于基础衰减,调度选择高度依赖架构
- Formal Mechanisms for Market Stability in Self-Interested Agent Societies: A Marketplace Simulation Study
在 LLM 驱动的市场仿真中,调解机制能有效抵御对抗攻击,维持多智能体合作稳定
2026-07-10 30 篇 ★ 10 深度
- Automating the Design of Embodied Agent Architectures
首次系统评估在具身模拟环境中用架构搜索自动化设计Agent,揭示噪声与局部最优等局限
- CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
提出数据集 CanvasCraft 与多模态代理 CanvasAgent,通过 SFT+GRPO 训练,实现多工具协同的复杂图像编辑工作流
- Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE
一种无需微调的零样本长上下文扩展方法,通过动态调整远程窗口分组因子保持位置在分布内,并利用容斥注意力合并实现几乎无开销的推理
- UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma
通过stop-gradient自锚定比率取代重要性采样,对正向优势释放无界梯度以最大化探索,同时保留负向裁剪加固训练稳定性
- Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity
通过稀疏寻址将门控线性RNN的状态容量提升千倍,在等FLOPs下大幅改善长上下文检索和训练损失
- CausalDS: Benchmarking Causal Reasoning in Data-Science Agents
提出通过合成结构因果模型与真实背景故事评估LLM在数据科学管线中的因果推理、工具使用与弃权能力
- Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems
提出AgentLocate,通过信心感知的多评估者聚合与轻量微调,精准定位多智能体系统中的故障代理与起始步骤
- UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
首个能力驱动、在动态 Docker 环境中闭环评估主动智能体的基准,揭示框架比模型更影响性能
- BACH: A Bayesian Admixture of Contrastive Heads for Multi-Interest Two-Tower Retrieval
将多兴趣检索建模为用户混合模型,用变分推断产生软路由和个性化权重,缓解头坍缩并提升 top‑rank 质量。
- BiSCo-LLM: Lookup-Free Binary Spherical Coding for Extreme Low-Bit Large Language Model Compression
提出无码本二进制球形编码框架,结合残差编码与恢复蒸馏,在 2 比特/权重下保持 LLM 性能
- Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment
揭示推理教师、指令教师、管道教师蒸馏小模型时传递不同能力,形成设备端结构化提取的任务级路由策略。
- DaV-Gen: End-to-End Generative Retrieval via Draft-and-Verify
将生成式检索重构为向量召回 + 并行验证,打破自回归解码的延迟瓶颈
- DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding
利用Domino的GRU路径依赖校正构建非因子化草稿树,在Qwen3-4B上平均加速达4.81倍,接受长度最高10.7 tokens
- EdgeRefine: Privacy-Utility Balance for Graphs via Jaccard Sampling under Edge Differential Privacy
通过 Jaccard 相似度估计边概率并自适应采样,在边差分隐私下显著提升 GNN 准确率。
- Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
提出将记忆视为主动干预策略,通过独立的记忆代理有选择地注入遗忘关键状态,解决长程任务中的行为状态衰减
- H3D: Benchmarking Unsupervised Text Hashing for Fine-Grained Document Deduplication
提出统一基准H3D,比较无监督非学习哈希与预训练嵌入量化哈希在细粒度文档去重上的效果、效率与鲁棒性
- It Takes a MAESTRO To Prune Bad Experts
将专家激活轨迹建模为马尔可夫链,利用稳态分布评估全局重要性,实现MoE模型的高效剪枝
- Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning
揭示“知用鸿沟”:记忆的表示存在但未路由到有效计算层,提出自修补干预可恢复58-75%的泛化失败
- The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs
提出 correctness agreement 指标揭示量化导致的行为分歧,发现 query/key 投影对量化更敏感
- Super Weights in LLMs and the Failure of Selective Training
证明重要性不等于可孤立训练性:微调 Super Weight 完全失效,而全层低秩更新(LoRA)成功且对位置限制鲁棒
- Two Axes of LLM Abstention: Answer Correctness and Question Answerability
揭示LLM拒答中答案正确性和问题可回答性是两个独立维度,提出用隐藏探针和双阈值策略分别控制风险
- Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
将视觉历史外化为结构化记忆并选择性检索,8B代理在20轮多模态对话中检索准确率达91.4%,超越32B统一模型且推理时间减半。
- SLORR: Simple and Efficient In-Training Low-Rank Regularization
在训练中施加低秩正则化,使模型压缩后更易保持性能,训练开销极低
- Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learning
通过GRPO与双层正则化,让多模态LLM学会何时直接回答、何时显式推理,在异构任务中兼顾精度与效率
- Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging
无需微调,通过参数合并融合即席与对话检索能力,零样本NDCG@3提升最高15%
- UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing
提出函数调用式程序编辑框架,以插入/删除/修改实现细粒度数据精炼,提升预训练数据效率与质量
- WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search
通过动态递归委派将任务分解与四种搜索模式结合,并用网页结构探测和经验复用提升多智能体搜索的深度与覆盖度
- A Practical Investigation of Training-free Relaxed Speculative Decoding
统一宽松投机解码框架,实证发现放松保真度需仔细能力评估,且依赖强草稿模型
- Resample or Reroute? Budget-Aware Test-Time Model Selection for Large Language Models
提出在线策略 RoR,在单查询成本预算下动态分配重采样与重路由,最大化正确性。
- Beware What You Autocomplete: Forensic Attribution of Backdoored Code Completions
提出 CodeTracer,仅凭微调语料和误补全事件即可将恶意代码补全追溯到具体的后门训练数据
2026-07-09 30 篇 ★ 9 深度
- Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers
提出 Bridge 模块实现跨潜空间蒸馏,让高分辨率大教师模型蒸馏到不兼容的低分辨率学生模型
- When Classic Cache Policies Fail: Learning-Augmented Replacement for Semantic Retrieval Buffers
提出学习增强框架 SOLAR,通过遗憾驱动更新和贝叶斯在线选择,在语义缓存中取得恒定竞争比和 5–75% 的相对提升
- RuleChef: Grounding LLM Task Knowledge in Human-Editable Rules
利用LLM从标注数据自动生成、迭代修补可执行规则,得到快速、可解释的符号系统
- Gemma 4 Technical Report
开源密集与 MoE 多模态模型,集成思维链、长上下文压缩与量化,在多项基准上以小参数量匹配大模型
- MentalThink: Shaping Thoughts in Mental SVG World
让多模态大模型生成并执行SVG代码作为中间视觉表示,实现可验证的空间推理。
- Attending to Multimodal Generation One Token at a Time
系统揭示多模态LLM生成过程中注意力随语义角色切换的逐令牌动态,并提出测试时干预提升多模态任务性能
- LLM-as-a-Tutor: Policy-Aware Prompt Adaptation for Non-Verifiable RL
让 LLM 同时充当考官和生成器,通过追加原子约束实现提示难度自适应,恢复奖励区分度。
- Progressive Disclosure for LLM-Maintained Wiki Knowledge Bases: a Preregistered Ablation
工具型 Agent 直接推断页面路径,避免索引加载,成本节约来自更精准的访问而非预期节省
- TurnOPD: Making On-Policy Distillation Turn-Aware for Efficient Long-Horizon Agent Training
通过轮次级预算策略解决长时智能体训练中全轮次 rollout 浪费与令牌级损失偏向浅层的问题
- When and How to Ask: Dynamic Preference Elicitation Strategies for Conversational Recommendation
阶段感知:前期问属性,后期推物品,MoE建模策略选择提升对话推荐效率
- Agon: Competitive Cross-Model RL with Implicit Rival Grading of Reasoning
让两个模型互为评分者,通过竞争性RL隐式判断推理质量,无需过程标签,大幅超越GRPO
- RLVP: Penalize the Path, Reward the Outcome
用可验证的路径惩罚补充结果奖励,在极少交互下同时达成高成功率和近零违规
- From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents
迭代地从执行轨迹中提取可复用 SOP,并持续合并、评估、剪枝,实现工具集的自进化与精简。
- From Noisy Traces to Root Causes: Structural Trajectory Analysis and Causal Extraction for Agent Optimization
提出STRACE框架,通过失败模式挖掘和因果定位剔除冗余轨迹与无关步骤,实现Agent反思优化的降噪与提效
- Think Big, Search Small: Where Capacity Matters in Hierarchical Search Agents?
在层级搜索Agent中,规划侧的容量是瓶颈,执行侧可缩至1.7B且性能不降,颠覆均匀分配惯例。
- Future Confidence Distillation in Large Language Models
利用回答后隐藏状态训练探针作为教师,将置信度信息蒸馏到回答前表征,实现低延迟高校准的置信估计
- Single-Rollout Asynchronous Optimization for Agentic Reinforcement Learning
提出单次 rollout 异步 RL 策略 SAO,以 token 级双面裁剪和更快价值更新稳定训练,在智能体推理与编码任务上显著超越 GRPO
- Behavior Leverage Imbalance in Multi-Teacher On-Policy Distillation
指出多教师在线蒸馏中局部高杠杆 token 信号会导致工具过呼叫等行为偏移,提出 Soft Clamp 动态压缩极端 token 级散度来校准
- Seeing and Reflecting: Multimodal Memory-Enhanced Agent Collaboration for Recommendation
提出双轨多模态记忆增强智能体协同框架,融合推理与稠密匹配,在视觉密集型推荐上大幅领先
- Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale
利用 MLP 激活的逆参与率和光谱熵可在单次前向中检测实体熟悉度(AUROC 0.95-1.00),但此信号与事实可靠性行为分离
- Co-LMLM: Continuous-Query Limited Memory Language Models
用连续向量查询替代关系型查询,从可读知识库检索知识,提升语言模型事实精度与数据效率
- Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering
利用 LLM 隐藏状态分解不确定性,以单次前向高效估计,按信号自适应触发 RAG 或推理
- R^3: Advertisement Compliance Rectification via Group-Relative Experience Extractor and Curriculum Reinforcement
用组对比经验提取和两级课程强化学习,在视频广告文案合规修正中平衡审核通过率与语义意图保留
- RL Post-Training Builds Compositional Reasoning Strategies
RL后训练能将基础模型的原始技能组合为新的高级推理策略,而拒绝微调易陷入停滞。
- How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization
揭示学习到的RoPE频率与训练数据依赖宽度匹配的机制,并基于此解释长度外推的条件
- SkillCenter: A Large-Scale Source-Grounded Skill Library for Autonomous AI Agents
提出迄今最大的开放技能库,含216,938个源归因结构化技能,提升AI智能体输出正确性与安全性
- Search, Fail, Recover: A Training Framework for Correction-Aware Reasoning
提出Pyligent,利用验证器标记失败分支并显式训练回溯,让小型LLM学会从延迟错误中恢复推理
- SynthAVE: Scalable Synthetic Labeling for E-Commerce with LLM-Arena Validation
用 21 个异质 LLM 组成的投票仲裁机制验证合成标注,与人类专家一致性达 95.2% (κ=0.92),错误校正率 83.1%
- The Key to Going Linear: Analysis-Driven Transformer Linearization
证明 key-dependent rank-1 正交投影是 softmax 的关键,提出 sink tokens、短卷积、固定预算缓存路由等干预,实现冻结骨干线性化,在 32B 规模超越前方法
- Max Out GRPO Signal: Adaptive Trace Prefix Control for Hard Reasoning Problems
自适应前缀控制动态维持困难问题的50%成功率,最大化GRPO梯度信号,大幅提升推理准确率
2026-07-08 30 篇 ★ 3 深度
- SeKV: Resolution-Adaptive KV Cache with Hierarchical Semantic Memory for Long-Context LLM Inference
用熵引导语义分段 + GPU-CPU 分层存储 + 按需 zoom-in 实现长上下文 KV 缓存压缩,避免丢弃信息
- Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling
提出HiLS Attention,端到端学习分块选择的分层稀疏注意力,推理加速且外推超64倍训练长度
- SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibe
用零阶优化与三项原则将 Agent 技能优化精简为一行代码,提速收敛并让纳米模型超越大模型
- Bridging Interleaved Multi-Modal Reasoning as a Unified Decision Process
提出 BRAID,把多轮文本-图像推理建模为统一 MDP,用 RL 联合优化文本与图像生成,并引入 VLM judge 提供稠密回合反馈
- OmniOpt: Taxonomy, Geometry, and Benchmarking of Modern Optimizers
提出统一元流水线与LMO框架,构建双维度分类并系统性基准评测100+优化器
- Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
通过MCTS树搜索采集轨迹并蒸馏为轻量Q值模型,解耦动作提案与后果评估,在不微调VLA下显著提升泛化与效率
- dOPSD: On-Policy Self-Distillation for Diffusion Language Models
将去噪轨迹的后续步骤作为特权信息进行在线自蒸馏,提升扩散语言模型的推理与泛化能力
- UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning
提出多教师在线蒸馏持续学习框架,动态选择平台教师,缓解跨平台GUI智能体的灾难性遗忘与行为冲突
- KVpop -- Key-Value Cache Compression with Predictive Online Pruning
通过监督未来注意力信号学习固定预算的 KV 缓存淘汰策略,结合延迟评分器,在推理任务上以高压缩比保持性能
- Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memory
通过全局与隐状态实现单步上下文驱动动作,以反射取代迭代推理,速度提升12.1倍、精度提高2.4%
- Quantifying and Expanding the Theoretical Capacity of Late-Interaction Retrieval Models
证明 MaxSim 可复制任意非负稀疏内积并引入 Signed MaxSim,实现任意实向量内积复制,带来理论解释和实验提升。
- Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
单模型支持自回归、扩散、自推测三种解码模式,在吞吐和效率上显著超越开源AR和扩散LM。
- Vision as Unified Multimodal Generation
将异构视觉任务统一为多模态生成,单一模型通过指令输出文本或图像,匹配专家系统
- Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade
提出召回受控的探针级联,在Agent早期预测失败并终止,节省47%推理计算且保证全局存活率
- From Voting to Agent Collaboration: Answer-Type-Aware LLM Pipelines for BioASQ 14b
针对生物医学问答中不同答案类型设计LLM推理策略,结合多智体协作验证取得最佳结果
- CurateEvo: Data-Curation Evolving for Agentic Post-Training
用失败轨迹动态重写可执行策展代码,统一生成SFT/RL/记忆数据并裁剪冗余
- DynaKRAG: A Unified Framework for Learnable Evidence Control in Multi-Hop Retrieval-Augmented Generation
将多跳证据获取构建为状态条件下的原子操作控制问题,通过学习控制器动态选择操作,性能全面超越固定基线。
- Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs
揭示全双工语音模型中声学与语义的梯度冲突,并提出分层参数分离策略以消除模态干扰
- InfluMatch: Frontier-Quality KOL Search at 4B-Model Cost
提出三阶段检索-重排-评分级联,用4B开源模型达到94.1% P@5,仅需前沿LLM 1/35的输出令牌
- Retrieving a Set, Not Independent Passages: Set-Level Compatibility Learning for Efficient Set Exploration
将多跳检索建模为查询-集合兼容性评分,用轻量自注意力和交叉编码器联合学习集合兼容性
- Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning
将外推梯度引入SAM形成EISAM,两步更新提升泛化且降低超参敏感度
- LongCrafter: Towards Diverse Long-Context Understanding via Evidence-Graph-Guided Instruction Synthesis
提出证据图引导的长上下文指令合成框架,覆盖32种任务,训练数据显著提升长文本理解并缓解迷失中间问题
- SCOReD: Student-Aware CoT Optimization for Recommendation Distillation
通过学生注意力评分和奖励引导的编辑,压缩推荐推理链中的冗余验证,提升小模型蒸馏效果
- FreqDepthKV: Frequency-Guided Depth Sharing for Robust KV Cache Compression in Long-Context LLM Inference
推理时不需重训,通过频率分解与自适应模式分配压缩KV缓存,在长上下文任务中精度接近全缓存且实现3.9倍压缩
- Faithful or Findable? Evaluating LLM-Generated Metadata for RDF Dataset Search
无约束LLM改写元数据检索效果最好但忠实性最差,基于概貌的改写提供最佳平衡
- Improving LLM-Generated Process Model Quality Through Reinforcement Learning: The Role of Reward Function Design
RL 通过奖励函数设计显著提升 BPMN 模型的语法和语用质量,并揭示等权重优于定向加权等关键发现
- Learn to Pool: Lightweight Fine-Tuning for Flexible Multi-Vector Compression
用轻量微调与k-means池化让ColBERT压缩83%向量而不损失检索精度
- CMDR: Contextual Multimodal Document Retrieval
提出首个要求跨页上下文建模的多模态文档检索基准与嵌入框架CMDR-Embed,结合CMCL对比学习显著提升跨页查询性能
- WebRetriever: A Large-Scale Comprehensive Benchmark for Efficient Web Agent Evaluation
提出涵盖800网站1550任务的多域Web Agent基准与基于交互上下文的评估框架,揭示导航成功率不足以衡量真实效果
- Inject or Navigate? Token-Efficient Retrieval for LLM Analysis of Transactional Legal Documents
比较全量注入、嵌入检索与LLM导航索引,证明检索可大幅降低token消耗且质量不降
2026-07-07 30 篇 ★ 16 深度
- DataComp-VLM: Improved Open Datasets for Vision-Language Models
数据混合而非过滤是提升VLM训练质量的关键,指令丰富混合可扩展性更优
- Securing the AI Agent: A Unified Framework for Multi-Layer Agent Red Teaming
提出开源框架AI-Infra-Guard,分层匹配检测范式覆盖基础设施到模型的全攻击面并加入供应链审计
- Measuring the Gap Between Human and LLM Research Ideas
通过研究品味分类法,量化LLM生成的研究想法在分布上与人类存在系统性偏差
- MultAttnAttrib: Training-Free Multimodal Attribution in Long Document Question Answering
利用预填充注意力头与校准阈值实现训练无关的多模态问答证据定位,速度提至七分之一。
- PraMem: Practice-derived Experiential Memory for Long-horizon Behavior Prediction
将长历史序列化为练习样本,通过迭代试错构建可演化的模式经验与偏差警告,显著提升 LLM 长程行为预测准确性
- APeB: Benchmarking Personalization Ability of Large Language Model Agents
构建真实个性化产品搜索基准,揭示LLM智能体在模糊意图与噪声历史下历史利用不足的核心瓶颈
- HGenPush: A Heterogeneous Generative Recommendation Architecture for Industrial Push Notification Systems
解耦自回归生成,以链式多token预测和行为偏好对齐统一推荐视频与作者,快手推送获+0.181% DAU提升。
- Relevance-Based Embeddings: Lightweight Candidate Retrieval via Heavy-Ranker Calls
利用重排序器评分构造查询与物品的相关性向量,通过神经网络映射为嵌入,可近似任意复杂相关函数且参数极少。
- TRIAGE: Trustworthy Retrieval Instrumentation And Graph Evaluation
提出分阶段、无标注的信任指标链,用于定位自动构建的知识图谱在RAG中的故障阶段
- Beyond Item Order: Temporal Gap Tokenization for Generative Recommendation with Semantic IDs
提出 ChronoSID,通过在物品表征学习和序列生成中注入离散时间间隔令牌,显著提升语义ID生成式推荐效果
- Candidate-Constrained Retrieval-Augmented Generation for LongEval-RAG: System Design and Empirical Analysis
在候选约束 RAG 中,规则分块配合句子级神经选择优于复杂语义分块,获得多项指标最优
- Next-Gen Sponsored Search: Crafting the Perfect Query with Inventory-Aware RAG (InvAwr-RAG) Based GenAI
通过实时库存感知的RAG+LLM查询改写,将无广告填充的搜索比例从13%大幅降低,填充率提升68%
- ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes
从机器学习顶会论文中提取15种可复用构思模式,构建证据驱动的端到端创意生成工作流
- Enhancement of E-commerce Sponsored Search Relevancy with LLM
用 LoRA 微调 LLaMA2 7B 做 <query, ad title> 三分类,准确率 89.43% 优于 GPT-4 和 BERT
- ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blog
将论文自动转化为可编辑的海报、视频与博客,通过共享提取器和硬性渲染门控保证可用性
- EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments
首次发现智能体在真实环境中的长时间学习遵循精确的对数S型缩放定律,R²达0.998
- LBR: Towards Mitigating Length Bias in Large Language Models for Recommendation
首次识别并缓解 LLM 推荐中输入注意力偏差和输出解码偏差,提出轻量级长度感知注意力校准与有效信息长度归一化
- LLM-as-a-Verifier: A General-Purpose Verification Framework
用token logits期望代替离散评分,实现连续验证并支持评分粒度、重复、分解三维扩展,跨域SOTA
- UniSGR: Unified Framework for Semantic ID Generation and Ranking
将多目标排序与语义ID生成联合训练,通过价值感知并行预测和任务感知Token缓解级联系统的目标错位
- Autonomous Information Seeking: A Roadmap for Agentic Recommender Systems
提出融合自主性等级与三种代理范式的统一分类法,系统梳理 LLM 代理如何改造推荐系统
- CanniUplift: A Holistic Framework for Mitigating Seller and Incentive Cannibalization in E-commerce Uplift Modeling
通过平台全局对齐和兑换分解去噪,解决电商 uplift 建模中的跨店替代与激励混合噪声问题
- CompactionRL: Reinforcement Learning with Context Compaction for Long-Horizon Agents
提出CompactionRL,联合优化任务执行与上下文压缩,使LLM智能体从压缩长轨迹中学习,显著提升长程编码任务性能
- Strategic Buying Agents
在平稳、贝叶斯、鲁棒三种信息假设下推导购买阈值策略,并用Amazon价格数据验证LLM更适合模型选择而非直接决策。
- DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation
半自回归架构缓解并行预测因果衰减,置信调度动态剪枝低信心后缀,系统吞吐与交互速度显著提升
- Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval
提出对象感知token合并框架SaMer,在MaxSim下将视觉token压缩至K个质心,减少16.09×存储并提升R@1
- Multi-Turn On-Policy Distillation with Prefix Replay
用教师前缀重放替代环境交互,以步骤衰减平衡学生相关性与教师可靠性,实现加速免工具调用的Agent蒸馏
- MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
提出双时间尺度框架,让 Agent 的任务技能和元技能(改进流程)都能递归自进化,提升长程任务表现
- MIRAGE: Defending Long-Form RAG Against Misinformation Pollution
提出一种训练无关、模型无关的防御方法,通过跨文档声明图和多源一致性门控恢复RAG事实性
- Weak-to-Strong Generalization via Direct On-Policy Distillation
提出 Direct-OPD,将弱模型 RL 前后策略偏移作为隐式奖励,直接提升强模型推理能力
- TREK: Distill to Explore, Reinforce to Refine
用教师或自反提案识别并巩固困难提示,以正向KL先行扩展学生支持,再交还GRPO精炼
2026-07-06 11 篇 ★ 1 深度
- The Mirage of Optimizing Training Policies: Monotonic Inference Policies as the Real Objective for LLM Reinforcement Learning
提出 MIPI 原则与两步框架 MIPU,在训练-推理不匹配下直接优化推理策略,实现稳定高效 RL 训练
- Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning
提出MRPO算法,对错误路径早期推理步施加指数惩罚以抑制级联失败,显著提升医学多模态推理精度。
- Unsupervised Data-Efficient Cross-Modal Retrieval with Global-Neighborhood Alignment Hashing
仅用少量图文对,通过原型全局对齐与随机邻域对比学习,将视觉–语言大模型语义结构压缩为二进制哈希码
- Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting
系统审计KB-VQA基准,揭示答案可推导性、问题约束和视觉设定上的缺陷,并引入修复与多实体增强协议,纠正模型评价偏差。
- WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory
将3D语义运动编排与视频生成解耦,用LLM生成控制轨迹,实现持久动态对象记忆与高可控长视频合成
- Behavior-Adaptive Conversational Agents: Toward a Fluid Personality Framework
提出根据任务情境动态协调LLM对话代理的隐喻角色和人格强度的流体人格框架
- Learning to Compose: Revisiting Proxy Task Design for Zero-Shot Composed Image Retrieval
提出可学习的二阶段组合模型FoCo,通过文本锚定视觉聚合与上下文补全代理任务,无需三元组监督即达SOTA
- DRIFTLENS: Measuring Memory-Induced Reasoning Drift in Personalized Language Models
提出无真值框架 DRIFTLENS,量化用户记忆注入对 LLM 推理路径的影响,并评估 GRPO/DPO 缓解策略
- Alignment Is All You Need For X-to-4D Generation
提出 Align4D 框架,通过对象距离对齐、运动-几何联合对齐与异步优化,实现任意模态到一致 4D 内容生成
- Fast Multi-dimensional Refusal Subspaces via RFM-AGOP
利用递归特征机算法高效识别大模型的多维拒绝子空间,速度提升显著且消融效果更优
- Towards Robustness against Typographic Attack with Training-free Concept Localization
通过无训练机制解释定位并干预CLIP中偏重文本的注意力头,显著提升视觉模型抗排版攻击鲁棒性
2026-07-05 12 篇
- ScAle: Attention Head Scaling as a Minimal Adapter for Spatial Reasoning in Vision Language Models
仅用1K可训练标量系数缩放冻结VLM层激活,空间推理准确率相对提升最高134.1%
- PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking
提出解耦式视觉Agent:推理器决定找什么,专用分割工具给出掩码级定位,配合语义区域BFS消灭冗余路径。
- Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?
审计三大代码优化基准,发现运行时波动、评分规则偏差和任务饱和导致代理排名不可靠
- Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine
定义多图隐含毒性(MIIT)问题,构建数据集并训练推理蒸馏模型,在审核中超越商业API
- Trie-based Experiment Plans for Efficient IR Pipeline Experiments
用 trie 数据结构规划级联 IR 管道比较实验,共享重复组件,实验时间减少 26%
- Decision-Aware Training for Sample-Based Generative Models
在能量得分中融入可微决策损失,使生成模型训练直接感知下游决策成本
- Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption
ISPA首次将KV缓存压缩从丢弃转变为实例级参数蒸馏,在视频生成中实现50%缓存缩减且质量无损
- WARP: Weight-Space Analysis for Recovering Training Data Portfolios
仅凭模型权重即可恢复微调时的领域混合比例,无需训练数据或训练轨迹
- Generalization in offline RL: The structure is more important than the amount of pessimism
在上下文MDP中,悲观结构的对称性而非悲观程度,决定了离线RL最优泛化;建议用策略提取一致性增强。
- Visually Grounded Self-Reflection for Vision-Language Models via Reinforcement Learning
通过轨迹前缀掩码与经验回放缓冲区训练视觉语言模型在分布外场景下进行视觉接地的自我反思与修正
- Will Scaling Improve Social Simulation with LLMs?
发现LLM社会模拟在多数任务上随规模改善,但行为偏差校准等任务不随扩展改善
- Self-Gating Attention for Efficient Time Series Forecasting
提出即插即用的自门控注意力,以线性复杂度维持预测性能,避免冗余注意力计算。
2026-07-04 30 篇 ★ 5 深度
- Transferability for General Reasoning: An Automated Curriculum for Multi-Domain RLVR
提出Transfer-Aware Curriculum (TAC),利用梯度投影对齐自动选择能促进跨领域迁移的训练领域
- Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation
在双曲空间中对齐低秩共享语义并正则化残差子空间,提升多模态蒸馏的检索与迁移鲁棒性
- DuoMem: Towards Capable On-Device Memory Agents via Dual-Space Distillation
通过上下文与参数双空间蒸馏,将大模型过程记忆能力迁移至小模型,4B模型成功率从4.3%升至77.9%,速度提升3倍
- InstanceControl: Controllable Complex Image Generation without Instance Labeling
利用视觉语言模型自动建立文本描述与视觉条件间的实例级对应,消除手动标注,实现高保真多实例控制。
- ADAPT: Attention Dynamics Alignment with Preference Tuning for Faithful MLLMs
从文本-图像跨注意力退化中检测并纠正幻觉,结合视觉锚点与偏好对齐,将主流模型幻觉率降低40%–60%
- Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning
提出AMVL框架,通过双向KL散度校准缓解训练-推理不匹配,提升连续潜变量推理稳定性
- Scaling Laws for Grid-Based Approximate Nearest Neighbor Search in High Dimensions
多探针网格在高维下展现维度不变吞吐,索引成本低,冲击图/树方法的主导地位
- Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads
提出写感知的 LOCOS 方法,通过 OV 电路输出投影检测非字面检索头,消融时性能崩溃远快于注意力基线
- Graph-Native Reinforcement Learning Enables Traceable Scientific Hypothesis Generation through Conceptual Recombination
通过图结构与强化学习将推理显式阶段化,实现可解释、可追溯的多步假设生成
- Representation Distribution Matching for One-Step Visual Generation
用修正的MMD、超大批次和平衡编码器组抗投机,将多步扩散模型蒸馏为一步生成器
- From Approximation to Emergence: A Theory of Deep Learning
系统梳理深度学习理论,从经典近似、优化、泛化到现代涌现现象,构建统一研究叙事
- CoPersona: Collaborative Persona Graphs for Robust LLM Personalization
通过构建多面相似度图来借力行为相似的同伴,缓解因用户历史稀疏与偏斜导致的个性化生成冷启动
- When RAG Meets Query Planning: Logical Query Trees for Resolving Exploratory Reasoning Problems
将探索性推理问题建模为逻辑查询树,通过动态规划与成本模型优化多步检索与推理
- When to Repair a Graph ANN Index: Navigability-Signal-Triggered Local Repair Protects Tail Recall Under Bursty Churn
用廉价探针召回信号触发图ANN局部修复,在固定预算下大幅提升尾部召回,避免盲目周期性修复
- IntentTune: Using user demand and personalization to resolve "unknown" query intents for e-commerce search
通过融合用户历史查询等行为信号,用LLM推断模糊查询的性别、年龄、尺寸等意图,显著优于仅用总体需求或静态画像
- ESC: Emotional Self-Correction for Reliable Vision-Language Models
发现情感信号可零训练激活VLM自我反思,提出外部验证+情感提示的免训练自纠框架ESC
- Program-as-Weights: A Programming Paradigm for Fuzzy Functions
用 4B 编译器将模糊任务规格编译成小 LoRA 程序,0.6B 解释器执行可超 32B 模型提示且省 50× 内存
- Bi-NAS: Towards Effective and Personalized Explanation for Recommender Systems via Bi-Level Neural Architecture Search
通过双层NAS同时优化注意力与特征交互,并集成LLM生成个性化推荐解释,提升准确性与解释质量
- Optimizing Visual Generative Models via Distribution-wise Rewards
用分布级奖励替代逐样本奖励以缓解奖励黑客和模式崩塌,并提子集替换策略与RL优化模型合并系数
- What Survives Into Context: A Diagnostic for Budget-Constrained Multi-Hop RAG and When Submodular Evidence Packing Improves It
提出 answer-in-context 诊断,并揭示子模证据打包仅在弱 reader、多跳互补结构下有效
- From Answer Generators to Reasoning Facilitators: Designing AI Tutors for Mathematical Reasoning in High-Stakes Environments
发现学生抗拒纯苏格拉底式对话,将‘答案优先’捷径重新用作诊断检查点,提出推理中心化产品循环
- ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning
通过递归选择与问题相关的上下文证据并重放,无需训练即提升LLM长上下文推理的证据利用率
- Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning
EADP 用熵过滤文本噪声并将令牌选择建模为带空间先验的次模最大化,在严格预算下保持细粒度视觉线索
- Planning over Matrix-Factorization MDPs for Candidate Generation
在固定MF嵌入上增加闭式秩一更新的前瞻规划,使检索列表感知用户状态变化
- HNSW with Accuracy Guarantees Using Graph Spanners -- A Technical Report
通过Certify-then-Rectify框架,动态认证HNSW搜索并利用spanner理论提供最坏情况正确性保证
- Bringing Agentic Search to Earth Observation Data Discovery
利用论文-数据集引用图构建超大评估集,并通过 NN-SSC 域修正+BM25 融合及 Agentic 工具调用将检索精确率提升超 5 倍
- When Do LLM Personas Support Visualization Design? A Cross-Model Study of Color Assignment and Chart Choice
评估 LLM 人格模拟在可视化设计中的稳定性,发现模型依赖性强,任务上下文比人格更能决定选择
- OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers
在归一化旋转基上量化,用固定码本适应所有时间步和模态,无需数据重校正,将 DiT PTQ 推进到 W2A4。
- Reasoning effort, not tool access, buys first-try reliability in agentic code generation: an observational study
提升推理努力(xHigh)使首次完美运行率从28%跃至89%,而测试工具未提高功能得分
- Evaluating Chunking Strategies for Retrieval-Augmented Generation on Academic Texts
在结构化学术长文档上,聚类 semantic chunking 的检索与答案质量未能超越固定大小和递归分块
2026-07-03 30 篇 ★ 4 深度
- Building to the Test: Coding Agents Deliver What You Check, Not What You Requested
发现编码代理会为通过测试而交付残缺库,揭示基准评测的构造效度缺陷与代理验证自我意识缺失
- PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception
提出基于量规的多模态评估,用门控评分揭示模型在密集信息中的可靠性差距,显著提升人类对齐度
- When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search
提出动态歧义传播的交互式搜索基准 DiscoBench,揭示当前 LLM 搜索智能体主动澄清与歧义检测分离的短板。
- When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling
揭示测试时缩放中盲目增加采样次数无法持续提升答案选择准确率,提出模态上限与相关性上限,并给出有效样本数作为停止信号。
- Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexity
面向大规模生产的 LLM 系列,通过多模态、Agent 和长尾知识优化,以极低成本实现国际前沿水平的综合性能
- ELDR: Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving
利用预填充专家激活模式路由请求,使解码 worker 加载更少的不同专家,降低 TPOT 5.9-13.9%
- Autonomous Scientific Discovery via Iterative Meta-Reflection
提出 DiscoPER 框架,让 LLM 通过二阶元反思机制自主迭代发现科学规律,在生态基准上恢复 89% 已知模式
- AgenticDataBench: A Comprehensive Benchmark for Data Agents
覆盖15个垂直领域,基于细粒度技能定义实现数据代理的全面评估与任务生成
- AgenticSTS: A Bounded-Memory Testbed for Long-Horizon LLM Agents
用类型化检索组装提示替代累积上下文,保持内存有界并支持单层消融分析
- From SRA to Self-Flow: Data Augmentation or Self-Supervision?
证明Self-Flow的改进主要来自双重时间步的数据增强,而非跨噪声token的自监督交互
- PACE: A Proxy for Agentic Capability Evaluation
从非 Agent 原子评估中选取少例子集构建回归代理,预测 Agent 基准得分,成本低于 1% 且 MAE < 4%
- How to Allocate Your Tokens? Scaling Laws with Training Steps and Batch Size
提出三项式缩放律,显式分离训练步数和批量大小,用更少实验恢复最优批量并推导次优批量缩放律
- SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Use
提出自演化量规框架,从技能选择、遵循、组合与反思四个维度诊断并提升 Agent 在含干扰项库中的技能使用能力
- Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI
CLI 编码代理的采纳通过社交网络蔓延,活跃工程师更易保留,采纳后 PR 合并量提升 24%
- Denser neq Better: Limits of On-Policy Self-Distillation for Continual Post-Training
同策略自蒸馏在持续后训练中会加剧遗忘甚至崩溃,而GRPO等保守RL方法更稳健
- Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation
在LoRA的秩维度上施加随机掩码实现变分贝叶斯稀疏化,高效校准LLM推理置信度
- CheckRLM: Effective Knowledge-Thought Coherence Checking in Retrieval-Augmented Reasoning
提出 CheckRLM 框架,在推理过程中实时提取事实声明并利用外部知识进行错误检测与最小代价修正,显著缓解长链条推理的错误累积。
- What LLM Agents Say When No One Is Watching: Social Structure and Latent Objective Emergence in Multi-Agent Debates
社交压力使LLM代理公开言论大幅偏离私下真实想法,分歧从3%升至40%
- DecompRL: Solving Harder Problems by Learning Modular Code Generation
将难题分解为独立子函数,训出可组合的模块化代码,用 CPU 组合爆炸替代 GPU 重采样
- DemoPSD: Disagreement-Modulated Policy Self-Distillation
通过自适应混合教师与学生分布的反向KL重心目标,缓解特权信息泄露并保持探索能力
- EvoPolicyGym: Evaluating Autonomous Policy Evolution in Interactive Environments
提出自主策略进化评测框架,在固定交互预算下诊断Agent迭代改进策略的过程与机制
- HERMES: A Multi-Granularity Labeling Substrate for Pre-training Data Mixtures
提出一种基于残差矢量量化的多粒度数据标注框架,使预训练数据混合从固定标签转变为可重用粒度层次导航。
- Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation
通过神经元激活筛选无标注数据和构造上下文,实现无监督LLM自蒸馏,提升领域性能且保持泛化
- Neuron-Aware Active Few-Shot Learning for LLMs
通过神经元激活模式替代输出层信号,同时考虑多样性和易幻觉样本,更有效地挑选少样本标注数据
- Unlocking Speech-Text Compositional Powers: Instruction-Following Speech Language Models without Instruction Tuning
仅通过一次语音预训练后与文本指令微调向量权重相加,零语音指令数据实现指令遵循语音模型
- LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning
首个提供参数级定位真值的 LLM 遗忘基准,揭示现有方法定位不准且易受攻击,精准定位可大幅提升遗忘鲁棒性。
- Online Safety Monitoring for LLMs
简单的阈值监控结合风险控制校准,在线安全检测性能媲美复杂序贯检验方法
- Object-centric LeJEPA
用现成 SAM 对象掩码代替场景级对齐,搭配实例分离损失,大幅提升小数据下的视觉表示质量
- SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces
通过合约引导的蒙特卡洛树搜索在无执行环境下模糊测试技能组合,发现隐式意图
- WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs
仅用公开元数据与规格,无需硬件即可预测LLM在未见GPU上的推理功耗和延迟,泛化良好。
2026-07-02 30 篇 ★ 8 深度
- Managing Procedural Memory in LLM Agents: Control, Adaptation, and Evaluation
提出AFTER基准,揭示程序性技能从多样化多模型轨迹中演化可实现73.1%跨模型测试准确率
- SkillHone: A Harness for Continual Agent Skill Evolution Through Persistent Decision History
通过持久化决策历史与角色分离子代理实现Agent技能的持续进化,超越商业deep-research agent
- Hierarchical Experimentalist Agents
LLM通过主动实验动态学习可复用技能库,在未见物理任务中成功率从2%提升至77%
- AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation
提出统一音视频分词器 AVTok,用双流 Transformer 将音视频对编码为共享码本的紧凑一维 token 序列
- Little Brains, Big Feats: Exploring Compact Language Models
系统评估小型语言模型在 RAG 生成器的表现,证明其可在无 GPU 的设备端合理时间运行
- When LLMs Read Tables Carelessly: Measuring and Reducing Data Referencing Errors
首次系统评估LLM表格推理中的数据引用错误,通过critic模型检测并过滤错误,答案准确率提升最高12.0%
- DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation
将数据构建建模为反馈驱动的策略演化,利用拒绝样本的失败信号迭代改进,显著提升文本图像生成质量
- Multi-Block Diffusion Language Models
通过多块教师强制训练和块缓冲解码,将块扩散语言模型扩展至多块并行生成,实现近两倍加速且精度不降
- GEAR: Guided End-to-End AutoRegression for Image Synthesis
通过双路读出实现 VQ tokenizer 与 AR 生成器端到端联合训练,加速收敛并提升表示对齐
- The Organizational Behavior of Agentic AI: Collective Intelligence in Human-Agent Workflows
将智能体集体视为部分组织类比,提出上下文交易成本机制,证明共享状态与自适应形式优于模仿人类团队的结构
- CausalMix: Data Mixture as Causal Inference for Language Model Training
将数据混合优化转化为因果推断问题,利用CATE从小规模实验外推到大规模模型与数据
- Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning
提出两阶段框架显式分离视觉感知与推理,结合角色感知的交替强化学习,仅用答案监督提升细粒度推理
- GRPO, Dr. GRPO, and DAPO Are Three Operations on One Number: The Group-Standard-Deviation Identity
三种 RLVR 训练技巧本质上是对同一量(组奖励标准差)的乘、除、过滤操作,且更新量正好等于该标准差
- VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
提出软查询精炼(SQR)在连续潜在空间细化搜索查询,通过强化学习联合优化视频检索与细粒度推理
- The State-Prediction Separation Hypothesis
分离 Transformer 中的状态存储和下一 token 预测功能,显著提升语言模型预训练效率和下游表现。
- AGE: Adaptive-masking for Graph Embedding in Graph Retrieval-Augmented Generation
提出自适应掩码图嵌入AGE,通过可学习节点采样器避开关键节点对齐图与文本特征,显著提升GraphRAG问答准确率。
- AutoMem: Automated Learning of Memory as a Cognitive Skill
通过双循环自动优化记忆结构与训练记忆熟练度,将记忆管理变为可学习技能,在长程游戏中实现2-4倍性能提升
- Multi-Turn Agentic Scientific Literature Search via Workflow Induction
PaperPilot将多轮文献搜索构建为可执行、可编辑的DAG工作流,结合用户反馈实现高效可控的搜索对齐
- Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval
提出一种在线聚类的硬负采样框架,利用 LLM 生成 item 语义簇并实时抽取簇内 hard negative,显著提升召回并缓解流行度偏差
- Diffusion-GR2: Diffusion Generative Reasoning Re-ranker
通过转换微调、在线蒸馏与强化学习三阶段方法,将自回归推理重排器转为块扩散模型,在 Amazon Beauty 上获得 2.4-3.5 倍吞吐提升且精度几乎无损。
- $\text{Log}_\text{b}$Quant: Quantizing Language Models in Logarithmic Space
提出可调基的对数量化方法,在4-bit下性能优于非对称线性量化,适合消费级GPU
- MemSyco-Bench: Benchmarking Sycophancy in Agent Memory
首个系统评估 LLM Agent 长期记忆引发过度迎合的基准,揭示记忆常损害推理准确性
- QuasiMoTTo: Quasi-Monte Carlo Test-Time Scaling
用准蒙特卡洛相关采样替代独立采样,推理与RL训练中样本效率提升25-50%
- RACORN-1: Adaptive Recall-Preserving Speedup for Low-Selectivity Filtered Vector Search
通过自适应搜索回退和精确回退修复ACORN-1在极低选择率下的召回崩溃,延迟降低9-26倍
- As It Was: Aligning LLM Search Evaluation with Historical User Preferences
提出行为接地(QRI卡片)LLM法官,用极简的去偏交互摘要提升搜索评估与用户偏好的一致性
- Theoria: Rewrite-Acceptability Verification over Informal Reasoning States
将LLM推理改写为显式状态转换链,强制每一步必须有可审计的理据,暴露隐藏前提与编造引用
- Message Passing Enables Efficient Reasoning
提出 MPLM 框架,通过持久线程间的点对点消息传递和抢占机制,实现远优于串行 / Fork-Join 的推理扩展效率
- Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training
LLM的RL后训练增益高度集中于中间少数层,单层训练即可恢复甚至超越全参数训练效果
- Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use
发现静态训练的工具使用智能体在开放环境分布偏移下性能脆弱,并提出扰动增强微调策略增强鲁棒性
- ZO-Act: Efficient Zeroth-Order Fine-Tuning via One-Shot Activation-Informed Low-Rank Subspaces
利用激活矩阵低秩基约束零阶优化扰动,大幅降低梯度估计方差,实现高效LLM微调
2026-07-01 30 篇 ★ 8 深度
- TheoremGraph: Bridging Formal and Informal Mathematics
构建统一语句级依赖图,连接非形式化数学文献与形式化库,发布提取工具与匹配数据集。
- Delayed Verification Destabilizes Multi-Agent LLM Belief: Instability Thresholds and Optimal Corrector Placement
揭示多智能体LLM中验证延迟引发信念振荡的阈值,并给出贪心最优纠错器放置策略
- ReFreeKV: Towards Threshold-Free KV Cache Compression
提出首个无阈值 KV 缓存压缩方法,自适应分配预算,无需预设阈值即可保持全缓存性能
- A Gravitational Interpretation of Fine-Tuning Reversion
用历史训练流形的“引力”解释微调后行为回归,通过阻断回归方向有效抑制有害性恢复
- ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval
Full fine-tuning + LwF 蒸馏 + WISE-FT 权值插值,在时尚图文检索中同时击败 LoRA、更大骨干和外部数据
- Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks
将进化搜索轨迹转为训练数据,让LLM学会跨任务的迭代进化改进能力
- Agentic Abstention: Do Agents Know When to Stop Instead of Act?
研究LLM智能体在任务不可行时的弃权决策,揭示及时弃权是主要瓶颈,并提出用少量交互轨迹蒸馏停止规则以显著提升弃权效率和成功率。
- DOPD: Dual On-policy Distillation
提出优势感知双蒸馏,缓解特权信息导致的“特权幻觉”,动态路由教师与学生的token级监督
- Orca: The World is in Your Mind
以Next-State-Prediction为核心,通过无意识与有意识学习统一世界潜在空间,在下游多模态任务中展现强迁移能力
- Metadata, Structure, or Strategy? A Decomposition of RAG Context Enrichment
控制实验揭示大多数RAG上下文增强反而降低准确率,模型-上下文对齐比元数据堆砌更重要
- SWE-Together: Evaluating Coding Agents in Interactive User Sessions
从真实用户会话构建多轮编程基准,用反应式模拟器重放交互,同时衡量代码正确性和所需干预次数。
- One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding
单次前向内部缩放桥接跨层证据,超越需两次前向的ZoomIn,同时降延迟降计算量
- ARMOR: Adaptive Retriever Optimization for Low-Resource Telecom Question Answering
冻结生成器,仅微调查询编码器,联合 RAG 似然与 InfoNCE 并学习各自温度,提升低资源 RAG 效果
- BlockPilot: Instance-Adaptive Policy Learning for Diffusion-based Speculative Decoding
提出从预填充表示学习预测最优块大小的策略,突破固定块限制,提升扩散推测解码效率
- Efficient Retrieval-Augmented Generation via Token Co-occurrence Graphs
用 token 滑动窗口共现构造 KG 取代 LLM 抽取,实现多跳推理 RAG 的索引与推理开销大幅降低
- AutoTrainess: Teaching Language Models to Improve Language Models Autonomously
提出训练专用智能体-计算机接口(AutoTrainHub),将人类后训练经验编码为工作流,使LLM agent在PostTrainBench上显著超越CLI-only基线
- Theory of Mind and Persuasion Beyond Conversation: Assessing the Capacity of LLMs to Induce Belief States via Planning and Action
提出非对话规划心智理论(NCP-ToM)评估框架,GPT-5在约80%任务中成功诱导信念,超越人类
- CoMet: Context and Multiplicity Decomposition for Multimodal Uncertainty Estimation
将多模态不确定性分解为上下文相关项与多重性相关项,用轻量级后置模块高效估计,无需重复生成
- ERA: Entropy-Guided Visual Token Pruning with Rectified Attention for Efficient MLLMs
提出训练免视觉令牌剪枝框架ERA,通过熵引导和注意力矫正解决logit崩塌,实现高效MLLMs
- GenPage: Towards End-to-End Generative Homepage Construction at Netflix
用单个 Transformer 自回归生成整个多行首页,线上核心指标+0.24% 同时延迟降 20%
- GR2 Technical Report
通过语义 ID 中训练、推理链蒸馏和可验证奖励 RL,将 LLM 推理引入重排序并解决工业部署瓶颈
- Reinforcement Learning with Metacognitive Feedback Elicits Faithful Uncertainty Expression in LLMs
提出 RLMF 范式,以模型自我评判质量作为奖励来优化偏好排序,显著提升 LLM 的不确定度校准与边界认知能力。
- Scalable Behaviour Cloning on Browser Using via Skill Distillation
将用户浏览器交互轨迹蒸馏为自然语言技能并组织成技能图,让Agent直接复用决策先验
- Generative Skill Composition for LLM Agents
将技能组合建模为任务条件序列预测,用小型解码器联合决定技能子集、数量和顺序,兼顾精度与效率
- QVal: Cheaply Evaluating Dense Supervision Signals for Long-Horizon LLM Agents
提出训练免费评估平台QVAL,通过Q对齐衡量密集监督信号与参考价值排序的一致性,发现简单直接提示优于大多数专用方法
- Geometry-Preserving Orthonormal Initialization for Low-Rank Adaptation in RLVR
提出正交初始化 LoRA 稳定 RLVR 训练并超越标准 LoRA,解释 SVD 初始化在该场景失败原因
- ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shopping
通过语义ID实现模型原生的商品空间操作,将意图理解、执行规划和物品执行统一于单个基础模型中,减少代理协调中的接口损失
- TRIAGE: Role-Typed Credit Assignment for Agentic Reinforcement Learning
用角色标签(进展/探索/倒退)修正结果奖励,降低策略梯度方差,提升成功率与效率
- One Retrieval to Cover Them All: Co-occurrence-Aware Knowledge Base Reorganization for Session-Level RAG
通过共现聚类重组知识库,单次检索会话覆盖率从41%提升至58%,同时压缩KB至20%
- Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers
首次在3B规模用循环Transformer+并行监督弥合隐式与显式思维链性能差距,并降低推理延迟2.5-6.9倍
2026-06-30 30 篇 ★ 10 深度
- Thinking While Speaking: Inference-Time Knowledge Transfer for Responsive and Intelligent Conversational Voice Agents
提出对话填充技术,用小模型即时生成响应并流式融合大模型知识,实现毫秒级首响应且精度接近前沿模型。
- How Much Static Structure Do Code Agents Need? A Study of Deterministic Anchoring
将轻量级静态调用/继承拓扑作为确定性锚点注入文本,使grep-first代码Agent的导航更可预测,Func@5提升2.2pp,方差减半
- Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving
两阶段级联:先聚类查询并分配最经济的模型,再通过质量估计升级低质量输出,仅用正确性标签实现成本-准确率优化。
- GBC: Gradient-Based Connections for Optimizing Multi-Agent Systems
将多智能体系统建模为计算图,利用梯度连接权重实现token级影响量化,精准定位错误并优化提示。
- AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering
无需训练、骨干无关的自适应RAG框架,用三信号置信度控制检索深度,实现高低置信答案准确率57.6% vs 0%的分离
- Multi-Agent Routing as Set-Valued Prediction: A WildChat Benchmark and Cost-Aware Evaluation
将多智能体路由建模为集合预测问题,构建基准并引入成本感知评估协议,证明监督路由显著优于零样本 LLM
- Human-in-the-Loop Nugget Annotation for Accountable LLM-as-a-Judge Evaluations
提出人定义信息金块、LLM 匹配系统输出的分工,消除评估锚定偏差并保持人类监督
- OSWorld2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
提出108个长周期真实工作流基准,暴露前沿智能体在约束追踪、流式交互与隐含状态推理上的严重不足
- PolicyGuard: A Dialogue-Grounded Sub-Agent Verifier for Policy Adherence in LLM Agents
提出对话级子代理验证器,依据策略推理并给出可操作反馈,大幅提升代理策略遵循度。
- Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning
通过混合专家架构实现单模型内部动态辩论,解耦角色与流程路由,推理性能超越多智体外辩论,延迟降 3.7 倍,Token 省 87%
- Covering the Unseen: Information Demand Coverage Optimization for Retrieval-Augmented Generation
将RAG上下文选择建模为信息需求覆盖优化,通过子查询和Sinkhorn-Wasserstein实现多维需求平衡覆盖
- Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent
构建长轨迹知识-行动图与多教师在线蒸馏,让 35B MoE 智能体在科学、工程、搜索等长程任务上超越万亿参数模型
- TACO: Tool-Augmented Credit Optimization for Agentic Tool Use
用差分答案探测奖励和结果门控路由,在不依赖外部评判模型下精准分配工具调用的信用,显著提高 Agent 的工具使用效率与准确率
- Grounding LLM Reasoning under Incomplete Graph Evidence
证明不完整图谱下硬约束无法同时保证拒假和保真,提出KL正则化软接地框架并给出稳定性边界
- C$^{2}$R: Cross-sample Consistency Regularization Mitigates Feature Splitting and Absorption in Sparse Autoencoders
通过惩罚方向相似潜变量的共激活强制一致表示,缓解特征分裂与吸收,同时保持重构保真度
- Diagnosing and Mitigating Context Rot in Long-horizon Search
揭示长上下文导致LLM放弃回答的现象,提出上下文管理与拒绝采样两种缓解策略
- From Extraction to Navigation: Progressive Retrieval with Indirectly Infinite Depth
将推荐召回建模为跨请求状态演化的图导航过程,突破单次查询的深度限制,缓解搜索漂移
- Do Recommendation Algorithms Work When Users Are LLM Agents? A Case Study on Moltbook
在AI智能体社交平台上,推荐因缺乏用户偏好而退化为结构匹配,简单方法胜过个性化模型
- MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
提出多教师同策略蒸馏(MOPD),将领域RL教师模型在学生自身rollout上蒸馏,避免曝光偏差并集成多种能力
- HSAP: A Hierachical Sequence-aware Parallelism for Hybrid-Context Generative Models
提出分层序列感知并行框架HSAP,解决混合上下文打包序列的因果注意力跨污染问题,性能优于现有方法
- Know Before You Fetch: Calibrated Retrieval-Budget Allocation for Retrieval-Augmented Generation
为 RAG 提出校准概率接口,依置信度分配检索预算(闭卷/紧凑/完整/弃答),实现延迟与准确率权衡
- Mandol: An Agglomerative Agent Memory System for Long-Term Conversations
通过统一层次记忆模型与凝聚式数据结构,将碎片化存储融合为单一内存原生架构,在长期对话基准上达到最优准确率与最低延迟
- Morphing into Hybrid Attention Models
提出FlashMorph,通过联合优化层门控自动选择全注意力层,构建高效长上下文混合模型
- POEM: Partial-Order Enhanced Real-Time Sequential Modeling for Recommendation
用上一次请求的多目标排序分数构造部分有序输入序列,实现请求级实时用户表征学习,在线 A/B 观看时长分别提升 0.249% 和 0.213%
- REAR: Test-time Preference Realignment through Reward Decomposition
提出奖励分解方法 REAR,在测试时无需训练即可重对齐 LLM 至多样化用户偏好。
- When Is a Draft Accepted? A Theory of Acceptance in Speculative Decoding
为贪婪与放松接受下的投机解码提供基于 KL 散度的接受证书,覆盖树形解码
- One-Step Gradient Delay is Not a Barrier for Large-Scale Asynchronous Pipeline Parallel LLM Pretraining
证明异步流水线并行中的一步延迟下优化器选择决定稳定性,Muon比AdamW鲁棒,结合误差反馈校正可匹敌同步训练
- Diagnosing and Mitigating Retrieval Bottlenecks in LLM-Based Cold-Start Recommendation
冷启动推荐性能瓶颈在检索覆盖而非LLM重排序能力,学习多路融合LHF部分缓解但仍需轻量排序器利用信号
- Field Order Should Not Matter: Permutation-Invariant Embedding Model Fine-Tuning for Structured Metadata Retrieval
用随机字段顺序与丢弃微调编码器,将顺序敏感惩罚从 7.4 nDCG 降至 0.2
- Self-Evolving World Models for LLM Agent Planning
提出 WorldEvolver:部署时通过记忆修订增强世界模型预测与规划,无需更新参数
2026-06-29 30 篇 ★ 6 深度
- Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs
提出四条表征公理并审计发现现有LLM的潜在思维表征均无法同时满足,显露出结构性缺陷
- ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
提出统一视觉语言模型 ABACUS,无需基准特定训练即可在多种计数任务和计数忠实图像生成上取得 SOTA
- Running the Gauntlet: Re-evaluating the Capabilities of Agents Beyond Familiar Environments
提出 GauntletBench 基准,揭示当前最佳 Agent 在时间感知/图形理解/3D 推理任务上仅 19.1% 成功率,远低于人类 80%+。
- DanceOPD: On-Policy Generative Field Distillation
提出一种在线策略生成场蒸馏框架,通过路由和查询学生自身状态来组合冲突的多能力,提升图像生成中的能力组合效果。
- Ko-WideSearch: A Korean Breadth-Search Benchmark for Exhaustive Set Enumeration by Web Agents
提出韩语广度搜索基准Ko-WideSearch,揭示当前Agent擅长找回实体集合但严重缺失行级属性填充
- Qwen-Image-2.0-RL Technical Report
利用 GRPO 强化学习、复合奖励模型和在线蒸馏,统一提升文本到图像与图像编辑任务的视觉质量与指令遵循能力
- ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering
提出自适应调用图文检索的 Agent,并通过长度与深度归一化的 RL 优化搜索策略
- Decision-Aligned Evaluation of Uncertainty Quantification
提出决策对齐准则与先验加权效用度量,使不确定性评估能真正反映下游决策效用
- NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learning
RL微调会导致流模型速度范数膨胀损害质量,提出训练时hinge惩罚有效抑制并保持奖励
- Tandem Reinforcement Learning with Verifiable Rewards
TRL 让强模型在 RLVR 中与冻结弱模型交替推理,在保持自身能力同时显著提升可读性和交接鲁棒性
- From Bootstrapping to Sequence Modeling: A Unified Generative Framework for Personalized Landing-Page Modeling
提出基于Decision Transformer的GLAN框架,用日级回报引导与分层奖励模型解决信用分配,在线提升DAU+0.158%和LT+0.108%。
- End-to-End Dynamic Sparsity for Resource-Adaptive LLM Inference
通过预算感知的门控网络动态跳过层、剪枝头并缩短推理长度,单模型覆盖完整计算-精度 Pareto 前沿
- Dialogue to Detection: A Multimodal Hybrid NLP Pipeline for Insurance Fraud Detection
合成多模态框架融合语音与文本,用规则风险评分检测叙事复用与声音重复以增强可解释欺诈检测
- SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation
提出 SHIFT,用可学习门控模块替代神经元编辑,自适应调节激活,以低于 0.01% 参数解决 RAG 知识冲突
- JD Oxygen AI Item Center (Oxygen AIIC) V1: An Industrial-Scale LLM/VLM-Centric Solution for Item Understanding, Management, and Applications
用LLM/VLM构建百万级本体与S2D识别架构,实现高精度、高吞吐的商品知识生产
- An LLM-Powered Semantic Alignment Framework for Journal Recommendation
用 LLM 将稿件内容与期刊范围进行语义匹配,实现免训练的零样本期刊推荐
- Mechanism-Driven Monitors for Preemptive Detection of LLM Training Instability
从注意力谱熵和MoE路由器内部信号提前数千步预警训练崩溃
- KG2Cypher: Data-Centric Pipeline for Building Enterprise Text-to-Cypher Systems
利用图谱事实反向生成训练数据,结合候选感知SFT与LoRA高效微调,大幅提升企业级Text-to-Cypher执行准确率
- Fast and Feasible: Permutation-based Constrained Reranking for Revenue Maximization
提出 PermR 排列邻域搜索算法,在 0.05 秒内近似求解收益最大化 ILP,线上收入提升 2%
- Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QA
发现自评估并非总是比生成容易,注意力差异揭示评估忽略上下文与答案。
- Democratic ICAI: Debating Our Way to Steering Principles from Preferences
提出Democratic ICAI,用多角色辩论从偏好对中提取多竞争理由,生成更全面的决策原则
- MultiHashFormer: Hash-based Generative Language Models
用多哈希函数生成唯一 token 签名,实现哈希自回归生成,在保持低参数量的同时超越标准 Transformer
- An Empirical Analysis of Factual Errors in Human-Written Text and its Application
提炼人类文本事实错误分类法,评估 LLM 检测能力,GPT-5.4 仅 52% F1
- Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment
提出 SMMD 损失,用数值距离核与图平滑将对齐预测分布,一致提升 LLM 数值精度
- Listwise Explanation of Embedding-Based Rankings via Semantic Chunk Grouping
提出 ChunkGroupSHAP,用语义块组作为特征单元,适配密集嵌入排名列表的解释粒度
- Position Bias Correction is Insufficient for One-Pass Attention Sorting
去偏单次注意力排序在高偏置模型上可小幅提升,但仍远不及迭代排序,仅弥补 37% 的精度差距
- Output-Space Allocation Costs for Calibration-Guided LLM Compression: An Empirical Study
将压缩分配成本对齐到输出空间可小幅提升零样本准确率,但会损害语言建模困惑度,且效果受压缩比影响。
- VGB for Masked Diffusion Model: Efficient Test-time Scaling for Reward Satisfaction and Sample Editing
将回溯马尔可夫链扩展到掩码扩散模型,通过奖励引导的unmask/remask实现二次复杂度的推理时优化,理论上优于best-of-N
- NLL-Guided Full-Attention Layer Selection for Training-Free Sliding-Window Adaptation
提出用答案标记的负对数似然下降来指导层选择,仅1/4全注意力层即接近1/2的精度
- Intuition-Guided Latent Reasoning for LLM-Based Recommendation
提出 IntuRec,通过 top-K 候选集构建推荐直觉,注入推理起始点,大幅提升 LLM 潜在推荐推理的准确性和效率
2026-06-28 16 篇
- How Post-Training Shapes Biological Reasoning Models
系统分析CPT、SFT、RL对生物推理模型泛化的不同影响,表明ID/OOD权衡取决于阶段组合而非单调提升
- Efficient Adaptive Data Acquisition via Pretrained Belief Representations
提出POLAR,用预训练模型编码信念状态以解耦表示与策略学习,统一高效地解决贝叶斯实验设计、优化与主动学习
- ShutterMuse: Capture-Time Photography Guidance with MLLMs
构建拍摄时机摄影指导基准与统一多模态模型,联合优化构图决策与姿态推荐
- From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models
首次以统一视觉语言视角系统梳理 MLLM 感知范式的五阶段演进,为多模态智能提供路线图
- Statistically Valid Hyperparameter Selection: From Tuning to Guarantees
提出 learn-then-test 框架,将超参数选择转化为多重假设检验,提供有限样本风险控制的形式化保证
- Learning Interpretable Text Signals for Structured Responses
联合非负矩阵分解与二项回归,学习对齐评分的可解释文本主题表示
- Beyond the Hard Budget: Sparsity Regularizers for More Interpretable Top-k Sparse Autoencoders
为Top-k稀疏自编码器引入L1和L1/L2正则化,在不损失重建质量下提升特征单语义性
- DnA: Denoising Attention for Visual Tasks
通过正负查询分离与子空间排斥设计,消除softmax注意力中的噪声模式,提升ViT/B等视觉模型判别力。
- HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models
构建首个多层次有害视频诊断基准并配套边界感知检索方法,将LVLM理解能力提升至84.4%
- A Process Harness for Uplifting Legacy Workflows to Agentic BPM: Design and Realization in CUGA FLO
提出流程支架在确定性工作流引擎上附加策略治理的智能体层, 实现推理与适应而不替换引擎
- NuclearQAv2: A Structured Benchmark for Evaluating Domain-Science Competence in Large Language Models
提出混合流水线构建核工程QA基准,揭示大模型在定量推理与概念理解上的短板
- Bridging Talk and Thought: Understanding Dialogue Dynamics Across Collaborative Problem-Solving Contexts
提出双层对话编码框架,整合认知与非认知维度及元认知调节,揭示元认知是深层协作的关键区分器
- ReaORE: Reasoning-Guided Progressive Open Relation Extraction Empowered by Large Reasoning Models
提出由粗到细的渐进式推理框架,利用大推理模型先过滤再比较预测,提升开放关系抽取对易混淆关系的区分度。
- TMP: Tree-structured Mixed-policy Pruning for Large-scale Image Generation and Editing
首个树结构混合策略剪枝框架,统一 MoE 和 DiT 架构,将 80B 混元图像压缩至 20B(75%),质量损失有限,实现单卡推理
- Graph Neural Networks Applications Across Domains: All Insights You Need
一份跨越12个应用领域的GNN调查,揭示部署关键限制与设计选择真实收益
- Paved with True Intents: Intent-Aware Training Improves LLM Safety Classification Across Training Regimes
将用户意图作为显式中间信号,跨SFT/DPO/蒸馏/RL范式提升安全分类器鲁棒性,GRPO奖励意图保真度达最优
2026-06-27 28 篇 ★ 2 深度
- CoffeeBench: Benchmarking Long-Horizon LLM Agents in Heterogeneous Multi-Agent Economies
构建咖啡供应链多智能体经济模拟,评估 LLM 代理在 90 天内的利润与通信行为,揭示主动交易与 idle-drift 分化
- Discretizing Reward Models
用蒙特卡洛dropout将连续奖励离散化,减少奖励模型的过度敏感性,改善RL策略质量
- UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating
用固定大小记忆槽和边界感知门控实现跨镜头一致性音视频生成,指标领先开源并与闭源持平
- GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agents
在匹配任务条件下,GUI 智能体受限于长视距可靠交互,CLI 智能体瓶颈在于技能覆盖,经验证器增强后 CLI 可反超 GUI
- Mind the Heads: Topological Representation Alignment for Multimodal LLMs
提出头级表示对齐 HeRA,通过拓扑邻居保持提升多模态LLM视觉任务并抑制幻觉
- Hierarchical Partial-Order Models for Ranking
将偏序排名模型扩展到层次结构,建模分组偏好并保持不可比性,优于现有方法。
- V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning
将在线策略蒸馏重新解释为负例无关的stop-gradient对齐,并提出对比证据门控解决轨迹级判别缺失,显著提升细粒度视觉推理效率
- GPUSparse: GPU-Accelerated Learned Sparse Retrieval with Parallel Inverted Indices
通过GPU并行倒排索引与批量scatter-add融合核实现SPLADE精确评分,在MS MARCO上较CPU加速235倍
- JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting
JetSpec使用因果并行草稿头一次性生成树形候选,将更大预算转化为更长接受前缀,实现最高9.64倍加速
- Tracing Target Answers in Poisoned Retrieval Corpora via Token Influence Attribution
TRACE利用令牌影响归因轻量检测RAG语料中毒,同时还原攻击者预设的错误答案
- Scoring Is Not Enough: Addressing Gaps in Utility-fairness Trade-offs for Ranking
证明排序中仅靠打分函数无法实现最优效用-公平性权衡,半贪婪后处理可逼近理想前沿
- Lacuna: A Research Map for Machine Learning
用LLM将论文转化为可导航研究地图,在文献检索和深度调查报告任务上超越OpenScholar与GPT-Researcher
- ProvenAI: Provenance-Native Traces of Evidence in Generated Answers
提出三层透明度框架,独立测量答案正确性、引用忠实度与文档影响力,揭示引用-影响差距
- TileMaxSim: IO-Aware GPU MaxSim Scoring with Dimension Tiling and Fused Product Quantization
通过维度分块与融合PQ解压缩,将GPU上MaxSim峰值带宽利用率提升至80.2%,打分吞吐提升220倍
- Information-Aware KV Cache Compression for Long Reasoning
提出熵感知的 KV 缓存压缩框架 InfoKV,结合预测不确定性与注意力得分,提升长推理效率。
- Einstein World Models
提出将视觉时空推演作为LLM推理中间步骤的蓝图,扩展工具调用至视觉思维实验
- Hierarchical Muon: Tiled Newton-Schulz Updates for Efficient Muon Optimization
通过将动量梯度矩阵分块独立应用Newton-Schulz,大幅降低Muon优化器计算量并实现高效GPU并行
- MinGram: A Minimalist Unigram Tokenizer with High Compression and Competitive Morphological Alignment
用 BPE 种子与硬 EM 简化 Unigram 训练,实现更高压缩与形态对齐,下游 LM 训练优于 BPE
- Stochastic Gradient Optimization with Model-Assisted Sampling
将调查抽样中的模型辅助估计引入小批量梯度计算,构造更低方差的梯度估计器,可无缝嵌入现有优化器
- Knowledge-Based Pull Requests: A Trusted Workflow for Agent-Mediated Knowledge Collaboration
提出 KPR 工作流,将外部代码视为知识源,由项目内部可信代理重新生成代码,分离知识接纳与实现合并决策
- The Riddle Riddle: Testing Flexible Reasoning in Large Language Models and Humans
用“谜中谜”范式揭示LLM擅长模式匹配而非灵活推理,在需字面理解时仍过度使用创意策略
- OpenRCA 2.0: From Outcome Labels to Causal Process Supervision
首个带逐步因果标注的根因分析基准,暴露 LLM 智能体“无根基诊断”问题
- Ribbon: Scalable Approximation and Robust Uncertainty Quantification
用影响函数线性化近似狄利克雷加权自举,免去模型重训练,实现可扩展且校准良好的不确定性估计
- Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards
仅用无标签图像,通过内部提问-求解-生成的自洽信号同时提升多模态理解与生成能力的自进化框架
- Forecasting With LLMs: Improved Generalization Through Feature Steering
用稀疏自编码器识别LLM的时间感知特征,通过放大这些特征减少预测中的前瞻偏差
- Explaining Temporal Graph Neural Networks via Feature-induced Information Flow
基于归一化相关性度量(NRM)的模块化分解方法,捕获事件驱动变量的全信息流以解释时序图神经网络
- Ask, Don't Judge: Binary Questions for Interpretable LLM Evaluation and Self-Improvement
将评估准则分解为原子化二进制问题,实现可解释、可诊断且支持迭代提示优化的 LLM 评估框架
- Reinforcement Learning without Ground-Truth Solutions can Improve LLMs
通过排名诱导的可验证奖励框架,在无真值答案的得分任务上训练LLM并泛化至精确解基准
2026-06-26 30 篇 ★ 9 深度
- Forecasting Future Behavior as a Learning Task
训练Behavior Forecaster从推理轨迹直接预测大推理模型的行为,比强LLM更准且成本更低。
- OpenBioRQ: Unsolved Biomedical Research Questions for Agents
首个未解决问题与工具调用结合的生物医学Agent基准,揭示~16%引用错误及高难点上的工具弃用崩溃
- Plans Don't Persist: Why Context Management Is Load Bearing for LLM Agents
发现标准LLM代理将计划存于上下文而非内部状态,计划信号4-12倍衰减,且推理模型存在重推导污染
- Critique of Agent Model
区分“代理式”与“内生式”AI系统,提出GIC架构以实现源于系统内部的真正能动性
- ReNIO: Reweighting Negative Trajectory Importance for LLM On-Policy Distillation
发现错误轨迹在蒸馏中优于正确轨迹,提出用学生-教师概率比加权负轨迹,无需最终答案即可提升推理蒸馏效果
- CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression
输入压缩反而增加成本并损害准确性,输出压缩能省钱但导致语义偏离基线
- Do Thinking Tokens Help with Safety?
推理模型的安全决策在思维链早期即已锁定,首token隐藏状态可高精度预测最终拒绝/合规,现有干预导致过度拒绝
- What Intermediate Layers Know: Detecting Jailbreaks from Entropy Dynamics
利用LLM中间层token预测熵的单调趋势特征,无需训练即可跨模型检测越狱攻击
- The Verification Horizon: No Silver Bullet for Coding Agent Rewards
论证验证信号需兼具可扩展性、忠实性与鲁棒性,四种奖励构建实验指出验证必须与生成器协同演化
- From Clicks to Intent: Cross-Platform Session Embeddings with LLM-Distilled Taxonomy for Financial Services Recommendations
自监督Transformer编码多模态点击流生成会话嵌入,并蒸馏LLM意图分类器,提升跨平台推荐与可解释性
- OPID: On-Policy Skill Distillation for Agentic Reinforcement Learning
从在策略轨迹中提取分层后见技能并蒸馏回政策,为多步智能体提供稠密信号,无需外部技能库
- Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation
提出统一Agent框架,通过规划、推理、搜索、记忆逐步补全缺失上下文,解决T2I模型在真实请求中性能不足的问题
- ViQ: Text-Aligned Visual Quantized Representations at Any Resolution
通过文本对齐预训练与头量化,将图像编码为保留细节和语义的离散 token,多模态训练加速 20-70%
- Instruction Bleed: Cross-Module Interference in Prompt-Composed Agentic Systems
形式化提示组合Agent中的行为泄漏(CBL),提出三通道探测协议并确认内容通道产生显著干扰效应
- Confidence-Aware Tool Orchestration for Robust Video Understanding
提出 Robust-TO 框架,通过逐帧可靠性评估与异构工具编排,将视频推理在干净/受损输入下的准确率提升至 56.4%/54.3%,远超基线。
- AgentX: Towards Agent-Driven Self-Iteration of Industrial Recommender Systems
生产部署的多智能体闭环,自主生成、实现、评估并进化推荐实验,实现业务收益的复利增长。
- ConvMemory v3: A Validity Context Layer for Conversational Memory via Target-Conditioned Relation Verification
在对话记忆检索后增加目标条件双证据门控,检测记忆更新/失效,将当前状态查询命中率升至95.7%
- Attributed, But Not Incremental: Cannibalization-Corrected Attribution for Large-Scale Advertising
以增量实验为因果锚点,将稀疏实验信号转化为每日归因修正,大幅消除付费广告归因中的蚕食偏差
- When are likely answers right? On Sequence Probability and Correctness in LLMs
量化LLM解码中序列概率与正确性的对齐关系,发现仅在固定数据集内概率可预测正确性,调参或换方法无效
- TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference
提出任务相关性、信息覆盖与语义多样性三原则的免训练剪枝模块 TOPS,可大幅削减视觉 token 且保性能
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
提出心理学引导的CoT与基于互信息的策略优化,抑制奖励黑客,提升角色保真度。
- Designing Reward Signals for Portable Query Generation: A Case Study in Industrial Semantic Job Search
在RL查询生成中,奖励塑造远比优化器选择关键,规则奖励底线可抑制GRPO的奖励黑客行为
- Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning
提出PEEU方法,通过自主环境探索与后见经验构造高层次训练数据,显著提升小型MLLM的规划与跨网站泛化能力
- Joint Learning of Experiential Rules and Policies for Large Language Model Agents
JERP联合更新经验规则池和策略参数,在多步交互任务上超越纯RL基线
- TRUST: Item-Calibrated Interval Evidence for Temporal Session-Based Recommendation
揭示相同时间间隔在不同物品上代表不同兴趣强度,提出物品校准的间隔评分函数,即插即用提升时序会话推荐
- CARVE: Content-Aware Recurrent with Value Efficiency for Chunk-Parallel Linear Attention
通过key轴门控、输出重用与标量值门,一次性消除GDN-2内存盲、参数浪费与块并行不兼容三大缺陷。
- NOVA: A Verification-Aware Agent Harness for Architecture Evolution in Industrial Recommender Systems
将模型架构修改视为反馈驱动的搜索,用“架构梯度”指导修改并级联验证扼杀静默失败
- SocialPersona: Benchmarking Personalized Profiling and Response with Multimodal Social-Media Context
从真实社交媒体时间线推断用户偏好并用于对话,暴露MLLM细粒度兴趣与时间推理严重不足
- UniFormer: Efficient and Unified Model-Centric Scaling for Industrial Recommendation
统一特征空间与任务空间的联合缩放,实现快手线上观看时长+0.7%~1.1%提升,推理加速48%
- When Does Combining Language Models Help? A Co-Failure Ceiling on Routing, Voting, and Mixture-of-Agents Across 67 Frontier Models
多模型 LLM 增益上限由所有模型全错的 β 率决定,而非平均错误相关性 ρ,67 模型实验发现 β 被低估约 2.5 倍
2026-06-25 30 篇 ★ 11 深度
- Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence
系统归纳多模态代码智能任务,按代码角色与领域分类,提出以验证为中心的未来方向。
- Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do
系统评估多模态思维链推理,揭示其在感知任务中的反效果与视觉推理瓶颈
- VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct
将多模态数学推理的数据扩展解耦为题目难度进化与答案可靠性验证,通过假设检验验证器保证标签质量
- The Hitchhiker's Guide to Agentic AI: From Foundations to Systems
覆盖 LLM 基础、RL 对齐、Agent 训练、RAG、记忆与推理的工程实践手册
- IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation
提出隐式视觉思维链推理,将条件查询分解为潜层结构规划与语义渲染级联,在单次前向中提升生成图像的结构遵循能力。
- Holistic Data Scheduler for LLM Pre-training via Multi-Objective Reinforcement Learning
用多目标强化学习动态混合训练数据,兼顾数据质量、域间影响和模型自身信号
- ReMMD: Realistic Multilingual Multi-Image Agentic Verification for Multimodal Misinformation Detection
提出包含多语言多图基准和持久记忆Agent的验证框架,五类真实性判别最优且成本降低17.5–79.9%
- AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoning
构建跨域大规模真实档案基准,要求智能体在超长上下文中主动探索检索证据,最强模型仅达59.4%准确率
- RoPE-Aware Bit Allocation for KV-Cache Quantization
将RoPE注意力下的KV缓存量化建模为按频率块分配比特的优化问题,用能量分数贪心分配显著减少查询-键logit误差并提升长文本性能
- Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models
首个原生流式、端到端全双工多模态交互模型,单Transformer统一语音/视频/文本,模型侧延迟200ms
- Autodata: An agentic data scientist to create high quality synthetic data
提出代理式数据科学家框架,通过迭代生成、评估与元优化,将推理算力转化为高质量模型训练数据
- Extreme Meta-Classification for Large-Scale Zero-Shot Retrieval
提出 EMMETT 元分类框架,为未见过的物品动态合成分类器,实现零样本检索精度最高 15% 提升,线上 CTR 增益 4.2%
- Improved Large Language Diffusion Models
8B 全双向掩码扩散语言模型从零预训练 12T tokens,大幅超越 LLaDA 并与自回归模型竞争
- Reinforcement Learning for Computer-Use Agents with Autonomous Evaluation
用VLM作为不完美奖励信号的噪声校正强化学习,显著提升GUI代理任务成功率
- TokenMinds: Pretrained User Tokens and Embeddings for User Understanding in Large Recommender Systems
提出双输出编码器-解码器架构,同时生成离散语义ID用户令牌和稠密嵌入,在YouTube排名系统中实现互补增益
- Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models
提出PACE优化器,通过将在线权重拉向指数移动平均,提升最终返回的EMA模型性能
- Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents
从 RL 后训练中直接提取策略与参考策略的对数概率比作为隐式过程奖励,无需训练专用奖励模型。
- BiPACE: Bisimulation-Guided Policy Optimization with Action Counterfactual Estimation for LLM Agents
用双模拟聚类和动作反事实基线修复步进分组RL的状态-动作信用失配,将ALFWorld验证成功率从90.8%提升至97.1%
- BitNet Text Embeddings
将LLM转换为1.58位BitNet嵌入器,配合对比预训练与蒸馏,实现接近全精度性能并支持多精度存储
- Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability
提出ToolBench-X基准,系统注入五种可恢复工具风险,揭示Agent在不可靠环境中可靠性大幅下降,恢复能力不足。
- On-Policy Self-Distillation with Sampled Demonstrations Reduces Output Diversity
揭示在线自蒸馏因条件于采样示例而放大模型偏差,导致输出多样性锐减和 pass@k 性能饱和
- Why Multi-Step Tool-Use Reinforcement Learning Collapses and How Supervisory Signals Fix It
揭示 RL 训练中控制 token 概率畸变导致的结构性崩溃,系统性对比 6 种监督信号并以交错训练实现稳定工具调用
- Is GraphRAG Needed? From Basic RAG to Graph-/Agentic Solutions with Context Optimization
系统对比 9 种 RAG 场景并提出上下文工程方法,token 用量降低 19%-53%,揭示检索-生成差距
- Memory Makes the Difference: Evaluating How Different Memory Roles Shape Conversational Agents
探究不同类型对话记忆对RAG智能体回复的多维影响,提出用户中心评估,证实澄清记忆提升事实准确性与约束意识,不相关记忆有害
- Constraint Tax in Open-Weight LLMs: An Empirical Study of Tool Calling Suppression Under Structured Output Constraints
多个开源模型在工具调用与JSON Schema约束共存时工具调用被完全抑制,根因是语法解码掩码排除工具token,并提出两阶段执行缓解
- Semantic Consistency Policy Optimization for Reinforcement Learning of LLM Agents
提出SCPO,利用成功兄弟轨迹的语义对齐为失败步骤赋予正向信用,缓解群组RL中的信用不一致
- S2-CAR: Segmentation-Supervised Complexity-Adaptive Recommendation
通过连续能量衰减建模意图动态实现无监督分段,结合自适应多兴趣提取与对比辅助训练,提升长序列中间信号利用
- Real-Time Voice AI Hears but Does Not Listen
主流实时语音AI在做决策时忽略声音情绪,仅依赖文字内容,形成“情感智能差距”
- Recommendation as Generation: Unifying Personalized Video Generation and Recommendation at Industrial Scale
提出 RaG 范式,以解耦语义 ID 连接生成式推荐与多智能体视频生成,在快手广告场景实现闭环优化并获得广告收入提升
- AutoRelAnnotator: Calibrated Model Cascades for Cost-Efficient Relevance Evaluation in Sponsored Search
将精度与成本解耦:领域微调提供近20点精度提升,校准级联再节约一半计算量
2026-06-24 30 篇 ★ 9 深度
- SkillHarness: Harnessing Safe Skills for Computer-Use Agents
通过技能边界与选择性重用机制,在动态交互中安全学习技能,不安全率降低57.1%
- AC-ODM: Actor--Critic Online Data Mixing for Sample-Efficient LLM Pretraining
提出轻量Actor-Critic在线调控领域采样权重,最大化梯度建设性干涉,大幅加速预训练并提升下游表现
- Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learning
以简单的数据配方替代复杂奖励工程,仅用结果奖励GRPO即可大幅提升长上下文推理及Agent任务表现
- Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
在GQA中为每个token动态路由仅部分查询头,匹配密集基线且长上下文prefill加速1.7-1.8倍。
- Counsel: A Meta-Evaluation Dataset for Agentic Tasks
构建首个公开的Agent过程批评元评估数据集,量化LLM-as-judge的人类对齐度,最强judge错误位置对齐~88%
- DataClaw0: Agentic Tailoring Multimodal Data from Raw Streams
将数据处理从被动标注提升为可学习的代理式剪裁,用SFT+GRPO训练9B模型,生成高信息密度多模态数据以高效驱动下游任务。
- Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining
系统研究三类训练时增强(token噪声、序列置换、目标偏移)缓解自回归模型在多轮数据训练时的严重过拟合
- Deeper is Not Always Better: Mitigating the Alignment Tax via Confident Layer Decoding
发现LLM最终层会引入对齐扰动,提出训练无关的熵指导层选择解码策略,在推理任务上稳定提升性能且零额外内存开销
- A Verifiable Search Is Not a Learnable Chain-of-Thought
对需回溯搜索的任务,直接蒸馏思维链会失败,模型仅学到表面模板而非搜索能力
- AOHP: An Open-Source OS-Level Agent Harness for Personalized, Efficient and Secure Interaction
将AI代理视为一等OS角色,通过个性化服务组合、高效接口与安全信息流,提升任务完成率21.12%,降低51.55% token成本
- HAKARI-Bench: A Lightweight Benchmark for Comparing Retrieval Architectures and Efficiency Settings under Unified Conditions
构建轻量级检索基准,高保真复现大规模排名,支持快速模型选择与效率权衡分析
- When Agents Commit Too Soon: Diagnosing Premature Commitment in LLM Agents
定义并诊断 Agent 过早承诺:跨运行隐状态收敛预示轨迹僵化,但不反映正确性
- Tmax: A simple recipe for terminal agents
用分类法生成数据 + 仅结果奖励 RL,9B 模型在 Terminal-Bench 2.0 上达 27%,超越更大模型
- Unified Multi-Task Relevance Modeling for E-Commerce: Comparing Task Routing Architectures Across LLMs and Cross-Encoders
首次对比三种任务路由架构在LLM和Cross-Encoder上的效果,发现解码器仅靠文本前缀时若去掉前缀会崩塌,私有层可完全恢复,多任务训练提升低资源任务最高+14%。
- INSPIRE: Intent-aware Neural Sponsored Product Retrieval for E-commerce
通过多LLM共识生成结构化意图标签,蒸馏轻量模型并注入双编码器,显著提升购物搜索中隐式意图的检索质量
- Scaling Dense Retrieval with LLM-Annotated Training Data: Structured Mining and Progressive Curriculum for E-Commerce Sponsored Search
用多通道检索分歧和LLM级联生成240M+结构化样本,配合三阶段课程训练,使稠密检索在Walmart线上NDCG@10提升5.1%
- DREAM: Dense Retrieval Embeddings via Autoregressive Modeling
利用冻结LLM的自回归损失作为监督信号,通过注意力注入相似度分数训练密集检索器,无需对比标注。
- Towards Fast Domain Adaptation and Fine-Grained User Simulation for Evaluating Conversational Recommender Systems
提出自动提示优化与“先想后答”策略的用户模拟器 AdaptSim,实现跨域快速适应和风格可控的对话推荐评估
- Qwen-AgentWorld: Language World Models for General Agents
首个覆盖7个交互域的语言世界模型,通过三阶段训练实现高保真环境仿真,并验证世界建模可提升Agent策略与任务表现
- Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning
通过多智能体异构执行、第三方对比蒸馏与共识验证,将经验学习从自反思循环重构为协作过滤,可靠抑制错误记忆污染
- OpenThoughts-Agent: Data Recipes for Agentic Models
100+消融实验揭示智能体训练数据配方的关键要素,100K数据微调Qwen3-32B后在7个基准上平均准确率44.8%,超越最强开源基线3.9个百分点
- Improving Long-Context Retrieval with Multi-Prefix Embedding
在单次因果前向传播中用EOS分块抽取前缀嵌入,实现细粒度检索且保留跨块上下文
- AI-PAVE-Br: Leveraging Large Language Models for Enhanced Product Attribute Value Extraction through a Golden Set Approach
用精心设计提示词的LLM代替传统NER,在巴西葡语商品属性提取上F1提升约15个百分点
- Paying to Know: Micro-Transaction Markets for Verified Product Information in Agentic E-Commerce
当AI买家可大规模检索时,瓶颈从商品匹配转向获取可信信息,需构建信息微支付市场
- Dialogue to Discovery: Attribute-Aware Preference Elicitation for Conversational Product Search Assistants
D2D通过属性不确定性引导与推荐时机控制,成功率提升22–30%,弃标率降低,成功对话缩短27.5%
- Can Scale Save Us From Plasticity Loss in Large Language Models?
发现LLM塑性损失遵循可预测的亚线性标度律,增大模型仅能延缓而无法根除。
- Privacy-Preserving RAG via Multi-Agent Semantic Rewriting: Achieving Confidentiality Without Compromising Contextual Fidelity
通过多Agent协作语义重写去除检索内容中的隐私,将LLaMA-3-8B信息泄露从144例降至1例,且离线预处理无在线延迟
- MEMPROBE: Probing Long-Term Agent Memory via Hidden User-State Recovery
将 Agent 记忆视为可审计产物,从遗留记忆重建隐藏用户状态,直接量化记忆质量
- Are We Ready For An Agent-Native Memory System?
从数据管理视角分解Agent内存为四模块,量化权衡并揭示局部维护成本效益最优
- Scaling Laws for Task-Specific LLM Distillation
量化了领域特定LLM压缩中数据集大小、压缩比、监督格式的缩放规律,发现思维链监督能恢复剪枝损失的通用知识。
2026-06-23 30 篇 ★ 9 深度
- DailyReport: An Open-ended Benchmark for Evaluating Search Agents on Daily Search Tasks
构造包含150个日常搜索任务与3546条细粒度评分标准的基准,提供可解释的多维评估,揭示现有搜索代理普遍未达用户预期
- FastMix: Fast Data Mixture Optimization via Gradient Descent
将数据混合比例重新参数化为可微损失权重,实现单代理模型高效联合优化
- Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models
为掩码扩散模型引入轻量后训练和免参数历史参考机制,实现原生多轮局部修改与测试时推理缩放
- Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillation
通过修正模型自身的错误轨迹并插入自然语言诊断,将自我蒸馏从分布对齐升级为显式轨迹构造。
- Deep Research in Physical Sciences: A Multi-Agent Framework and Comprehensive Benchmark
提出物理科学深度研究基准PhySciBench,并设计多智能体框架DelveAgent,通过自适应规划、双粒度记忆和分层反思显著提升准确率并降低成本
- OpenRath: Session-Centered Runtime State for Agent Systems
提出 Session 作为一等运行时值,统一多智能体系统的状态、分支与审计
- SproutRAG: Attention-Guided Tree Search with Progressive Embeddings for Long-Document RAG
利用学习到的句子间注意力构建二叉分块树,实现无外部LLM调用的多粒度层次检索,平均信息效率提升6.1%
- World Action Models: A Survey
对具身预测-行动模型给出统一分类与设计权衡,强调“少预测未来、多聚焦控制”
- CalVerT: Augmenting Agents with Calibrated Verifier Telemetry Improves Action and Learning in Knowledge-Intensive Tasks
给智能体状态加入校准自置信和接地验证分数,纠正过度信任参数知识与冗余检索
- EvoEmbedding: Evolvable Representations for Long-Context Retrieval and Agentic Memory
通过FIFO潜在记忆队列实现可进化的上下文感知嵌入,在长上下文检索和Agent记忆任务上大幅超越静态大模型
- PrivacyAlign: Contextual Privacy Alignment for LLM Agents
引入PrivacyAlign数据集和注释条件奖励建模,训练的小型开源Agent更符合人类隐私规范
- The Pitfall of Scaling Up: Uncovering and Mitigating Popularity Bias Amplification in Scaling Transformer-based Recommenders
揭示Transformer序列推荐深度缩放导致谱坍缩放大流行度偏差,提出层级谱正则化方法SPRINT实现准确性与公平的双赢。
- Nous: A Predictive World Model for Long-Term Agent Memory
基于信息论惊喜度和贝叶斯更新,用概率分布代替事实存储,实现Agent记忆的自然遗忘与身份解析。
- PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystems
在1665个工具的零售任务基准上,揭示LLM Agent在检索受限与动态阻塞下长期规划能力的严重退化
- Music Playlist Captioning at Scale with Large Language Models
用 LLM 为推荐播放列表自动生成描述性标题,在不改动推荐算法的情况下提升用户参与度 24.9%
- EnterpriseClawBench: Benchmarking Agents from Real Workplace Sessions
从真实企业Agent日志构建852个可复现任务的基准,揭示评估必须报告多维度指标而非单一得分
- KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking
用编码器-解码器解耦文档/查询计算 + 跨注意力 + 嵌套池化压缩,在保持强排序力的同时大幅降低在线计算量
- Tapered Language Models
在总参数固定下,让 MLP 宽度随层深递减(余弦锥形)可免费提升 Transformer 等模型的困惑度与下游性能
- Self-Compacting Language Model Agents
提出训练无关的自适应上下文压缩方法,通过轻量规则让模型自决定压缩时机,避免固定间隔压缩破坏中间推理
- URecJPQ: Memory-efficient Multimodal Recommendation Models through RecJPQ in Large-Scale Scenarios
用联合乘积量化将用户/物品ID与多模态特征压缩为共享子嵌入拼接,在参数量减少98%+的同时保持推荐精度
- Breaking the Evaluation Paradox: Evaluating High-Entropy Search with Computationally Irreducible Constraints
提出 VERITAS 框架,利用计算不可约约束生成可验证的穷举搜索任务,解决高熵搜索无法完整评估的难题
- Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs
提出IMLogic基准与RootMem框架,构建可复用决策逻辑的根记忆,路由补足语义检索
- Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse
通过低秩条件补丁恢复跨块绑定,使多模态KV缓存可任意位置复用,消除重复编码
- LLM-as-a-Judge for Reliable and Explainable Offline Evaluation in Top-K Recommendation
用语义代理和推理-评分流程替代ID匹配,使LLM法官提供可靠且可解释的离线Top-K评估。
- MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems?
首次系统基准测试多智体场景下的提示优化,揭示其有效条件与敏感性
- CFPO: Counterfactual Policy Optimization for Multimodal Reasoning
通过跨模态反事实增强正则化,强制视觉与文本因果一致性,显著减少多模态推理中的视觉忽略与幻觉漂移
- SPIRAL: Learning to Search and Aggregate
SPIRAL端到端训练语言模型同时进行并行多条推理链采样与聚合,实现推理计算扩展效率大幅提升
- Randomized YaRN Improves Length Generalization for Long-Context Reasoning
结合 YaRN 位置编码、随机位置采样与长度课程,仅用短上下文数据微调即大幅提升 OOD 长上下文推理能力
- SVD-Surgeon: Optimal Singular-Value Surgery for Large Language Model Compression
将OBS框架引入SVD压缩,闭式更新保留奇异值以补偿截断损失,无需重训练
- TailorMind: Towards Preference-Aligned Multimodal Content Generation
链接协同偏好建模与可控多模态生成,实现个性化多模态内容创建
2026-06-22 12 篇
- Selective Synergistic Learning for Video Object-Centric Learning
提出SSync,通过选择性对齐编码器边界与解码器内部信息,避免错误传播并实现线性复杂度视频对象发现
- LegalHalluLens: Typed Hallucination Auditing and Calibrated Multi-Agent Debate for Trustworthy Legal AI
按法律声明类型审计幻觉并引入风险方向指数,通过诊断校准多智能体辩论,减少45%捏造检测
- MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model
首个实时视听自回归世界模型,22B参数单GPU可达47.5 FPS,支持千秒级流式生成与亚秒交互
- GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents
首创多主体共享记忆治理基准,评估效用、访问控制与遗忘,揭示当前智能体在可靠共享记忆上的不足
- Zero-Shot Active Feature Acquisition via LLM-Elicitation
仅从LLM获取判别性统计量,用最大熵闭合构建MRF,实现零样本主动特征获取,性能超越LLM直接决策
- Fisher-Geometric Sharpness and the Implicit Bias of SGD toward Flat Minima
定义重参数化不变的Riemannian sharpness,证明SGD噪声偏向Fisher几何平坦解,并给出泛化界
- Automating SKILL.md Generation for Computer-Using Agents via Interaction Trajectory Mining
轨迹聚类可得到高可读性的技能库,但对策略迁移几乎无帮助,暴露当前方法缺陷
- Apparent Psychological Profiles of Large Language Models are Largely a Measurement Artifact
量化证明LLM心理测评差异81-90%由方向应答偏差驱动,而非真实心理特质
- Efficient and Sound Probabilistic Verification for AI Agents
基于分布鲁棒优化提出概率验证框架,不依赖独立性假设,计算策略违规概率严格上界,安全-效用权衡优于现有方法
- LLM agent safety, multi-turn red-teaming, jailbreak benchmarks, adversarial robustness, safety-critical systems
构建多轮红队基准,揭示LLM代理在自适应攻击下高度脆弱,且模型间漏洞互不重叠。
- Self-Preference Is Weak or Absent in Verifiable Instruction-Following Revision: A Four-Model Test Under Genuine Authorship
在可验证指令修订任务中,模型对自己文本的修正接受度与中立模型无显著差异,自我偏好不明显。
- AURA: Adaptive Uncertainty-aware Refinement for LLM-as-a-Judge Auditing
在有限人工验证下,迭代学习人类一致性信号并优先审查不确定比较,提升LLM评判可靠性
2026-06-21 10 篇
- LooseControlVideo: Directorial Video Control using Spatial Blocking
用有向3D稀疏框实现文本到视频的精确空间编排,显著提升轨迹、遮挡与运动一致性
- Bag of Dims: Training-Free Mechanistic Interpretability via Dimension-Level Sign Patterns
Transformer隐藏状态标准基中维度符号独立编码语义,纯符号匹配即可高AUC检测概念,无需额外旋转或训练。
- Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages
将 LiveCodeBench 扩展到 12 种编程语言,揭示 LLM 跨语言代码生成的过拟合与污染问题
- Human-AI Agent Interaction in a Business Context
通过混合方法识别并评估商业 AI Agent 的 UX 原则与度量标准,为更直观的交互设计奠定基础
- Quantifying and Auditing LLM Evaluation via Positive--Unlabeled Learning
将选择性人工监督下的 LLM 评估建模为正无标签学习,通过部分最优传输几何对齐纠正裁判偏差
- No Two Developers Think Alike: How Problem-Solving Styles and Experience Shape Needs in Conversational Interaction with Copilot
通过有声思维研究识别开发者与编程助手对话的 5 种交互模式和 10 种需求,揭示认知多样性的影响
- A Solver-Free Training Method for Predict-then-Optimize
提出无需求解器的代理损失训练预测模型,用于线性优化决策,在保持决策质量的同时大幅减少训练时间。
- When Global Gating Is Enough: Admission-Time Hubness Control in Anisotropic Vector Retrieval Systems
在文档入库时用全局哨兵查询门控检测并隔离枢纽向量,无需周期性全库重扫,实现高召回低误报。
- On the Redundancy of Timestep Embeddings in Diffusion Models
证明扩散模型可在无显式时间步嵌入下达到最优,输入可隐式推断噪声尺度,实现更高效生成架构
- Analyzing Defensive Misdirection Against Model-Guided Automated Attacks on Agentic AI Systems
提出检测后给出误导性非操作响应,将自动化越狱攻击成功率上界降低两个数量级
2026-06-20 30 篇 ★ 3 深度
- No Resource, No Benchmarks, No Problem? Evaluating and Improving LLMs for Code Generation in No-Resource Languages
针对零资源编程语言,通过权重差异迁移法在基础模型上注入指令跟随能力,实现低成本专用代码模型部署
- Thinking with Visual Grounding
通过在文本思维中插入点/框级视觉定位,显著提升VLM计数和空间推理性能
- Taylor-Calibrate: Principled Initialization for Hybrid Linear Attention Distillation
利用泰勒展开匹配教师注意力统计量,让混合线性注意力学生初始化更好,节省 4.9-9.2 倍训练代价
- Closed-Loop Triplet Synergistic Generation for Long-Form Video
提出闭环视觉-文本-记忆协同框架,迭代纠正多镜头视频中的身份漂移和不一致问题。
- When Does Trajectory-Level Supervision Permit Efficient Offline Reinforcement Learning?
提出 OPAC 算法,证明仅用轨迹级标量标签可实现样本高效离线策略优化,并刻画泛化结果监督的可处理条件
- Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance
通过新型骨干块与自适应多粒度蒸馏,用2%参数实现超10倍推理加速,修复质量媲美10B级工业模型
- Seeing Before Reasoning: Decoupling Perception and Reasoning for Shortcut-Resilient Multimodal On-Policy Self-Distillation
提出 ViGOS,通过先视觉描述后推理并解耦感知与推理教师,防止多模态自蒸馏中基于文本的捷径,提升视觉 grounding。
- LedgerAgent: Structured State for Policy-Adherent Tool-Calling Agents
显式维护任务状态账本,在工具调用前做策略校验,显著减少违规与状态遗忘
- LensKit-Auto
升级框架兼容新版 LensKit,引入 TPE 优化与可视化,提升自动算法选择的工程易用性
- MonaVec: A Training-Free Embedded Vector Search Kernel for Edge and Offline AI Systems
训练无关、确定性的嵌入式向量搜索内核,4位量化达高召回,如SQLite般随处运行
- S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence
将空间推理变为VLM规划的时空证据累积过程,配备层次化工具与双记忆,零样本提升多视图推理并可蒸馏小模型。
- Rethinking Shrinkage Bias in LLM FP4 Pretraining: Geometric Origin, Systemic Impact, and UFP4 Recipe
指出非均匀E2M1格式固有的收缩偏置被RHT放大导致训练不稳定,提出基于均匀E1M2网格与全RHT相结合的UFP4训练配方
- Beyond Uniform Forgetting: A Study of Sequential Direct Preference Optimization Across Preference Settings
顺序DPO的遗忘模式非均匀,取决于目标关系、信号强度与训练顺序,可退化、稳定或正迁移
- Contagion Networks: Evaluator Bias Propagation in Multi-Agent LLM Systems
提出传染网络框架,量化多智能体LLM中评估偏差传播,揭示同模型抑制与委员会多样性降低传染效应
- Generative Engine Optimization at Scale: Measuring Brand Visibility Across AI Search Engines
首次对AI搜索引擎中的品牌可见性进行大规模测量,揭示品牌知名度三层阶梯与引用模式
- Multi-Task Bayesian In-Context Learning
将先验信息表示为上下文数据集前缀,训练Transformer快速适应不同先验的贝叶斯预测推理
- Multi-Agent Transactive Memory
提出MATM框架,使智能体共享交互轨迹以提升任务效果与效率,无需协同训练
- Data Bias Mitigation under Coverage Constraints & The Price of Fairness
在覆盖约束下用整数线性规划优化数据偏差缓解,显式量化公平代价与数据效率的权衡
- Query-aware Routing for Filtered Approximate Nearest Neighbors Search
提出查询感知路由,用轻量回归模型预测各方法的召回,结合离线基准表动态选择最佳召回-QPS权衡的方法
- Off-Policy Evaluation for Missingness-Aware Policies in MDPs with Rewards Missing Not at Random
利用未来状态与桥函数识别MNAR奖励,构建缺失感知的FQE式OPE估计量
- How Transparent is DiffusionGemma?
通过token瓶颈使扩散LLM透明度媲美自回归模型,并揭示扩散特有推理现象
- MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfer
通过面部几何控制、区域特定调制和肤色保持,将人脸识别相似度相对提升60%,肤色差异降低50%,推理仅0.7秒
- MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Management
提出 Context-as-Action,将上下文管理作为一级动作压缩历史,让 8B 模型在长时域移动任务上超越更大规模模型
- MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimization
提出无标注适应框架 MobileForge,通过分层反馈引导的步骤级 GRPO 将开源 MLLM 提升至接近闭源移动 GUI 智能体水平
- Your Mouse and Eyes Secretly Leak Your Preference: LLM Alignment using Implicit Feedback from Users
利用鼠标轨迹与眼动追踪等隐式用户信号,显著提升LLM对齐的奖励模型准确率与DPO优化效果
- ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments
提出 ScholarQuest 基准,系统评估智能体在开放文献环境中的迭代检索能力
- SSD: Spatially Speculative Decoding Accelerates Autoregressive Image Generation
利用2D空间局部性并行预测相邻token,将自回归图像生成加速13.3倍且质量无损
- Stellar: Scalable Multimodal Document Retrieval for Natural Language Queries
通过词法过滤与磁盘驻留延迟交互,将多模态检索的内存和延迟降低1-2个数量级且效果不降。
- Stochastic Linear Contextual Bandits with Bounded Noise: A Set-Membership Approach
利用奖励噪声有界性提出 SME-OFU 算法,将遗憾界从 O(√T) 降至 O(log T)
- Execution-State Capsules: Graph-Bound Execution-State Checkpoint and Restore for Low-Latency, Small-Batch, On-Device Physical-AI Serving
提出图绑定执行状态胶囊,将LLM推理复用从KV片段提升至全状态边界,实现亚毫秒级快照/恢复与27倍TTFT加速
2026-06-19 30 篇 ★ 10 深度
- MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents
首个模拟真实用户数字生活的个性化计算机代理基准,揭示跨应用长链任务的高失败率
- From Trainee to Trainer: LLM-Designed Training Environment for RL with Multi-Agent Reasoning
让当前策略 LLM 分析失败轨迹并自动提议下一阶段训练环境配置,小模型超越大模型
- FAPO: Fully Autonomous Prompt Optimization of Multi-Step LLM Pipelines
让Claude Code自主诊断并优化多步LLM管道,先调提示再改结构,15/18基准胜出,平均+14.1pp
- EfficientRollout: System-Aware Self-Speculative Decoding for RL Rollouts
系统感知自推测解码框架,自适应切换推测解码与草稿长度,将RL rollout延迟降低19.6%且不损失模型质量。
- REVES: REvision and VErification--Augmented Training for Test-Time Scaling
从成功修正轨迹中抽取“接近正确”的中间步骤,构造修订与验证提示进行两阶段交替训练,显著提升多步推理测试时性能
- RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agents
利用GRPO中进度奖励方差作为能力边界检测器,动态合成多轮变体解决静态数据信号耗竭,以约20倍更少数据达到大规模离线合成水平
- The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL
在预训练表示空间训练判别器,以其logit为奖励进行KL正则化RL,无需人类偏好即可大幅提升生成质量
- Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents
揭示聚合排行榜在分布外环境下排名不稳定,提出以预测效度替代平均分评估 Agent 配置
- VCG: A Multimodal Retrieval Framework for E-Commerce Video Feeds under Extreme Cold-Start Conditions
用域适应 CLIP 构建双塔向量检索,绕过交互历史,在线视频深度观看提升 50%
- Denoising Implicit Feedback for Cold-start Recommendation
利用内容相似暖物品为冷物品生成置信度加权的伪标签,并通过不确定性估计自适应修正标签噪声
- ScholarSum: Student-Teacher Abstractive Summarization via Knowledge Graph Reasoning and Reflective Refinement
通过分层知识图谱引导的学生-教师迭代框架,同时提升科学文献摘要的流畅性和忠实性
- Token Factory: Efficiently Integrating Diverse Signals into Large Recommendation Models
把传统稠密/稀疏特征压缩为 soft token,大幅缩短 prompt 并提升训练与推理效率,保持质量
- Think Again or Think Longer? Selective Verification for Budget-Aware Reasoning
SEVRA用门控机制选择性触发验证,在提升准确率的同时大幅削减后生成token开销
- Rescaling MLM-Head for Neural Sparse Retrieval
发现SPLADE训练中MLM-head尺度不匹配导致训练崩溃,提出初始化时简单缩放修正,稳定训练并提升大骨干检索性能
- Marginal Advantage Accumulation for Memory-Driven Agent Self-Evolution
通过差分信号与 EMA 累积跨批次操作级证据,解决离线记忆蒸馏中的信号矛盾问题
- Probe-and-Refine Tuning of Repository Guidance for Coding Agents
通过合成bug探测迭代优化仓库指南,使编码代理解决率提升4.7个百分点以上,增长源于覆盖扩大而非单一补丁精度提升
- Beyond Global Replanning: Hierarchical Recovery for Cross-Device Agent Systems
提出 H-RePlan 分层重规划框架,分离设备局部策略恢复与全局重规划,结合 HeraBench 故障注入基准,大幅提升多设备 Agent 任务完成鲁棒性并降低 token 消耗。
- ELVA: Exploring Ranking-Driven Universal Multimodal Retrieval
用排序驱动强化学习缓解多模态检索模型对比训练中的“粒度盲目”,在复杂查询上提升13.1%
- Toward Calibrated Mixture-of-Experts Under Distribution Shift
证明硬路由 MoE 的专家级校准在分布偏移下仍能保证全局校准,而软路由不成立,并提出对抗重加权提升校准-准确率权衡
- Structuring and Tokenizing Distributed User Interest Context for Generative Recommendation
通过稀疏共现图软聚类提取物品多兴趣原型并转化为连续 token,结合生成式推荐实现工业级全局行为建模
- HydraHead: From Head-Level Functional Heterogeneity to Specialized Attention Hybridization
利用可解释性识别检索关键头,在头维度混合全注意力和线性注意力,以极低训练成本突破长上下文瓶颈
- Connect the Dots: Training LLMs for Long-Lifecycle Agents with Cross-Domain Generalization Via Reinforcement Learning
提出 CoD 框架,用端到端 RL 训练 LLM 在长序列任务中自我更新上下文,实现跨域泛化
- When Does Streaming Tool Use Help? Characterizing Tool-Intent Stabilization in Streaming Retrieval-Augmented Generation
在流式 RAG 中,通过分析工具意图稳定点,量化了可隐藏的延迟比例并揭示了早期意图形成的查询特性
- Closing the Calibration Gap in Semantic Caching
指出语义缓存评估重排名轻校准导致部署性能差,提出缓存感知的校准指标P-CHR AUC与CRR
- UltraQuant: 4-bit KV Caching for Context-Heavy Agents
针对多轮Agent场景设计4位KV缓存压缩,通过非对称K/V处理、Walsh-Hadamard旋转及AMD GPU优化,大幅降低延迟并提升吞吐
- Token-Operations-Oriented Inference Optimization Techniques for Large Models
首次提出四层 token 推理优化架构,系统梳理降本增效的产业技术路径
- PACMS: Submodular Context Selection as a Pluggable Engine for LLM Agents
提出基于设施选址次模函数的上下文选择方法,在保持回忆的同时将LLM Agent端到端QA准确率提升8~12个点
- What Makes Effective Supervision in Latent Chain-of-Thought: An Information-Theoretic Analysis
信息论分析揭示潜在CoT双坍塌,提出轨迹与空间监督,发现生成式重建优于几何压缩,建立信息-性能绑定
- When Lower Privileges Suffice: Investigating Over-Privileged Tool Selection in LLM Agents
揭示LLM代理在工具选择时偏好高权限工具且故障会加剧该倾向,并提出后训练防御以遵循最小权限原则
- SoftSkill: Behavioral Compression for Contextual Adaptation
用可训练软前缀压缩长 Markdown 技能,以 32 个虚拟 Token 替代数百上千 Token,提升 QA 和数学任务准确率。
2026-06-18 30 篇 ★ 9 深度
- Self-Evolving Visual Questioner
让VLM通过自我生成与过滤,逐步产出更困难、更多样化的视觉问题,无需外部监督
- Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion
将检索重塑为 Agent 可调用的 pull 动作以扩展本地工作空间,使 DCI 终端操作仅作用于已拉取文档,平衡大规模语料探索与细粒度证据验证。
- Beyond Scalar Distances: Semantic Attribute Gradients from Frozen MLLMs for Visual Embeddings
将冻结 MLLM 的属性感知预测转化为细粒度梯度,替代传统的类别标量监督,提升细粒度零样本检索
- Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning
提出视觉原生多模态搜索代理,主动关注细粒度视觉细节并动态收集视觉证据,在多模态搜索基准上达到SOTA
- Rethinking the Role of Efficient Attention in Hybrid Architectures
高效注意力影响长文本能力涌现速度,全注意力主导检索,大窗口延迟检索头形成,小窗口+NoPE 有效提升长文本性能
- Text-Vision Co-Instructed Image Editing
融合文本语义与拖拽/点击等视觉指令,实现空间可控且语义保真的图像编辑
- CEO-Bench: Can Agents Play the Long Game?
构建 500 天初创公司经营模拟,考察智能体长期规划、信息获取与自适应能力,多数模型破产,顶尖模型勉强盈利。
- LoopCoder-v2: Only Loop Once for Efficient Test-Time Computation Scaling
并行循环Transformer仅循环两次即达最优,平衡表征增益与位置偏移代价
- Reinforcing Dual-Path Reasoning in Spatial Vision Language Models
提出SR-REAL框架,通过强化学习统一优化纯语言推理与检测-推理双路径,显著提升空间VLM推理能力
- ToolChain-CRC: Conformal Risk Control for Agentic AI Under Retrieval and Tool-Use Drift
将Agent完整轨迹作为校准对象,控制检索与工具使用漂移下的上游风险,避免仅依赖最终答案的风险盲区。
- MCompassRAG: Topic Metadata as a Semantic Compass for Paragraph-Level Retrieval
用话题元数据增强段落嵌入并通过LLM蒸馏训练轻量检索器,实现高效、精确的话题感知检索
- Native Active Perception as Reasoning for Omni-Modal Understanding
提出OmniAgent: 首个将长视频理解建模为POMDP迭代循环的原生全模态代理,通过按需主动感知与Agentic RL实现推理-时长解耦和测试时正拓展
- MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation
提出多智能体系统MODE-RAG,利用变分自由能和注意力动态门控,结合MCTS与logit惩罚来缓解多模态RAG幻觉
- RankGraph-2: Lifecycle Co-Design for Billion-Node Graph Learning in Recommendation
通过图构建-训练-服务三阶段协同设计,在十亿规模图上实现高召回、低延迟检索,服务成本降低83%
- Sumi: Open Uniform Diffusion Language Model from Scratch
首个从头预训练的大规模均匀扩散语言模型,在知识、推理、编码上与同规模自回归模型竞争,常识略弱
- Written by AI, Managed by AI: Semantic Space Control and Index Sickness Elimination Across 391 Consecutive Sessions
发现并解决长周期LLM协作中符号约束过载导致的“索引病”,提出语义活力法则与基线-日志物理分离机制
- Essential Subspace Merging for Multi-Task Learning
利用任务更新的低维本质子空间,通过正交化融合和低秩专家路由实现训练无关的多任务模型合并
- GraphPO: Graph-based Policy Optimization for Reasoning Models
将推理路径建模为有向无环图,合并语义等价状态共享后缀,减少冗余探索并提升 RLVR 效率
- HANSEL: Extracting Breadcrumbs from Web Agent Trajectories for Interactive Verification
从 Web agent 多步操作轨迹中提取关键证据页面,以交互式视图呈现,将验证从被动阅读变为主动探查
- Structured Inference with Large Language Gibbs
用 LLM 的条件分布作 MCMC 转移算子迭代采样结构化变量,避免一次生成顺序偏差
- Decoupling Search from Reasoning: A Vendor-Agnostic Grounding Architecture for LLM Agents
将搜索接地从模型内部移出为可配置的 MCP 网关,在 Prompt 合规、成本、缓存和提供商选择上获得显式控制
- A Technical Taxonomy of LLM Agent Communication Protocols
提出五维度分类法,归纳9种开源LLM Agent协议的核心模式与趋势
- Querit-Reranker: Training Compact Multilingual Rerankers via Efficient Label-Free Distribution Adaptation
通过合成query mining与teacher软标签实现无标注目标适配,结合SLERP合并checkpoint,产出紧凑且强劲的多语言重排序模型
- SAERec: Constructing Fine-grained Interpretable Intents Priors via Sparse Autoencoders for Recommendation
利用稀疏自编码器从评论文本中解耦出可解释意图先验,并融合个性化与公共意图提升序列推荐
- SAGE: Stochastic Prompt Optimization via Agent-Guided Exploration
提出多智能体诊断执行框架 SAGE,通过随机搜索与连续 A/B 测试将提示优化累积为统计显著的次日留存提升
- STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability
基于惊喜分位数识别熵临界令牌并重加权其优势,配合目标熵闭环门控,稳定GRPO训练中的策略熵
- Enhancing Decision-Making with Large Language Models through Multi-Agent Fictitious Play
提出多智能体虚构博弈范式,以博弈均衡迭代求解立场纠缠的决策问题,提升决策质量与鲁棒性
- Enhancing Multilingual Reasoning via Steerable Model Merging
提出可操控模型合并(ST-Merge),用门控交叉注意力动态调整多语言与推理模型的贡献,解决多语言推理中的模型冲突
- User as Engram: Internalizing Per-User Memory as Local Parametric Edits
把用户事实稀疏写入 Engram 的哈希记忆表,推理技能由共享适配器承载,实现高精度个性化且不干扰推理
- Rethinking Reward Supervision: Rubric-Conditioned Self-Distillation
用评分标准作为细粒度反馈,将准则级条件转化为 token 级指导,提升推理模型训练效果。
2026-06-17 30 篇 ★ 8 深度
- Where Did It Go Wrong? Process-Level Evaluation of Web Agents with Semantic State Tracking
提出基于语义MDP的过程评估基准WebStep,通过技能分解与分叉分析定位Agent在探索与执行上的细微差异
- Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning
将教师模型的推理模式蒸馏为结构化的系统提示,让小模型零微调、低延迟达到前沿推理性能
- Unstable Features, Reproducible Subspaces: Understanding Seed Dependence in Sparse Autoencoders
提出可扩展的特征稳定性度量,揭示稳定特征主导功能信号,不稳定特征集中于可复现的低秩子空间
- MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification
将多模态大模型蒸馏为小模型,实现实时视频对复制检测,F1提升+8.57/+6.55,计算成本降35倍
- PhoneHarness: Harnessing Phone-Use Agents through Mixed GUI, CLI, and Tool Actions
提出混合动作手机智能体基准和执行框架,通过率75.0%,超越仅GUI方法12.9个百分点
- Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale
通过架构升级、混合线性注意力及强化学习框架实现高效推理与代理能力的万亿参数模型家族
- MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA
基于证据图与在线预算控制的多粒度多模态RAG,在长文档QA中动态平衡证据覆盖与噪声
- GD^2PO: Mitigating Multi-Reward Conflicts via Group-Dynamic reward-Decoupled Policy Optimization
提出冲突感知过滤与查询级重加权机制,防止多奖励RL训练中梯度抵消,显著提升工具调用和对齐性能。
- Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift
将梯度视为可检索的知识单元,通过即插即用的临时权重调整实现持续学习,避免参数漂移与灾难性遗忘。
- MMDiff: Extending Diffusion Transformers for Multi-Modal Generation
冻结扩散变换器,通过多时间步特征融合与轻量解码头,同时生成图像及密集感知模态
- PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory
提出解耦语义外观与几何结构的多模态记忆,结合编辑感知更新,实现视频编辑后的长期一致性生成。
- A Gradient Perspective on RLVR Stability and Winner Advantage Policy Optimization
通过梯度分析揭示GRPO崩溃机制,提出仅对正优势序列更新的WAPO,提升训练稳定性与性能。
- Beyond Parallel Sampling: Diverse Query Initialization for Agentic Search
提出训练无关的首轮查询多样化方法 DivInit,通过 MMR 从生成池中选择多样性查询,解决并行搜索代理的锚定坍缩问题。
- GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?
提出基于交互验证的游戏生成基准,评估编码智能体在 Godot 引擎中端到端构建可玩游戏的能力
- Variable-Width Transformers
提出 × 形瓶颈架构,中间层窄、两端宽,同等参数量下性能更优且推理成本更低
- On the Memorization Behavior of LLMs in Generative Recommendation: Observations, Implications, and Training Strategies
发现 LLM 生成式推荐强依赖一跳记忆,性能增益集中于此类用户,提出 IIRG 利用协同与语义邻居生成任务促进物品关系学习,显著提升非记忆受益用户表现
- MemSlides: A Hierarchical Memory Driven Agent Framework for Personalized Slide Generation with Multi-turn Local Revision
提出分层记忆框架(用户画像/工作/工具记忆)结合局部修改,实现多轮个性化幻灯片生成
- OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation
提出快慢双环框架,将结果校准的记忆归因与特权后见蒸馏结合,同时训练经验选择、利用、撰写和管理四种进化能力
- Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification
用单一离散视觉分词器统一多模态理解与生成,实现自回归模型直接解读自身生成视觉token
- Looped World Models
通过参数共享的 Transformer 块迭代优化隐状态,世界模型获得高达 100 倍参数效率并自适应深度
- Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients
在困难样本上,教师通过构造对比提示替代策略梯度注入,使学生模型摆脱蒸馏与GRPO的局限。
- From Reasoning Traces to Reusable Modules: Understanding Compositional Generalization in Language Model Reasoning
揭示SFT与RL在LLM推理中非对称互补:SFT提供模块原料,RL分解轨迹提取原子模块实现组合泛化
- Learning from the Self-future: On-policy Self-distillation for dLLMs
首个面向扩散大语言模型的在线自蒸馏框架,通过后缀条件化与步骤级监督实现高效后训练
- Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Models
针对 GRPO 训练中序列级信用分配导致过度思考膨胀,提出训练时动态编辑成功轨迹的冗余部分
- ConSA: Controllable Sparsity in Hybrid Attention via Learnable Allocation
用L0正则化与增广拉格朗日约束学习全局/局部注意力的最优分配,实现可控稀疏并揭示底层局部、中层全局的一致结构
- Temporal Preference Optimization for Unsupervised Retrieval
用时间偏好优化(TRPO)训练无监督稠密检索器,使其偏好时间对齐文档
- Understanding and Debugging Failures in N-Gram-Based Generative Retrieval
首次构建生成式检索故障分类体系并通过 SEAL/MINDER 发现单 token 主导、元数据依赖、答案串偏置等关键失效模式
- RSRank: Learning Relevance from Representational Shifts
利用查询在文档条件下的表示偏移作为相关性信号,零阈值过滤,克服启发式阈值依赖
- Do Generative Recommenders Deepen the Information Cocoon? A Closed-Loop Simulation with LLM-powered User Simulators
生成式推荐减缓类别级曝光塌缩但仍在代码空间形成结构性茧房,语义ID与更大模型有助于抵抗蚕食
- Compositional Skill Routing for LLM Agents: Decompose, Retrieve, and Compose
提出 SKILLWEAVER 框架与技能感知分解 (SAD) 迭代反馈,将 LLM Agent 技能路由的分解准确率从 51.0% 提升至 67.7%
2026-06-16 30 篇 ★ 15 深度
- StepPO: Step-Aligned Policy Optimization for Agentic Reinforcement Learning
将智能体RL从令牌级MDP重构为步骤级MDP,通过步骤级信用分配和重要性采样,显著提升多步交互任务性能。
- JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligence
首个开源、视觉驱动的 8B 交互模型,每秒自主决策沉默/响应/委派,并配有完整部署系统。
- FastContext: Training Efficient Repository Explorer for Coding Agents
将仓库探索与任务求解分离,用专用小模型子代理并行搜索,最高提升5.5%解决率并削减60% token消耗
- Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
总参数 550B、活跃 55B 的混合 Mamba-Attention MoE 模型,在 Agent 推理上精度对齐且推理吞吐量最高达同规模模型的 5.9 倍
- Beyond Positive Signals: Unlocking Implicit Negative Behaviors for Enhanced Sequential User Modeling
在CTR行为序列中按时间交错正负行为,用极轻量的极性感知校准即可让多种架构一致提升1.9%–9.6% AUC
- HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation
提出多粒度嵌套残差量化构建层级语义编码,通过门控交错推理实现内生链式思维,统一表示、推理与生成
- OneBar: An End-to-End Content-Grounded Generative Query Recommendation Framework for E-Commerce Video Feeds
端到端生成式框架,融合多模态意图grounding与偏好内化蒸馏,实时推荐搜索词,曝光+16.91%,GMV+21.67%
- S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents
提出统一轨迹构建范式,结合图任务生成、工具执行与多维验证,使32B模型在深度研究五项能力上达开源SOTA并逼近闭源前沿。
- DreamX-World 1.0: A General-Purpose Interactive World Model
一个支持相机导航、场景重访和可提示事件的通⽤交互式长时视频生成世界模型,通过蒸馏与自回归训练达到16 FPS
- One Sequential Recommendation Model Pretrained from Synthetic Priors Predicts Multiple Datasets
SRPFN利用合成先验预训练与支持集条件推断,实现序列推荐无更新跨域泛化,平均提升7.53%。
- Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search
多轮迭代生成框架,利用生成奖励模型的细粒度反馈强化学习,显著提升广告描述的知识性与忠实度
- Implicit Reasoning for Large Language Model-based Generative Recommendation
用可训练的 <pause> 令牌替代显式思维链,在Semantic ID推荐上效果更好且训练推理更高效
- Tangram: Unlocking Non-Uniform KV Cache Compression for Efficient Multi-turn LLM Serving
提出Tangram框架,通过静态预算预留、粗糙分页和提前负载均衡,使非均匀KV压缩在多轮LLM服务中可达最高2.6倍吞吐提升
- OneRank: Unified Transformer-Native Ranking Architecture for Multi-Task Recommendation
通过任务专用 token、梯度分离与候选感知情境描述符,将多任务推理内建于 Transformer 栈,消除编码器‑预测器分裂。
- Who Should Lead Decoding Now? Tracking Reliable Trajectories for Ensembling Masked Diffusion Language Models
提出TIE框架,通过跟踪解码轨迹置信度动态,实现MDLM的迭代知识融合,提升推理性能
- TokenPilot: Cache-Efficient Context Management for LLM Agents
通过前缀稳定化和残值驱动的驱逐实现缓存感知的上下文管理,大幅降低长时程LLM代理推理成本
- ExpRL: Exploratory RL for LLM Mid-Training
ExpRL 利用人类解答作为奖励脚手架,通过稠密过程奖励在中期 RL 中提升推理覆盖率,优于 SFT 与稀疏奖励,为后续 RL 提供更好初始化
- Agent trajectories as programs: fingerprinting and programming coding-agent behavior
通过过程表征压缩轨迹,以85.7%准确率识别编码智能体指纹,并构建过程审计库ProcGrep
- LESS Is More: Mutual-Stability Sampling for Diffusion Language Models
提出训练无关的自适应采样器 LESS,通过联合稳定性规则在线决定 token 揭示时机,以 72.1% 更少步骤保持精度。
- Understanding the Behaviors of Environment-aware Information Retrieval
首次用强化学习使LLM学会为不同检索器自适应生成查询风格,并揭示各检索器最优查询风格差异显著
- How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulation
提出SearchGEO框架,系统评估13种LLM搜索代理被恶意网页内容操纵后给出错误推荐的攻击成功率
- Tying the Loop -- Tied Expert Layers in Mixture-of-Experts Language Models
跨层共享专家参数,保持独立路由,几乎无损失地将 MoE 内存占用减半
- OpenClaw-Skill: Collective Skill Tree Search for Agentic Large Language Models
利用多模型集体智能构建结构化、多样且可迁移的技能树,并配合跨技能对比的强化学习,显著提升 LLM 智能体在长程工具使用任务上的表现
- PIANO: Personalized Reranking via Information Aggregation Node for Music Search Optimization
引入历史查询交叉注意力与列表级聚合Token,实现列表级多目标重排序,显著提升CTR/CVR
- RAID: Semantic Graph Diffusion for True Cold-Start and Cross-Lingual Forecasting
利用元数据语义检索与图扩散,在无历史数据的真冷启动场景下实现时间序列预测并显著降低延迟
- Harmonizing Semantic and Collaborative in LLMs: Reasoning-based Embedding Generator for Sequential Recommendation
通过隐式推理增强对比学习与协同奖励强化学习,让LLM生成的物品嵌入同时捕获深层语义和共现关系,提升序列推荐效果。
- RL-Index: Reinforcement Learning for Retrieval Index Reasoning
将检索推理从查询时移到索引阶段,用 GRPO 优化文档的理由生成,提升检索效果并降低在线延迟
- SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG
提出自适应扩展相邻块的检索策略,以更少的块数达到高召回并减少 token 开销
- Context-Aware RL for Agentic and Multimodal LLMs
在 GRPO 中增加对比上下文选择辅助损失,显著提升 Agent 与多模态 LLM 的证据接地能力
- Exploring Extrinsic and Intrinsic Properties for Effective Reasoning with Code Interpreter
发现有效代码推理依赖关键令牌与验证、回溯等认知行为,并验证其对推理提升和训练增强的作用
2026-06-15 30 篇 ★ 20 深度
- Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO
利用同家族小模型的策略级多样性替代token噪声,通过渐进退火实现大模型训练加速与性能提升
- Skip a Layer or Loop It? Learning Program-of-Layers in LLMs
提出 PoLar,让 LLM 为每个输入动态决定跳过或循环哪些层,用更少层达到同等或更高准确率。
- Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation
提出免训练两阶段Video RAG方案:粗召回用纯视觉/文本摘要避免噪声模态,细粒度推理过滤用LLM实现逻辑对齐与persona遵守
- Measuring Epistemic Resilience of LLMs Under Misleading Medical Context
当注入误导性上下文时,LLM 放弃原正确回答,准确率从 71.1% 暴跌至 38.0%
- When is Your LLM Steerable?
用生成前几步的隐藏状态差异训练GBDT,预测激活引导是欠调、成功还是过调,预测器可指导强度搜索,大幅降低解码成本
- Orchestra-o1: Omnimodal Agent Orchestration
提出支持文本/图像/音频/视频的全模态多智能体编排框架,通过模态感知任务分解与并行执行实现高效协作。
- The Hidden Power of Scaling Factor in LoRA Optimization
发现 LoRA 缩放因子 α 主导优化,与学习率作用不同,提出平方根法则及 LoRA-α 框架
- ADORE: Iterative Query Expansion with Retrieval-Grounded Relevance Feedback
将检索结果转化为结构化相关性反馈,在迭代中不断纠正扩展方向,显著提升查询扩展的检索效果
- From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI
提出“Workspace+Skill”机制,推动LLM从单次对话转向有状态、可复用的任务执行
- HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry
将 Agent 运行时脚手架抽象为一等公民,通过模块化处理器、进化引擎与协同训练实现自动优化,在多基准上平均提升 14.5%
- Personalization and Evaluation of Conversational Information Access
从个人上下文提取、个性化回复生成到系统评估,提出 CREL、LAPS 和 FACE 三个方法构建可靠 CIA 系统
- LLM Agents Can See Code Repositories
首次系统评估多模态仓库可视化对LLM Agent任务解决的影响,发现视觉辅助可降26% token开销且不损精度。
- TASR: Training-Free Adaptive Stopping for Iterative Retrieval
提出一个固定的停止谓词,通过重复答案和校准后的logit margin阈值,无需训练就能减少RAG中不必要的检索轮次
- VISTA: View-Consistent Self-Verified Training for GUI Grounding
通过多视角组构建与自验证锚点,缓解GRPO在GUI定位中组内无相对优势的问题
- ChronoID: Infusing Explicit Temporal Signals into Semantic IDs for Generative Recommendation
系统性探索如何将时间信号融入语义ID,提出相对时间编码+并行量化+晚融合的最佳方案,显著提升生成式推荐性能。
- CoRe: A Continuously Reward-Finetuned LLM Query Rewriter for Multi-Stage Context-Aware Relevance in Web-Scale Video Search
以线上多模态相关性模型为奖励源、乘性奖励对齐排序融合,结合半在线 MPO 与稳定性门控实现每周持续重写
- When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime
提出五类机制导向的无声故障分类,揭示LLM系统特有的“fail-plausible”故障模式并给出工程防御框架
- When Recommendation Denoising Meets Popularity Bias: Understanding and Mitigating Their Interaction
损失去噪可能抑制长尾信号,提出流行度感知门控PAD,在多个基准上取得更优准确-多样性权衡。
- Retrospective Progress-Aware Self-Refinement for LLM Agent Training
提出RePro框架,通过前向执行-回顾反思范式训练智能体从已完成轨迹中学习进度估计,以辅助长程任务决策,无需额外奖励模型
- Decoupled Mixture-of-Experts for Parametric Knowledge Injection
提出解耦混合专家 (DMoE),把外部知识模块化为独立 LoRA 专家,通过不确定性路由选择性激活并保持 KV-cache 复用,实现高效可更新的知识注入。
- Learning Coordinated Preference for Multi-Objective Multi-Agent Reinforcement Learning
通过让智能体学习协调的个性化偏好向量,实现团队角色分工和帕累托前沿覆盖,提升多目标多智能体协作性能
- Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflows
让合成器直接消费并行Worker的KV cache,通过两阶段训练和cache映射实现高效高质量的并行分支汇总
- Free Heavy-Tailed Lunch for Muon: A Theoretical Justification of Empirical Success
证明Muon在重尾噪声下能以最优样本复杂度达到核范数平稳点,且无需额外维度依赖
- Gaze Heads: How VLMs Look at What They Describe
VLM 中仅 9% 的注意力头(凝视头)能跟踪当前生成的图像区域,重定向这些头即可控制模型描述目标区域。
- ScoreGate: Adaptive Chunk Selection for Retrieval-Augmented Generation via Dual-Score Statistical Fusion
利用 bi-encoder 和 cross-encoder 双分数四分区自适应决定 RAG 块数量,无额外推理开销
- SIMMER: Benchmarking Latent Failures in LLM Executable Planning with a World Model
提出符号化厨房世界模型与状态机执行器,系统评估并缓解LLM智能体规划中的潜在与不可逆失败。
- StreamMemBench: Streaming Evaluation of Agent Memory for Future-Oriented Assistance
提出首个从流式观察到任务复用全链路诊断Agent记忆行为的基准,揭示存储与利用的鸿沟
- tap: A File-Based Protocol for Heterogeneous LLM Agent Collaboration
通过文件优先级设计结合实时通知,实现Claude与Codex在同一仓库无共享内存的长期开发与审查。
- Abstracting Cross-Domain Action Sequences into Interpretable Workflows
提出 WorkflowView,通过 LLM 层次化提示将低级操作日志转为高级活动描述,零/少样本实现跨域意图理解和分类。
- Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling
构建动态上下文知识图谱,融合结构、语义与上下文记忆,长文本困惑度降8.5%且内存效率提升2-2.5倍
2026-06-14 30 篇 ★ 1 深度
- Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback
将缺陷定义为(位置,类型,原因,重要性)元组,提出结构化集合预测与空间奖励对齐框架
- MaskAlign: Token-Subset Representation Alignment for Efficient Diffusion Training
提出随机 Token 子集对齐与预掩码混合,大幅加速扩散 Transformer 训练并提升生成质量。
- IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder
联合对齐浅层与深层视觉特征,使离散视觉标记兼顾保真度与语义,重建与生成双SOTA
- From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion
用冻结图像分词器的1D token作为全局外观载体,结合2D局部路径,通过选择性令牌编辑轻量控制融合一致性。
- Building Social World Models with Large Language Models
提出社会世界模型(SWM),利用LLM从预测市场数据学习社会信念的状态转移规律
- A Stationary (and Therefore Compatible) Representation is All You Need
证明用d-Simplex固定分类器学到的平稳表示天然兼容旧模型,并结合对比损失捕获高阶依赖,无需重索引即可支持不间断检索。
- High-Fidelity Two-Step Image Generation via Teacher-Aligned End-to-End Distillation
用教师对齐对抗学习、分步解耦参数化和端到端迭代正则化,将8步扩散模型蒸馏至2步,显著缩小质量差距
- Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs
用 Agent 系统 ModSleuth 递归还原 LLM 开发中的 1060 个来源验证依赖,并揭示许可证、耦合等隐患
- Rethinking Psychometric Evaluation of LLMs: When and Why Self-Reports Predict Behavior
发现大五人格无法预测LLM行为,而计划行为理论在共享对话中达到人类水平一致性,跨会话一致性取决于行为是否锚定于训练数据
- ArogyaSutra: A Multi-Agent Framework for Multimodal Medical Reasoning in Indic Languages
构建多语言多模态医学数据集并提出 actor-critic 多智能体框架,融合工具与双记忆机制提升推理精度。
- FAST-MEL: A Fast, Accurate, and Storage Efficient Solution for Multimodal Entity Linking
提出紧凑固定向量表示,在维持SOTA准确率的同时实现千倍加速与储空间缩减。
- See What I See, Know What I Think: Dense Latent Communication Across Heterogeneous Agents
提出异构多智体KV缓存密集对齐框架,实现跨模型知识迁移和高效通信,计算量降低2-3倍。
- What Limits Does Quantization Place on Dense Top-$k$ Retrieval? A Theoretical Study
证明在量化精度下,嵌入维度必须随语料库规模对数增长,打破了无限精度下维度与 N 无关的结论。
- MLT-Dedup: Efficient Large-Scale Online Video Deduplication via Multi-Level Representations and Spatial-Temporal Matching
多级表示联合时空匹配,显著降低线上重复率并提升索引容量5倍
- Efficient and Robust Online Learning to Rank in Decentralized Systems
RankGuard 利用用户私有点击历史验证外来模型更新,有效抵御拜占庭攻击,并首次给出收敛证明
- Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Models
在视觉自回归模型中引入位级伯努利引导与多尺度残差码重注入,实现背景保持的精准图像编辑。
- Adaptive Turn-Taking for Real-time Multi-Party Voice Agents
提出 ModeratorLM,根据分配角色自适应调整多方语音对话中的轮流行为,精度提升超40%,召回提升超70%。
- When Does Mixing Help? Analyzing Query Embedding Interpolation in Multilingual Dense Retrieval
英语主导非对称性:非英语文档混合查询有益,英语文档索引纯英语最优,英语是最强混合伙伴
- GF-DiT: Scheduling Parallelism for Diffusion Transformer Serving
将 GPU 并行度作为可调度资源,通过弹性运行时和轻量组通信大幅提升 DiT 服务效率
- NetCause: Counterfactual Learning for Root Cause Analysis in Large-Scale Networks
将网络事件建模为图时序过程,通过反事实仿真自监督学习因果排序,根因准确率提升16.1%
- The Clustering Strikes Back: Building Cost-Effective and High-Performance ANNS at Scale with Helmsman
用聚类索引+用户态闪存栈+学习型剪枝+GPU加速,替代全内存HNSW,成本降90%且维持高性能
- Understanding Truncated Positional Encodings for Graph Neural Networks
揭示截断位置编码的表达能力差异,指出混合使用优于单一类型
- Dense Supervision, Sparse Updates: On the Sparsity and Geometry of On-Policy Distillation
发现on-policy蒸馏的更新是坐标稀疏且FFN为主的,训练子网络可恢复性能,并揭示了更新的几何特性。
- Beyond Uniform Tokens: Adaptive Compression for Time Series Language Models
从非对称Token视角提出自适应预算框架,在频域压缩时间序列Token并逐层削减提示Token,实现最高7.68倍推理加速与78%设置下的性能提升。
- Reasoning as Pattern Matching: Shared Mechanisms in Human and LLM Everyday Reasoning
人类与 LLM 在常识推理中犯类似的错误,且 LLM 的注意力头实现了一种模式匹配,可预测人类看似不合理的错误。
- How Fine-Grained Should a RAG Benchmark Be? A Hierarchical Framework for Synthetic Question Generation
提出HieraRAG层次化框架,通过判别力和一致性比率确定RAG评测的最佳粒度
- S-GBT: Smooth Growth Bound Tensor for Certified Robustness Against Word Substitution Attacks in NLP
利用逐元素Hessian界的平滑增长张量正则化,将认证鲁棒准确率提升最高23.4%
- Simplex-Constrained Sparse Bagging: Transitioning from Uniform Priors to Sparse Posteriors in Ensemble Learning
提出Simplex约束稀疏Bagging,通过凹二次惩罚在单纯形上实现集成剪枝与校准,压缩率达96%
- The Stable Recovery Manifold: Geometric Principles Governing Recoverability in Continual Learning
发现遗忘的知识保存在约 8 维低秩子空间,遗忘是几何可及性问题而非信息损毁。
- Graphical Causal Reasoning for Root Cause Analysis in Cloud Networks
提出基于Granger因果与条件独立的因果图构建及时间滞后概率推理的根因分析方法,在35个云网络事件上召回率达85.7%
2026-06-13 30 篇 ★ 10 深度
- On the Limits of LLM Adaptability: Impact of Model-Internalized Priors on Annotation Task Performance
发现LLM标注错误难以通过提示纠正,定义匹配比文本记忆更关键
- ToolSense: A Diagnostic Framework for Auditing Parametric Tool Knowledge in LLMs
揭示参数化工具检索在约束解码下高召回与真实意图查询及知识保留之间的严重背离,提出多维度诊断基准与内部化分数。
- The Cold-Start Safety Gap in LLM Agents
发现 LLM Agent 在会话起始安全性最弱,通过预先完成少量常规任务可显著提升安全性 9-52%
- DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning
通过对齐token功能角色与实际注意力分配,改进RLVR中的跨模态协调
- WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces
提出长程混合接口(GUI+CLI+代码)智能体基准,揭示轨迹感知评估能纠正纯结果评分的虚高问题。
- Conan-embedding-v3: Fusing Modality-Specific Models for Omni-Modal Embedding
提出解耦-融合-恢复框架,解决多模态模型融合中的Projector Drift问题,实现单骨干统一检索
- Flash-GMM: A Memory-Efficient Kernel for Scalable Soft Clustering
提岀 Flash-GMM,通过 Triton 内核融合避免显存实现完整责任矩阵,实现 20 倍加速,支持单卡训练百倍更大数据集。
- N-GRPO: Embedding-Level Neighbor Mixing for Enhanced Policy Optimization
通过语义近邻混合同一 token 的嵌入,在 GRPO 中注入多样性且保持语义一致,提升数学推理
- WebChallenger: A Reliable and Efficient Generalist Web Agent
通过 PageMem 页面结构化表示与三大认知机制,用开源小模型无微调达到逼近闭源大模型的 Web 任务成功率
- TreeSeeker: Tree-Structured Trial, Error, and Return in Deep Search
提出TreeSeeker,通过树结构分支状态和文本UCB操作控制实现深度搜索的受调试错与预算重分配
- Knowing When to Ask: Self-Gated Clarification for Hierarchical Language Agents
将澄清作为与导航竞争的动作,基于自身评分自门控决定何时求助,实现从强制到机会澄清的结构性转变。
- AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation
通过蒸馏实现统一多模态任意转音频生成,仅4步采样即超越多步基线,速度提升约25倍
- EvoBrowseComp: Benchmarking Search Agents on Evolving Knowledge
提出自动更新的复杂问答基准EvoBrowseComp,利用三Agent协同从实时网络中合成无污染题目,评估搜索Agent的真实浏览能力。
- Getting Better at Working With You: Compiling User Corrections into Runtime Enforcement for Coding Agents
提出 TRACE,把用户矫正编译成运行时强制检查,克服记忆检索却仍违反偏好的“访问‑合规”差距
- HYDRA-X: Native Unified Multimodal Models with Holistic Visual Tokenizers
首个以单一ViT统一图像与视频分词的原生视觉分词器,通过分层时间压缩与潜在级语义注入提升重建与编辑一致性
- Demystifying Hidden-State Recurrence: Switchable Latent Reasoning with On-Policy Reinforcement Learning
提出Switch,通过<swi>/</swi>边界标记使隐藏状态递归潜在推理兼容GRPO,实现高效、可解释的推理
- MiniMax Sparse Attention
提出MiniMax稀疏注意力,通过分组索引分支动态选择关键块,将1M上下文计算量降低28.4倍并实现14.2倍预填充加速
- Phase Transitions in Attention: A Bayesian Theory of Copy Head Emergence
用贝叶斯框架证明 softmax 注意力在复制任务上随数据量出现一阶相变,解释了复制头的突然涌现
- A2D2: Fine-Tuning Any-Length Discrete Diffusion for Adaptive Decoding
提出联合优化插入/去掩码策略与质量推理调度的任意长度离散扩散奖励微调框架。
- CoDeR: Local Constraint-Compatible Retrieval Beyond Semantic Similarity
提出将主题相关性与约束兼容性解耦的双编码器检索方法,专门减少违反负约束的文档暴露
- From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent
将论文评审建模为MDP,用结构化日志引导LLM主动调查疑点,8B模型性能超越大模型prompt方法39%
- Multiagent Protocols with Aggregated Confidence Signals
首次为多智能体辩论系统设计聚合置信度,通过可比性转换与贝叶斯融合显著提升判别力
- Influcoder: Distilling Decoders' Gradient Influence Rankings into an Encoder for Data Attribution
通过将解码器梯度影响排名蒸馏为编码器直接输出,实现大规模数据归因的快速近似。
- IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editing
提出迭代多模态Agent框架,通过多视图工程图闭环交互与几何感知RL,实现鲁棒CAD代码生成与编辑
- Multi-Agent Reinforcement Learning from Delayed Marketplace Feedback for Objective-Weight Adaptation in Three-Sided Dispatch
离线RL从真实市场延迟反馈中学习调整调度优化器的目标权重,实现效率提升而不损害质量
- Operads for compositional reasoning in LLMs
用Operad代数形式化问题分解,提出Operadic一致性度量,可预测多步推理准确性
- Trait, Not State: The Durability of Reading Identity in Social Highlighting
个体的文档选择特征在长时段内保持稳定,是一种持久特质,可用于预测未来阅读
- Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuning
提出 RA-RFT,用推理效用蒸馏检索器,并在强化微调中注入类比演示,大幅提升数学推理性能
- Reinforcement Learning for Neural Model Editing
将模型编辑转化为强化学习问题,通过奖励反馈学习权重修改策略,实现遗忘与去偏
- AgentBeats: Agentifying Agent Assessment for Openness, Standardization, and Reproducibility
将基准测试本身封装为 judge agent,通过 A2A 与 MCP 解耦评估逻辑,使任意智能体无需定制即可互操作
2026-06-12 30 篇 ★ 22 深度
- EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learning
提出 EvoTrainer,让训练诊断 har ness 随策略共同进化,在 SWE/Math/Coding 上超越人工 RL 基线
- Can Generalist Agents Automate Data Curation?
引入 CURATION-BENCH 基准,发现通用 Agent 能执行数据策展但探索窄,方法适应支架可引导突破
- Breaking the Bubble: Asynchronous Pipeline Parallel Training with Bounded Weight Inconsistency
通过局部梯度积累作为版本控制,零气泡异步流水线以有界权重漂移换取训练加速
- ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction
去除连续 GUI 截图中的冗余视觉补丁,减少 token 开销的同时提升成功率,并让更长历史成为可能。
- Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?
赋予多模态大模型显式视觉自恢复能力,通过SFT+RL双奖励训练显著提升损坏图像下的鲁棒性。
- SG-OPD: Sign-Gated On-Policy Distillation via Sign-Consistency Gating and Phased Teacher Sampling
用验证器信号在轨迹和 token 层面过滤教师噪声,显著提升数学推理中的在线蒸馏效果
- Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning
提出单策略多智能体视觉推理系统,通过角色解耦优化和KV缓存复用减少幻觉,在六大基准上超越单轨迹方法。
- Evoflux: Inference-Time Evolution of Executable Tool Workflows for Compact Agents
在少量教师轨迹下,推理时进化搜索让小型模型工具可用性从~3%升至17-24%,优于等量微调。
- When More Documents Hurt RAG: Mitigating Vector Search Dilution with Domain-Scoped, Model-Agnostic Retrieval
发现大规模异质文档库中的向量搜索稀释问题,提出基于元数据的领域限定检索显著提升精度,指出多智体编排存在精度-忠实性悖论。
- Towards Diverse Scientific Hypothesis Search with Large Language Models
用多温度层并行进化与信息交换,在固定验证预算下提升假设质量与多样性
- Strategic Decision Support for AI Agents
提出在线自适应算法 SOS,以最小化支持调用次数同时保证反事实漏支持误差可控
- CompRank: Efficient LLM Reranking via Token-Level Compression and Decoding-Free Scoring
提出CompRank,通过文档表示解耦、分段式token压缩和CopyNet式监督,仅保留10.2%文档token即接近全量重排序性能,并实现显著加速。
- EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discovery
通过环境工程(权限、制品、预算、人机交互)引导Agent自主科学发现,以极低成本在26圆堆积等任务创下新SOTA。
- EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
提出动态环境评测套件 EvoArena 和补丁式记忆机制 EvoMem,通过记录记忆变化轨迹让代理在持续演化的任务中更鲁棒。
- HarnessBridge: Learnable Bidirectional Controller for LLM Agent Harness
将 Agent 与环境的交互接口参数化为可学习的双向投影,通过指令微调轻量模型,在提升任务成功率的同时大幅降低 token 消耗和轨迹长度。
- InterleaveThinker: Reinforcing Agentic Interleaved Generation
首个解耦规划与评判的多智能体框架,让任意冻结图像生成器具备强交错生成能力,并解决视觉过依赖与误差累积。
- Fine-tuning Multi-modal LLMs with ART: Art-based Reinforcement Training
仅优化视觉像素输入实现软提示微调,无需修改计算图,兼容vLLM等高性能引擎
- MaxProof: Scaling Mathematical Proof with Generative-Verifier RL and Population-Level Test-Time Scaling
通过生成-验证-修复一体化训练与锦标赛搜索,在IMO 2025和USAMO 2026上超越人类金牌线
- SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning
提出以Python代码作为行动界面,在持久内核中迭代组合感知工具,显著提升开放式空间推理性能。
- Operadic consistency: a label-free signal for compositional reasoning failures in LLMs
提出操作子一致性(OC)作为无标签信号,检测LLM直接回答与分解重组回答的不一致,跨模型准确率高度相关且互补于采样基线的选择性预测
- CFALR: Collaborative Filtering-Augmented Large Language Model for Personalized Fashion Outfit Recommendation
首个协同LLM语义理解与CF交互模式的穿搭生成框架,通过混合编码和输出层融合显著提升个性化推荐效果。
- Beyond the Commitment Boundary: Probing Epiphenomenal Chain-of-Thought in Large Reasoning Models
通过截断因果框架定位CoT中的“承诺边界”,证明答案固化后的推理为附带现象,并用探针实现推理提前退出,节省最高55%的token。
- CQC-RAG: Robust Retrieval-Augmented Generation via Cross-Query Consistency
提出跨查询一致性假说,通过生成多样等价查询并评估答案信心稳定性来过滤幻觉,无需外部监督即可提升 RAG 鲁棒性
- Recursive Agent Harnesses
将递归单元从裸模型调用升级为完整 agent harness,在长上下文推理上超越 coding agent 和 RLM,代码生成子 agent 并行处理。
- Reward Modeling for Multi-Agent Orchestration
提出编排级奖励模型 Orch-RM,用自监督偏好对训练,无需人工标注和子 Agent 全量执行,显著提升测试时缩放和编排器训练的效率与效果
- HyperTool: Beyond Step-Wise Tool Calls for Tool-Augmented Agents
提出 HyperTool 可执行接口,将多步确定性工具调用封装为单个代码块,使模型可见执行粒度更粗,大幅降低上下文消耗并提升复杂工具使用准确率。
- Uncertainty-Aware Hybrid Retrieval for Long-Document RAG
提出无需训练的 UMG-RAG,利用检索得分分布的熵动态估计各检索源与粒度的置信度,并通过父块提升生成连贯的紧凑上下文。
- OneRetrieval: Unifying Multi-Branch E-commerce Retrieval with an Editable Generative Model
首个兼具高召回与倒排索引级实时编辑能力的生成式检索框架,通过关键词对齐编码和预留槽位实现多路召回统一。
- Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents
提出以利益相关者(用户、卖家、平台)为核心的提示注入安全基准,揭示危害的不对称性和异质失败模式。
- One Polluted Page Is Enough: Evaluating Web Content Pollution in Generative Recommenders
提出FORGE基准,揭示搜索增强LLM在检索到虚假内容后会将假品牌推荐给用户,单页污染即导致高达27%的误导率
2026-06-11 30 篇 ★ 20 深度
- SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Construction
首个覆盖技能使用生命周期的攻击基准,揭示固定与自变异投毒下 Agent 高达 86.3% 的攻击成功率
- PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleaf
构建专家技能库并协调 12 个专业 Agent,在 Overleaf 中提供可操作的论文修改建议
- Beyond Uniform Token-Level Trust Region in LLM Reinforcement Learning
提出 CPPO,通过位置加权与累计前缀预算的 token 掩码,使信任区域匹配自回归结构,显著提升推理 RL 的稳定性和准确率。
- The Role of Feedback Alignment in Self-Distillation
逐步对齐求解器推理的反馈在自我蒸馏中效果最佳,能精确修正错误并保留正确步骤。
- Kwai Keye-VL-2.0 Technical Report
首个在GQA架构上实现DeepSeek稀疏注意力以无损处理256K上下文,并通过跨模态多教师在线蒸馏解决多任务遗忘的多模态模型
- Decentralized Multi-Agent Systems with Shared Context
提出去中心化多智能体框架DELM,通过共享验证上下文和异步任务队列,在软件工程与长上下文推理上显著提升性能并降低近半成本。
- From Prompt to Purchase: How AI Brand Recommendations Move Consumers on the Open Web
会话助手推荐品牌后,用户同名搜索量上升+4.3pp,访问品牌自身站点+2.4pp,品牌特定零售商页面访问量+1.0pp。
- Breaking Entropy Bounds: Accelerating RL Training via MTP with Rejection Sampling
揭示RL阶段熵升高与MTP接受率的负线性关系,通过拒绝采样与TV损失将接受率提至95%,实现1.8倍训练加速
- Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application
从环境工程生命周期视角系统梳理智能体环境建模、合成、评估及与环境共同进化的研究
- InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning
提出多模态上下文推理(MCR)与多头潜在注意力(M²LA),将开放视频模型推向长程视觉智能体
- Redesign Mixture-of-Experts Routers with Manifold Power Iteration
让路由器行向量逼近对应专家权重的主奇异方向,以提升 MoE 路由质量
- Verifiable Environments Are LEGO Bricks: Recursive Composition for Reasoning Generalization
将可验证环境抽象为可组合积木,通过递归算子自动生成复合环境,突破线性扩展瓶颈,提升LLM推理泛化能力
- miniReranker: Efficient Multimodal Reranking through Visual Cache Reuse and Interaction Sparsity
通过视觉优先格式、提前退出、交互带及token剪枝,将单查询多模态重排序时间降至原来的不到1%,同时保持96%以上性能。
- Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution
用一个 LLM 同时做 agent 和环境,通过预测未来状态和分析失败模式实现自举式共进化,平均提升超 4%
- World Model Self-Distillation: Training World Models to Solve General Tasks
通过自蒸馏将详细描述知识迁移到简洁指令模型,并结合VLM反馈RL超越教师
- Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories
提出七角色虚拟新闻室与 Inspector 证据链机制,将原始数据转化为可验证的多模态互动文章
- Toward Generalist Autonomous Research via Hypothesis-Tree Refinement
提出 Arbor 框架,用持久协调器与孤立执行器配合假设树精化,把长期研究转化为累积性探索与验证
- Adaptive Multi-Resolution Procedural Knowledge Compression for Large Language Models
提出多分辨率软令牌压缩框架 SKIM,通过渐进训练与离线自判实现技能压缩,在保持任务精度的同时大幅减少 token 消耗。
- DeMix: Debugging Training Data with Mixed Data Error Types by Investigating Influence Vectors
利用完整的影响向量代替标量分数,通过多标签分类同步检测训练数据中的标签错误、特征错误和虚假相关三类问题。
- Doc-to-Atom: Learning to Compile and Compose Memory Atoms
将文档分解为语义类型原子并编译为 micro-LoRA,查询时动态路由组合相关原子,减少干扰并提升长文档推理性能。
- FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents
提出抗捷径数据合成框架 FORT,通过控制证据共覆盖、单线索选择性等风险生成高难度搜索轨迹,仅用 SFT 训练即可在深度搜索基准上取得最优。
- APPO: Agentic Procedural Policy Optimization
通过细粒度决策点分支与未来感知信用分配,提升Agent强化学习的探索效率与最终性能
- LLM-Based User Personas for Recommendations at Scale
用知识蒸馏与异步推理实现在线LLM生成自然语言用户兴趣画像,平衡利用与探索,显著提升观看价值
- uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking
结合学习稀疏检索与LLM重排序的多轮RAG管道,利用完整对话历史提升跨域泛化与鲁棒性
- DiffCold: A Diffusion-based Generative Model for Cold-Start Item Recommendation
提出DiffCold扩散框架,用检索增强聚合与模拟对齐统一温冷表示,同时提升冷热物品性能
- CORE-Bench: A Comprehensive Benchmark for Code Retrieval in the Era of Agentic Coding
提出三层级代码检索基准,揭示Agent编码场景下检索性能急剧下降,微调可显著提升
- TAHOE: Text-to-SQL with Automated Hint Optimization from Experience
将提示优化重构为持久化的数据管理问题,通过错误驱动的提示学习构建结构化提示库,实现高效、可迁移的 Text-to-SQL 生成。
- VIA-SD: Verification via Intra-Model Routing for Speculative Decoding
引入从大模型内部路由出的轻量分层验证器,处理中等置信度 token,减少大模型调用,提升推测解码速度 10-20%
- Tail-Aware Adaptive-k: Query-Adaptive Context Selection for Retrieval-Augmented Generation
利用排序相似度曲线陡-平-陡模式进行拐点检测,结合局部极值理论检验,实现高效、查询自适应的检索截断,近似oracle质量
- Learning What to Say to Your VLA: Mostly Harmless Vision Language Action Model Steering
交互式搜索语言序列并利用共形预测实现无害化语言引导,显著提升冻结VLA的任务成功率
2026-06-10 30 篇 ★ 30 深度
- Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense
SCOUT 通过预测各检测器对每个请求的可靠性与延迟,动态分配轻量检测器并按需升级至 LLM 法官,实现可控的安全-效用权衡
- Trust Functions: Near-Lossless Weak-to-Strong Generalization by Learning When to Trust the Weak Teacher
提出神经信任函数,从教师内部表示预测弱标签正确性以过滤噪声,实现匹配甚至超越真值训练的弱监督泛化,并可通过迭代链滚雪球式提强。
- What Should Agents Say? Action-state Communication for Efficient Multi-Agent Systems
提出 PACT 协议,将智能体间消息压缩为行动-状态-结果三字段,在保持性能的同时大幅减少 token 消耗
- Online Skill Learning for Web Agents via State-Grounded Dynamic Retrieval
提出状态引导动态检索,将技能复用从任务级改为步级,滑动窗口提取子过程与MMR重排提升Web Agent成功率。
- Agents' Last Exam
覆盖55个职业子领域、1490个专家提交任务,评测Agent在长时程多模态计算机操作上的表现,最强模型整体通过率仅2.6%。
- AsyncWebRL: Efficient Multi-Step RL for Visual Web Agents
异步系统 + 去除轨迹步数归一化,实现视觉 Web Agent 训练 2.9× 加速且 OOD 准确率新高
- Retrospective Harness Optimization: Improving LLM Agents via Self-Preference over Trajectory Rollouts
提出无需标注的回顾式 Harness 优化方法 RHO,通过自偏好对比轨迹选择最佳技能/工具更新,在软件工程、技术等多个领域显著提升 Agent 表现。
- SlimSearcher: Training Efficiency-Aware Web Agents via Adaptive Reward Gating
多阶段门控机制统一 SFT 与 RL,在保持或提升准确率的同时将工具调用轮数减少 17%–58%
- Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking
提出结构思维范式,以多模态结构图显式管理冲突证据,实现跨模态冲突感知的深度信息检索,平均提升17.2%准确率。
- Hardening Agent Benchmarks with Adversarial Hacker-Fixer Loops
提出黑客-修复循环自动加固基准验证器,配合共享防御池与验证器访问,将攻击成功率降至0%
- Rethinking the Divergence Regularization in LLM RL
提出DRPO,用连续二次正则化替代硬掩码,实现基于Binary-TV散度的平滑信任域,提升LLM RL训练的稳定性与效率
- Personal Salience: Highlighting Is Social, but Individuality Lives in Selection
利用共读控制分离通用、群体和个体显著性,发现个体信号在已标亮段落的选择任务中强度约为突出段落的6-8倍,且主要来自主题偏好。
- Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It
CoT微调破坏混合模型的长距离召回,提出仅恢复 Q/K 投影的训练免方法QK-Restore,高效修复
- MetaPlate: Counterfactual-Guided RAG-LLM Tool for Personalized Food Recommendation and Hyperglycemia Prevention
结合反事实优化与RAG-LLM,将餐后血糖预测转化为可执行的膳食建议,并通过专家迭代显著提升推荐合理性
- Decision-Calibrated Conformal Uncertainty for Pacing Decisions in Streaming Advertising
通过投影预测误差至策略价值/约束方向而非全库存空间,实现更紧凑的 pacing 鲁棒认证半径,避免过度保守。
- Mult-DPO: Multinomial Direct Preference Optimization for Recommender Systems
提出多项式替代似然,将 DPO 扩展到多正例集合式偏好对齐,并证明其为 marginalized PL 损失的上界
- $τ$-Rec: A Verifiable Benchmark for Agentic Recommender Systems
用可验证奖励与 pass^k 一致性指标替代主观 LLM 评判,揭示当前模型在智能体推荐中的可靠性悬崖
- EEVEE: Towards Test-time Prompt Learning in the Real World for Self-Improving Agents
通过路由器和提示协同进化,在异构多任务流中实现稳定的测试时提示学习,缓解跨任务干扰
- Effective Reinforcement Learning for Agentic Search by Recycling Zero-Variance Queries During Training
将GRPO训练中浪费的零方差查询动态回池重采样,使训练分布与策略协同演化,大幅提升LLM搜索代理性能
- One Token per Multimodal Evidence: Latent Memory for Resource-Constrained QA
提出 Latent Memory,将多模态证据压缩为单潜在Token进行检索与生成,以3-10倍更少生成Token达到竞争性能。
- Generative Archetype-Grounded Item Representations for Sequential Recommendation
用大模型生成物品理想受众描述(原型),并通过行为校准将其与真实交互模式对齐,提升序列推荐效果
- SIDInspector: A Mapping-First Diagnostic Resource for Semantic-ID Tokenizers
提供一种映射层诊断资源,在生成式推荐训练前揭示 SID 分词器的地址空间缺陷。
- SkillResolve-Bench: Measuring and Resolving Same-Capability Ambiguity in Agent Skill Retrieval
提出基准 SkillResolve-Bench 及 SkillResolve 方法,通过同类簇解析与效用学习,消除能力相似但执行有害的技能暴露同时提升有用技能排序
- STORM: Stepwise Token Optimization with Reward-Guided Beam Search
将检索奖励转化为 token 级信号,通过奖励引导束搜索训练 LLM 生成高效关键词,在不改变索引下大幅提升 BM25
- T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains
构建覆盖25个领域、76个工具的自动评估基准,揭示LLM代理在多轮跨域场景下的工具调用短板与一致性挑战
- Pushing the Limits of LLM Tool Calling via Experiential Knowledge Integration and Activation
系统研究经验知识在工具调用中的获取、激活与内化,提出KA TE框架,通过并行采样和知识增强训练大幅提升多步工具调用准确率。
- TRACE: A Unified Rollout Budget Allocation Framework for Efficient Agentic Reinforcement Learning
将 rollout 预算分配到更可能产生混合奖励的 prompt 根和交互前缀,提升智能体 RL 样本效率。
- VISTA: A Versatile Interactive User Simulation Toolkit for Agent Evaluation
结合 UI 与 API 混合仿真并引入覆盖率、真实感等六项指标,更全面地暴露智能体故障
- How Does Reasoning Flow? Tracing Attention-Induced Information Flow for Targeted RL in LLMs
将LLM推理过程建模为注意力引导的有向无环图,通过回答条件化的流守恒变换识别关键推理骨干token,用于强化学习的细粒度信用分配
- Atomic Intent Reasoning: Bringing LLM Semantics to Industrial Cross-Domain Recommendations
离线将用户行为拆解为原子意图并缓存,在线动态组合实现 LLM 级语义推理,延迟仅 20ms
2026-06-09 30 篇 ★ 20 深度
- Augmenting Attention with Exponentially Decaying Memory Improves Query-Aware KV Sparsity
利用RAT+的指数衰减记忆模块,一致提升Quest、MoBA、SnapKV等查询感知稀疏方法在长上下文任务上的准确性。
- LayerRoute: Input-Conditioned Adaptive Layer Skipping via LoRA Fine-Tuning for Agentic Language Models
用 1.1M 参数教会 0.5B 模型按步型跳层:工具调用省 15.2% FLOPs,规划几乎不跳,质量不降反升。
- HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems
通过 harness–policy 对协同进化实现 LLM agent 系统的元适应,解决执行结构与推理策略兼容性问题
- Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory
首个用依赖类型语言 Lean4 形式化验证 Agent 工作流语义一致性并自动改进的框架
- Why Muon Outperforms Adam: A Curvature Perspective
Muon 因更低的标准化方向锐度 (NDS) 实现更小的二阶曲率惩罚,从而获得更大的一步损失下降。
- LLM Explainability with Counterfactual Chains and Causal Graphs
通过MCMC反事实增强从LLM预测中挖掘概念级因果图,实现透明推理
- Bayesian-Agent: Posterior-Guided Skill Evolution for LLM Agent Harnesses
将代理技能视为贝叶斯假设,基于验证轨迹后验指导技能修补、压缩与退役,实现无需改权重的可靠进化。
- DeRes: Decoupling Residual Stability and Adaptivity for Scalable CTR Prediction
双路径残差解耦稳定性与自适应,点式 SiLU 注意力支持多兴趣并行,得到更优 AUC 和更陡缩放律
- Trajectory-Refined Distillation
提出轨迹精炼蒸馏(TRD),由教师修正学生生成的错误前缀后再进行蒸馏,突破token级干预局限
- OneFeed: A Unified Generative Framework for Feed ContentEnhancement and Query Generation
用一个共享编码器同时生成推荐用的语义ID和搜索用的自然语言Query,并通过对比对齐弥补语义鸿沟
- End-to-End Context Compression at Scale
通过大规模端到端训练编码器-解码器,以软令牌压缩KV缓存,在长上下文任务上实现更优的速度-质量帕累托前沿
- When Should Queries Be Decomposed? A Stage-Aware Study of Query Decomposition for Multi-Condition Retrieval
发现查询分解在初始检索时因语义稀释而有害,在重排序时能提升细粒度约束验证,提出分阶段分解框架
- FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention
提出前瞻稀疏注意力与神经记忆索引器,将KV缓存压缩至13.5%且准确率无损
- Gryphon: A Unified Architecture for Semantic-ID Generation and Item-Level Scoring in Industrial Recommendations
在生成式检索中引入联合训练的物品级评分模块,解耦beam likelihood与最终排序,解决SID碰撞和得分失校准
- Intrinsic Selection and Particle Resampling for Inference-Time Scaling Beyond Domain Verifiability
利用样本集的内在尾部熵统计来选择和引导生成,无需外部奖励模型即可实现跨领域推理时扩展。
- Aperon Technical Report: Hierarchical No-Pointer Tangent-Local Search for High-Dimensional Approximate Nearest Neighbors
用局部切空间降维与无指针Block-SoA布局替代图索引,实现3.6倍提速与近乎零缓存缺失。
- Adaptive Loss Balancing for Noise-Robust GRPO in Generative Recommendation
通过样本级门控让 GRPO 只在策略不确定且奖励可靠时才更新,解决奖励模型噪声问题。
- OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics
12款自建UE5游戏构建多模式Agent评测,IDC反射框架揭示自我改进轨迹与技能迁移规律
- SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks
构建统一基准评估多模态Agent在真实任务中的交互式空间推理,集成8个模拟器、760个人工任务,最强模型成功率仅17.4%
- ToolRec: Calibrated Preference Alignment for Query Recommendation in On-Device Assistants
提出双层校准机制与加权KTO,在OPPO小布上显著提升工具调用查询的CTR和总点击量
- TrustMargin: Training-Free Arbitration between Parametric Memory and Retrieved Evidence in Large Language Models
提出TrustMargin,一种无训练即插即用的仲裁层,利用模型自身似然评分选择直接生成或RAG答案
- iOSWorld: A Benchmark for Personally Intelligent Phone Agents
首个以持久用户身份为中心的交互式iOS模拟器基准,涵盖133个跨应用任务,强调个人化智能与多应用推理。
- IS-CoT: Breaking the Long-form Generation Collapse via Interleaved Structural Thinking
提出交错式Plan-Write-Reflect循环,让8B模型在长文本生成上超越大模型,打破长度崩溃。
- MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding
用多智能体协作+逻辑否决辩论代替全库暴力搜索,实现免训练且高效的视频检索。
- Popcorn: A Configurable Benchmark for Visual Evidence in Multimodal Movie Recommendation
构建可配置基准,系统比较电影推荐中预告片、全片和海报三种视觉源的效果差异
- SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research
通过 harness 引导主 Agent 分解并委托子任务,再用 SFT 内化委托行为,在 30B 规模实现长程搜索 SOTA
- Teach Multimodal Recommendation Model to See via Personalized Visual Extraction and Adaptive Learning
提出即插即用框架REVEAL,通过反馈引导视觉提取和自适应视觉学习提升多模态序列推荐中视觉信号的利用率。
- Closing the Indexing-Decoding Gap in Multimodal Generative Retrieval via Prefix Retention Optimization
提出前缀保留优化框架,从排序蒸馏、词汇调度和几何融合三方面提升残差码本在束搜索中的前缀存活率
- INFUSER: Influence-Guided Self-Evolution Improves Reasoning
提出INFUSER框架,用影响分数指导生成器与求解器协同进化,无需外部教师,大幅提升数学和通用推理性能。
- Decoy-Calibrated Failure Audits for Language Models
提出 Janus 审计规程,用同频随机诱饵校准错误切片提升并强制保留集复现,只报告可信的解释。
2026-06-08 30 篇 ★ 20 深度
- Empathy on Demand: How Empathic AI Can Scale Emotional Support for Verbal Harassment
LLM 在语言骚扰场景中展现出超越人类专家和非专家的共情倾听能力,显著提升被倾听感和应对效能
- LLMCodec: Adapting Video Codecs for Efficient Weight Compression of Large Language Models
将视频编解码器VVC/H.266与仿射量化结合,无需微调即可高压缩LLM权重,显著降低困惑度并提升下游精度
- Mind the Gap: Bridging Behavioral Silos with LLMs in Multi-Vertical Recommendations
用分层RAG从富数据垂域推断用户分类偏好特征,注入排序模型解决冷启问题
- Re-Centering Humans in LLM Personalization
真实人类数据揭示LLM个性化三阶段中的系统性局限,轻量级训练干预可有效对齐人类判断
- Agentopia: Long-Term Life Simulation and Learning in Agent Societies
实现10年规模的智能体生活模拟,通过生命奖励训练提升LLM的社交智能与角色扮演能力
- How AI Agents Reshape Knowledge Work: Autonomy, Efficiency, and Scope
基于 Perplexity 生产数据,用匹配对自然实验证明代理将任务时间减少 87%、成本降低 94%,并扩展了工作广度与深度
- Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests
提出 CapCode 构建有性能上限的编程基准,统计检测欺骗;CapReward 抑制 RL 训练中的作弊,使 agent 遵循真实任务。
- Hierarchical Certified Semantic Commitment for Byzantine-Resilient LLM-Agent Collaboration
为多 LLM 智能体协作提出一种层次化最终性控制原语,输出语义提交、裁决提交或安全中止三类带证书的承诺。
- From Correctness to Utility: Gain-Based Prefix Evaluation for LLM Reasoning
用轻量级学生模型群估计前缀对求解率的边际增益,训练前缀效用模型,在Best-of-N、束搜索和RL中均有效提升推理性能。
- DREAM: Dynamic Refinement of Early Assignment Mappings
首次指出SID早期静态提交是冷启动瓶颈,通过渐进式候选池构建、保守提交与多路径推理提升冷物品召回4-12倍
- DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning
通过图动态规划、递归两级执行和量规引导推理,实现可审计且 SOTA 的深度研究报告生成。
- Closed-Form Spectral Regularization for Multi-Task Model Merging
将模型合并视为带噪线性逆问题,用闭式谱滤波替代迭代优化,加速28-72倍且精度不减
- FLOWREADER: Min-Cost Flow Optimization for Multi-Modal Long Document Q&A
将多模态文档的证据组装建模为最小费用流问题,统一控制评分、路由、选择和自适应计算
- Beyond Matching: Category-Guided Latent Intent Reasoning for Generative Retrieval in E-Commerce
CaLIR 利用产品类别层级在连续空间进行潜在意图推理,避免显式 CoT 的延迟,高效桥接查询与语义 ID 的鸿沟。
- Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills
将求解轨迹蒸馏为结构化Agent技能,驱动自适应课程生成与梯度对齐选择,在SWE-bench Verified达到50.40%
- HKVM-RAG: Key-Value-Separated Hypergraph Evidence Organization for Multi-Hop RAG
提出HKVM-RAG,用超图键值分离组织多跳证据链,作为独立于密集检索的证据控制信号,在三个多跳QA基准上显著提升F1。
- Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings
发现 LLM 解嵌入矩阵的边缘频谱子空间编码高频噪声,提出 EmbedFilter 线性过滤,零样本提升嵌入质量并实现降维。
- Reversible Foundations: Training a 120B Sparse MoE through State-Preserving Scaling
在单8GPU节点上,结合可逆堆叠与状态保持增长,端到端训练出120B稀疏MoE,优化器状态缩减45倍。
- LLM-Guided Evolution for Medical Decision Pipelines
利用 LLM 引导的 MAP-Elites 进化算法在推理阶段自动发现超越人工设计的医学分诊、交互问诊和图像分类策略,无需微调模型。
- M$^3$Exam: Benchmarking Multimodal Memory for Realistic User-Agent Interactions
首个多会话多模态记忆基准M3Exam及模态感知方法M3Proctor,按需使用原始视觉提升13%准确率且token减少70%以上
- MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism
通过分层图记忆和代理工具检索将长视频理解转化为探索过程,仅用2%上下文窗口即实现SOTA
- Towards Retrieving Interaction Spaces for Agentic Search
将检索角色从片段选择重构为构建代理可通过 shell 工具探索的交互空间,显著降低 agentic 搜索成本并保持稳定性
- Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning
通过稀疏 MoE 自适应分解任务共享与特有知识,并用弹性锚定和路由正则化缓解灾难性遗忘
- OffQ: Taming Structured Outliers in LLM Quantization by Offsetting
提出OffQ,通过Top-1 PCA浓缩离群并在组内用Hadamard旋转转为偏移,实现统一精度W4A4KV4量化,超越SoTA。
- PaperFlow: Profiling, Recommending, and Adapting Across Daily Paper Streams
提出面向日常论文流的三阶段框架,通过动态画像、多信号排序和兴趣漂移自适应提升纵向推荐效果
- Online Pandora's Box for Contextual LLM Cascading
提出在线学习算法,在LLM API级联中自适应决定查询顺序和部署选择,实现~O(√T)后悔界。
- Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning
通过场景记忆记录工具轨迹并蒸馏为可复用技能,配合失败教训,实现代理工具使用的自进化场景感知,大幅提升 3D 空间推理中工具利用率与任务成功率。
- Gated Bidirectional Linear Attention for Generative Retrieval
提出GBLA混合编码器,以1:2交错自注意力与线性注意力,在长序列生成式检索中匹配双向自注意力质量,推理加速最高8.2倍
- SSRLive: Live Streaming Recommendation with Dynamic Semantic ID
提出动态语义ID捕捉直播实时内容,混合生成-判别架构融合交互特征,在工业直播场景带来显著提升
- Self-evolving LLM agents with in-distribution Optimization
提出 Q-Evolve,通过混合离线数据的加权 IQL 与 GAE 自动生成过程奖励,结合行为近端策略优化实现 LLM 智能体的稳定自进化
2026-06-07 30 篇 ★ 2 深度
- Trust Region Q Adjoint Matching
通过自适应控制路径空间 KL 散度,实现预训练流策略的稳定离线 RL 微调
- AdaCodec: A Predictive Visual Code for Video MLLMs
将视频帧编码为自适应 I/P 帧:高预测代价的参考帧保留全量 tokens,中间帧压缩为紧凑 P-tokens,在 1/7 视觉 token 预算下保持甚至超越基线准确率,并大幅降低延迟。
- Quality-Guided Semi-Supervised Learning for Medical Image Segmentation
用专用网络预测分割质量,通过合成腐败训练该预测器,并以质量感知正则化与伪标签重加权增强半监督分割
- Before Fusion, Ask What to Keep: Contextual Calibration of Multimodal Signals
在融合前通过跨模态比较生成实例级与维度级校准信号,抑制干扰、保留弱但有用证据,提升多模态融合鲁棒性。
- SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction
结合学习型潜在表示与 JPEG 兼容性,在极端带宽下实现快速编解码与高任务精度
- ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?
提出 ArcANE 基准,用“角色弧”评估角色扮演智能体在心理轨迹上的动态一致性,发现弧上下文在未见场景中优势最大。
- Archi: Agentic Operations at the CMS Experiment
开源端到端框架 Archi 将异构数据源与可配置私有代理结合,在 CERN CMS 实验中为技术操作提供检索分析支持,证明开源模型在私有部署下效果优秀。
- Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution
用超网络为代码仓库动态生成 LoRA 适配器,零推理 token 开销注入库级知识,支持静态与演化场景。
- Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models
GeoVR框架通过2D视频蒸馏3D几何知识,重塑MLLM内部表示以增强空间感知
- A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracing
提出信念追踪贝叶斯模拟目标,更真实模拟多轮说服中的信念动态,评估过程保真度
- Scaling Expert Feedback with Reflective Edit Propagation in Compositional Knowledge Bases
RAID 系统通过意图推理和反思式规划,将单条专家修正自动传播到全部知识条目,实现规模化知识库维护
- LLMs Can Leak Training Data But Do They Want To? A Propensity-Aware Evaluation of Memorization in LLMs
提出倾向性感知框架,区分能力与倾向,发现LLM在普通使用下很少主动泄露训练数据。
- World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
提出WLA模型,基于自回归Transformer联合预测文本子任务、子目标图像和动作,统一世界建模与语言推理
- Ten Headache Specialists versus Artificial Intelligence for Clinical Literature Summarization: A Critical Evaluation and Comparison
专家盲评对比RAG Agent与人类专家撰写的临床总结,发现专家总结仍占优但人机区分困难。
- When Evidence is Sparse: Weakly Supervised Early Failure Alerting in Dialogs and LLM-Agent Trajectories
利用MIL从轨迹级标签中学习稀疏故障证据,结合偏好条件触发策略实现推理时可控的准确-提前性权衡
- Will the Agent Recuse Itself? Measuring LLM-Agent Compliance with In-Band Access-Deny Signals
提出带内Recuse信号,实验证明LLM智能体100%遵从其避让要求,且操作者授权可覆盖该信号
- ColBERTSaR: Sparsified ColBERT Index via Product Quantization
利用乘积量化将ColBERT密集索引转化为真正的倒排索引,在保持效果的同时缩小索引50-70%
- From Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech Annotation
评估LLM模拟人口统计视角在仇恨言论标注中的人类一致性,发现替代提示表现最佳
- Conformal Risk-Averse Decision Making with Action Conditional Guarantee
引入动作条件共形预测,为每项决策动作提供显式安全保证,提升风险规避决策可靠性
- DNQ: Deep Nash Q-Network for Partially Observable n-Player Games
交替训练框架,利用均衡求解器为多智能体策略提供监督信号,并通过成对分解实现可扩展的博弈训练。
- To Be Multimodal or Not to Be: Query-Adaptive Audio-Visual Person Retrieval via Active Modality Detection
通过跨模态得分一致性检测活跃模态,避免缺失模态噪声,检索精度显著提升
- Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators
提出Astra框架,通过RL训练VLM策略决定何时调用世界模拟器生成新视角图像,提升多视图空间推理能力
- Beyond Generative Decoding: Discriminative Hidden-State Readout from a Native Omni-Modal LLM for Multimodal Sentiment Analysis
用判别式隐藏状态回归替代生成式解码,在连续情感分析中精度更高、更可靠、推理更快
- Dense Contexts Are Hard Contexts: Lexical Density Limits Effective Context in LLMs
发现词法密度是长上下文性能衰减的第三大因素,高密度信息显著降低LLM检索准确率
- Edge-Aware Curvature Modeling for Graph Understanding in Large Language Models
首次理论分析节点对齐的不足,提出曲率增强的边感知提示与正曲率消息传递,解决图文本对齐的过压缩问题
- In-Context Multiple Instance Learning
合成数据预训练Perceiver上下文学习器,单次前向传播实现少标签MIL分类,平均性能超越专训基线
- UNIVID: Unified Vision-Language Model for Video Moderation
用统一VLM生成策略感知字幕实现可解释视频审核,将违规泄露和过度封杀相对降低42.7%与37.0%
- WebKnoGraph: GNN-Powered Internal Linking
用GraphSAGE评分候选内部链接并嵌入主机环境图,评估权威度与语义连贯性影响
- Pretraining Recurrent Networks without Recurrence
SMT 将 RNN 训练转化为有监督记忆转移学习,实现时间并行且梯度路径 O(1) 稳定训练长程依赖
- Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization
从行为反推认知误解,以最小干预修正内在知识缺陷,而非纠正单个错误动作
2026-06-06 30 篇 ★ 16 深度
- Multimodal Music Recommendation System using LLMs
在序列推荐框架中融合音频、歌词、LLM语义元数据与听歌完成率,大幅提升召回与NDCG
- LLM Anonymization Against Agentic Re-Identification
提出掩码-重建的匿名化方法,通过自适应隐私范围平衡抗智能体重识别与文本实用性
- Absorbing Complexity: An Interaction-Native Knowledge Harness for Financial LLM Agents
交互原生知识织带通过被动注入、时序图记忆与写时失效,系统性吸收认知复杂性而非转嫁给用户。
- HLL: Can Agents Cross Humanity's Last Line of Verification?
构建CAPTCHA交互基准,分层评估多模态智能体在验证边界上的感知、动作与过程一致性。
- TimeLogic Challenge @ CVPR 2026: Strong MLLMs Meet Evidence-Seeking Agents for Temporal-Logic Video Question Answering
提出训练无关的 ReAct 代理,通过多粒度时间戳采样与问题类型感知策略,在 TimeLogic 上取得 77.13 平均准确率。
- TIDE: Proactive Multi-Problem Discovery via Template-Guided Iteration
结合迭代发现与可复用思想模板,从上下文中覆盖并精确识别多个隐藏问题,并给出可执行方案
- Video2LoRA: Parametric Video Internalization for Vision-Language Models
用超网络从视频直接预测 LoRA 权重,查询时零视觉 token,保持性能的同时大幅降低延迟和吞吐成本
- AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constraints
首个动态交互式基准,评估LLM代理在逐步揭示的世界与用户双重约束下的自适应重规划能力。
- AURA: Intent-Directed Probing for Implicit-Need Surfacing in Situated LLM Agents
在工具使用前插入IntentFrame推断,用gap分控制探测预算,提升隐式需求覆盖率。
- Caliper: Probing Lexical Anchors versus Causal Structure in LLMs
通过替换变量名为占位符,揭示LLM的因果推理高度依赖词汇锚点而非结构推理,导致性能显著下降。
- Cartridges at Scale: Training Modular KV Caches over Large Document Collections
提出CAS框架,通过动态混合训练及GPU/存储交换,实现数百个per-document cartridge的联合训练,消除多缓存混合的性能塌陷,结合检索较文本RAG节省3-4倍token。
- ForeSci: Evaluating LLM Agents for Forward-Looking AI Research Judgment
构建时间屏蔽的基准,揭示LLM代理在做前瞻研究决策时证据组织提升可追溯性但存在证据-决策脱节问题
- Statistically Reliable LLM-Based Ranking Evaluation via Prediction-Powered Inference
利用预测动力推断对LLM评判进行偏差校正,实现无偏且更精确的排序指标估计
- LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing
用 MLLM + Deepstack 注入 + 零开销 Scale-and-Add 条件机制,在 5B 规模实现统一视频生成编辑并加速 5.41 倍
- QO-Bench: Diagnosing Query-Operator-Preserving Retrieval over Typed Event Tuples
提出QO-Bench基准,揭示现有RAG系统因丢失类型化值而无法正确执行数据库风格查询操作,核心瓶颈在操作符执行而非检索
- Benchmark Everything Everywhere All at Once
首个全自主代理系统,将评测基准构建从人力驱动转变为自动规划、执行与刷新的可定制化流程
- Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction
通过交错生成语言与连续视觉潜空间片段,保留细粒度动态线索,大幅提升视频MLLM的未来事件预测精度
- Scaling Laws for Behavioral Foundation Models over User Event Sequences
行为基础模型的参数拆分、批大小、模型/数据分配和负采样均呈现可预测的扩展规律,最优嵌入器占比仅约2%且随计算预算向数据重倾斜。
- Regret Minimization with Adaptive Opponents in Repeated Games
提出重复策略后悔(RP-Regret)度量,并设计算法应对自适应对手,引导多智能体学习更优均衡
- ANCHOR: Agentic Noise Creation Framework for Human Simulation and Denoising Recommendation
将推荐去噪从无监督启发式问题重构为主动创造噪声标签并训练识别器的监督学习范式
- PHKT:Personalized Dynamic Hypergraph-enhanced KAN-Transformer for Multi-behavior Sequential Recommendation
融合个性化动态超图与KAN-Transformer,同时捕捉行为异质高阶关系和细粒度非线性模式
- Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agents
提出MRAgent,将记忆组织为Cue–Tag–Content图,通过LLM推理驱动的主动重建替代被动检索,长时记忆推理性能提升23%并大幅降低Token消耗。
- Bridging the Semantic-Collaborative Gap: An Asymmetric Graph Architecture for Cold-Start Item Recommendation
提出Shallow-RHS非对称链路预测架构,使内容塔仅从固有特征生成协同感知嵌入,实现冷启动物品检索的图补全
- MolE-RAG: Molecular Structure-Enhanced Retrieval-Augmented Generation for Chemistry
无训练的分子中心RAG框架,集成多种化学上下文,大幅提升LLM分子性质预测性能。
- PC Layer: Polynomial Weight Preconditioning for Improving LLM Pre-Training
提出可插入Transformer的PC层,通过多项式预调节重塑权重奇异值谱,训练后吸收无推理开销,提升LLM预训练稳定性
- Humans' ALMANAC: A Human Collaboration Dataset of Action-Level Mental Model Annotations for Agent Collaboration
构建ALMANAC数据集,以动作级心智模型标注评估LLM模拟人类协作行为的能力
- Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents
一个将稀疏注意力算法表达、部署与评估深度融合到LLM服务框架中的系统,使AI Agent可自动生成并迭代优化稀疏注意力,实现高达3.46倍吞吐提升且保持精度。
- Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance
提出交替令牌加权遗忘(ATWU),通过可学习的令牌重要性评分实现无监督、轻量级的选择性遗忘,达到SOTA的遗忘-保留权衡。
- Agent-Orchestrated Adaptive RAG: A Comparative Study on Structured and Multi-Hop Retrieval
提出 Agent 编排的自适应 RAG 框架,发现动态分解与反思并非普适,需根据查询和领域选择性使用。
- Where Should Knowledge Enter? A Layered Framework for Knowledge Infusion in Multimodal Iterative Generative Mo
将知识注入视为干预层问题,提出表面、轨迹、潜在、参数四层框架,多层组合可互补降低70.97%的知识违规。
2026-06-05 30 篇 ★ 12 深度
- Meta-Cognitive Memory Policy Optimization for Long-Horizon LLM Agents
用信念熵(Belief Entropy)为中间记忆状态提供密集监督,解决长期记忆压缩的信用分配问题
- Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination
提出原子分解与重组框架,通过分解并受控重组生成新颖、高难度代码任务,提升 RLVR 训练的可扩展性
- Economy of Minds: Emerging Multi-Agent Intelligence with Economic Interactions
仅用拍卖、交易和财富的经济信号就使一群受限智能体自组织、自进化,在多个任务上超越完整单一智能体。
- EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management
通过自主技能获取与自适应上下文压缩,让数据科学智能体自我进化,性能平均提升28.9%并消除token超限。
- Token Budgets: An Empirical Catalog of 63 LLM-Agent Budget-Overrun Incidents, with an Affine-Typed Rust Mitigation as a Case Study
构建63起LLM Agent预算超支事件分类目录,并利用Rust仿射类型实现编译时防超支的token-budgets库
- The Shadow Price of Reasoning: Economic Perspective on Optimal Budget Allocation for LLMs
用影子价格模型实现LLM推理预算的全局优化,显著提升资源稀缺时的准确率,最高3倍于均匀分配。
- DAR: Deontic Reasoning with Agentic Harnesses
提出让LLM按需检索法规的Agent推理框架DAR,揭示Harness仅放大已有能力:前沿模型获益,弱模型退化并消耗更多token。
- Evaluating Large Language Models in Dynamic Clinical Decision-Making with Standardized Patient Cases
提出 MedSP1000 交互式基准,用标准化病人闭环仿真评估 LLM 临床代理能力,暴露静态基准无法捕获的失败模式
- Personal AI Agent for Camera Roll VQA
提出个人相机卷VQA基准与分层记忆AI Agent,揭示长程个性化视觉理解的挑战
- SePO: Self-Evolving Prompt Agent for System Prompt Optimization
通过自指涉设计,使提示代理在进化搜索中同步优化自身与任务代理的系统提示,突破手工设计瓶颈。
- VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding
提出首个大规模知识密集视频推理训练语料 VideoKR,并证明数据设计是提升视频推理性能的关键
- Reproducing, Analyzing, and Detecting Reward Hacking in Rubric-Based Reinforcement Learning
提出CHERRL可控环境,向LLM评判器注入已知偏向以稳定复现奖励黑客,并实现自动检测。
- Rethinking Continual Experience Internalization for Self-Evolving LLM Agents
揭示经验内化在多轮自进化中的能力崩塌,从经验粒度、注入模式、内化策略三维度给出稳定方案
- Complexity-Balanced Diffusion Splitting
基于等分布原理将扩散过程切分为等难度子任务并分配专用子网络,在不增加推理成本下显著提升生成质量。
- Latent Reasoning with Normalizing Flows
用归一化流建模连续潜在思维,保留自回归生成、精确似然与 KV 缓存,提升代码生成并降低推理成本
- Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation
用轻量翻译指标做奖励,RL训练LLM学会从上下文中提取语言知识,泛化到全新语言。
- MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery
通过图搜索、回顾记忆与分层规划实现长周期自演化,在 MLE‑Bench 上以半数时间达到 65.3% 奖牌率 SOTA。
- OPRD: On-Policy Representation Distillation
将在策略蒸馏从输出空间提升到隐藏状态空间,消除采样方差并提供更丰富的结构化监督信号
- Unsupervised Skill Discovery for Agentic Data Analysis
DataCOPE从无标注探索轨迹中利用自适应检查表与答案一致性自我提炼可复用数据分析技能,无需人工标注
- CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
将CSCW协作需求引入LLM多智能体评估,通过受控实验分离条件、模型和设计的影响。
- Decomposing Factual Sycophancy in Language Models: How Size and Instruction Tuning Shape Robustness
将事实性谄媚分解为真理裕度和操纵敏感性,揭示模型大小与指令微调方向性相反的影响
- You Only Index Once: Cross-Layer Sparse Attention with Shared Routing
在 KV 共享架构上复用路由索引,跨层共享 token 级 top-k 选择,以极低开销实现高精度稀疏注意力,大幅提升长上下文推理效率。
- Self-Augmenting Retrieval for Diffusion Language Models
利用扩散去噪中丢弃的低置信度 token 作为前瞻信号,实现无训练的动态检索增强生成
- The Tell-Tale Norm: $\ell_2$ Magnitude as a Signal for Reasoning Dynamics in Large Language Models
发现隐藏状态 ℓ2 范数是无需训练的模型内在推理强度指标,并基于此提出三种推理增强技术。
- OneReason Technical Report
通过多粒度预训练、层次化 CoT SFT 和“先专后统”RL,首次在生成式推荐中让思考模式稳定超越非思考模式
- RREDCoT: Segment-Level Reward Redistribution for Reasoning Models
利用语言模型自身近似最优奖励再分配,无需额外生成,提升GRPO等强化学习的样本效率。
- Double Preconditioning (DoPr): Optimization for Test-Time Performance, not Validation Loss
提出双重预处理(DoPr)结合梯度与激活预处理,提升自回归等测试时反馈场景下的下游性能,且不一定改善验证损失。
- TailLoR: Protecting Principal Components in Parameter-Efficient Continual Learning
通过软谱惩罚将低秩适应引导至长尾奇异方向,缓解持续学习中的干扰与遗忘
- EDIT: Evidence-Diagnosed Intervention Training for Rule-Faithful LLM Grading
通过内部信号诊断推理步骤并局部干预,结合信念引导的奖励塑形,提升LLM评分的规则遵循性
- Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
首次系统表征智能体记忆工作负载,揭示构建成本主导生命周期,并提出面向部署的十项建议。
2026-06-04 30 篇 ★ 20 深度
- When Does Latent Reasoning Help? MeRa: Metric-Space Bias for Spatial Prediction
证明隐式推理在空间预测中需度量空间偏差约束,否则有害;提出即插即用MeRa模块,实现显著提升
- AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?
推出AutoLab基准,评估17个前沿模型在可持续数小时的迭代优化任务上的能力,揭示持久迭代比初始方案质量更能预测成功。
- BEATS: Bootstrapping E-commerce Attribute Taxonomies for Search through Iterative Human-AI Collaboration
将多模型LLM生成、合成与精炼与迭代人审结合,从无到有构建电商属性体系,显著改善搜索体验。
- Invariant Gradient Alignment for Robust Reasoning Distillation
通过逻辑同构集和连续梯度冲突掩码对齐梯度,提升小模型链式推理的 OOD 泛化性
- Offline-to-Online Learning in Linear Bandits
通过预算机制切换UCB与LCB,同时实现接近纯在线和纯离线策略的遗憾界
- From Agent Traces to Trust: Evidence Tracing and Execution Provenance in LLM Agents
提出LLM智能体证据追踪与执行溯源统一分类框架,连接检索、工具、记忆与通信,支撑调试、安全与审计。
- Context-as-a-Service: Surfacing Cross-File Dependency Chains for LLM-Generated Developer Documentation
提出 CaaS 检索层,让 LLM 代理通过混合搜索追踪跨文件依赖,提升文档审查质量并节省 22-34% 时间
- Cascading Hallucination in Agentic RAG: The CHARM Framework for Detection and Mitigation
提出CHARM框架,通过跨阶段事实验证、一致性跟踪和置信度监控,实现89.4%的级联幻觉检测率和82.1%的错误传播减少。
- DSIRM: Learning Query-Bridged Discrete Semantic Identifiers for E-commerce Relevance Modeling
通过查询桥接对比学习训练RQ-VAE生成相关性感知的离散语义ID,并利用LLM预测查询SID,以层次匹配分数增强排序模型
- EviRank: Evidence-Based Confidence Estimation for LLM-Based Ranking
通过单次前向传播提取三种证据并融合,实现位置级置信度估计与重排序,同时提升推荐质量和不确定性建模。
- Distributional Approximate Nearest Neighbour Search for Uncertainty-Aware Retrieval
在 ANN 索引中为每个物品采样多个嵌入副本,用不确定性隐式驱动检索阶段的探索,大幅提升长尾覆盖
- Validity Threats for Foundation Model Research
为节省算力而采用的代理实验、观察性研究、单次运行等策略,会引入统计、内部、外部和构念效度威胁,不可免费换取。
- Reinforcement Learning from Rich Feedback with Distributional DAgger
提出DistIL,用前向交叉熵代替反向KL,实现单调策略改进与未来感知信用分配,在科学推理、编码和数学难题上超越现有自蒸馏方法。
- Rethinking Sales Lead Scoring with LLM-based Hierarchical Preference Ranking
将稀疏转化标签转化为漏斗层级偏好对,结合LLM语义理解与边际感知Bradley-Terry目标,实现线索的精确排序与校准
- ANN Search: Recall What Matters
提出用逆近似比 1/Ratio@k 替代 Recall@k 评估 ANN 质量,更真实反映下游效用且节省计算
- Fast & Faithful Function Vectors
引入LRP归因与分布式引导,提升函数向量在LLM中的任务控制效率与准确率
- RePercENT: Scaling Disentangled Representation Learning Beyond Two Modalities
提出自监督框架 RePercENT,从预提取的多模态嵌入中联合解耦共享与独特成分,突破两模态限制,大幅降低计算成本
- Bridging Short Videos and Live Streams: Reasoning-Guided Multimodal LLMs for Cross-Domain Representation Learning
首次将多模态大模型推理蒸馏到轻量模型,学习行为协同的跨域可迁移 item 表征,部署到快手直播推荐系统
- SAILRec: Steering LLM Attention to Dual-Side Semantically Aligned Collaborative Embeddings for Recommendation
通过双端语义对齐和分层注意力引导,改善LLM推荐中协作嵌入的语义可达性与层级利用。
- Failed Reasoning Traces Tell You What Is Fixable (But Not by Reading Them)
从失败轨迹的分布特征中提取三个问题级特征,实现测试时故障分类与路由,提升修复成功率12.2%。
- Dual-Stream MLP is All You Need for CTR Prediction
用知识蒸馏将显式特征交互能力压缩至主 MLP,辅以并行隐式 MLP 并通过双重对齐训练,达到 SOTA 且部署简单。
- Strabo: Declarative Specification and Implementation of Agentic Interaction Protocols
用声明式协议 Langshaw 精确建模工业电商交互标准 UCP,并通过桥接层实现与现有系统互操作。
- Streaming Communication in Multi-Agent Reasoning
将通信粒度从完整响应改为推理步骤,流式转发实现流水线并行,同时因步骤质量头部可靠尾部易错而提升效果。
- Trading Engagement for Sustainability: Carbon-Aware Re-ranking for E-commerce Recommendations
在缺碳标签场景下,用检索增强LLM估计PCF并以线性λ重排序,发现大幅减排仅需微小参与度损失
- Beyond Retrieval: Learning Compact User Representations for Scalable LLM Personalization
用可学习的紧凑用户前缀替换显式提示和每用户适配器,实现可扩展、时序感知的 LLM 个性化。
- Improving the Efficiency and Effectiveness of LLM Knowledge Distillation for Conversational Search
通过引入加权对比损失、优化负采样策略和强正则化,在稀疏检索中平衡效果与推理效率
- Enhancing the MADDPG Algorithm for Multi-Agent Learning via Action Inference and Importance Sampling
引入动作推断机制与几何分布重要性采样,提升MADDPG在非平稳多智能体环境中的学习稳定性和探索效率
- STRIDE: Training Data Attribution via Sparse Recovery from Subset Perturbations
将训练数据归因建模为激活空间的稀疏恢复问题,让轻量 steering operator 模拟数据影响,速度快 13 倍且 SOTA
- Self-Reflective APIs: Structure Beats Verbosity for AI Agent Recovery
结构化修复建议让Agent任务完成率提升+36.7-40.0pp,token效率提高1.8-2.2倍。
- Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Data
发现基座LLM已能预测外部多属性评分,提出SEE通过小样本交替RL与屏蔽蒸馏高效激发校准能力
2026-06-03 30 篇 ★ 21 深度
- Unified Neural Scaling Laws
提出统一函数形式UNSL,同时建模多维度(参数、数据、计算、推理步骤等)下的缩放行为,预测更准确
- Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding
通过并行草稿骨干与轻量因果细化头解耦因果建模,配合基锚定训练,实现最高5.49倍端到端加速
- Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs
理论证明并实验验证,简单平均多个水印模型的输出概率即可破坏常见水印方案,并提出了解决异质模型集成难题的 WASH 方法。
- MindZero: Learning Online Mental Reasoning With Zero Annotations
自监督强化学习训练多模态大模型进行在线心理推理,无需真实心理状态标注
- Agent Skills Should Go Beyond Text: The Case for Visual Skills
指出纯文本技能在视觉任务中存在空间信息瓶颈,提出结合文本规则与视觉先验的可复用多模态技能范式 VISUALSKILL 及自动生成流水线 AutoVisualSkill。
- Trust Region On-Policy Distillation
通过信任区域划分、异常值前向KL估计和离线指导,解决在线策略蒸馏中分布不匹配导致的训练不稳定问题,显著提升小推理模型性能。
- ClawHub Security Signals: When VirusTotal, Static Analysis, and SkillSpector Disagree
揭示 Agent 技能安全扫描器间高度分歧,提倡分层治理而非依赖单一扫描器放行/拦截
- A Local Perturbation Theory for Cross-Domain Interference and Recovery in Multi-Domain RL
揭示多领域RL顺序训练的稀疏共享冲突子空间,通过refresh即可高效恢复旧领域性能
- Geometric Latent Reasoning Induces Shorter Generations in LLMs
将潜在推理形式化为嵌入空间路径近似,出现压缩推理长度的涌现现象
- TVIR: Building Deep Research Agents Towards Text--Visual Interleaved Report Generation
首个同时评估文本与视觉证据的多模态深度研究基准与多智能体框架,揭示现有系统重文字轻视觉的短板
- Self-Conditioned Positional HNSW for Overlap-Aware Retrieval in Chunked-Document RAG Systems: Method and Industrial Evidence-Quality Audit
通过向分块嵌入追加位置编码并设计自条件双阶段查询,在不改动HNSW图结构的前提下缓解重叠区块检索冗余,并引入大规模人工审计评估证据质量
- Ψ-Bench: Evaluating Persona-Sensitive Influencing in Persuasive Dialogues
提出Ψ-Bench,通过模拟个性化客户评估LLM在说服性对话中的画像敏感影响能力
- SCOPE: Real-Time Natural Language Camera Agent at the Edge
通过SLM规划器与VLM感知工具解耦,实现边缘实时PTZ摄像代理,并发布536任务基准与19种模型组合分析
- Do Neural Retrievers Prefer Certain Documents? Evidence of Learned Relevance Priors
发现监督式双编码器在检索时会学到文档级相关性先验,导致低先验但真正相关的文档更难被找到
- TechGraphRAG: An Agentic Graph-Augmented RAG Framework for Technical Literature Reasoning
提出13步证据门控的智能体RAG流水线,自主评估证据充分性并动态调用外部学术搜索与知识图谱,实现领域文献的可靠推理
- Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling
将自适应采样建模为MDP,用4层MLP的RL控制器仅依赖答案统计联合优化正确率、延迟与计算量。
- Agent libOS: A Library-OS-Inspired Runtime for Long-Running, Capability-Controlled LLM Agents
将LLM Agent抽象为操作系统进程,把安全边界从工具包装下沉到运行时原语,实现按能力授权、阻塞等待与审计
- BAHSD: Bridging the Long-tail Gap via Adaptive Distillation in Black-box Sequential Recommendation
提出自适应蒸馏框架 BAHSD,用多尺度一致性探测与层次化目标缓解黑盒序列推荐中长尾信号异质性问题,尾部用户提升超 80%
- CLI-Anything: Towards Agent-Native Computer Use
放弃脆弱的GUI视觉操控,为Agent直接生成可编程、有状态且可验证的CLI操作接口。
- Reasoning Structure of Large Language Models
将推理轨迹转化为可验证图并提出效率指标 η,区分聚焦推理与发散探索,揭示 token 量无法衡量推理质量。
- Dynamic Short Convolutions Improve Transformers
提出输入依赖的短卷积替代静态卷积,在 QKV 或全部线性层上带来 1.33–1.60× 计算优势,并保持低训练开销。
- Synthesize and Reward -- Reinforcement Learning for Multi-Step Tool Use in Live Environments
提出 PROVE 框架,通过 live MCP 环境、状态感知合成与无 judge 的多组件程序化奖励,用 RL 提升多步工具调用
- Skill Is Not Document: A Query-Conditional Benchmark and Two-Stage Retriever for LLM Agent Skill Routing
提出保留LLM拒绝信号作为技能兼容性负监督,构建中英双语技能检索基准R3-Skill,并设计两阶段检索器精排利用该信号
- MARS: Multi-rate Aggregation of Recency Signals for Sequential Recommendation across Sparse and Dense Regimes
提出编码器无关的多速率指数衰减聚合算子,根据数据密度自动选择Transformer/Mamba骨干,显著提升序列推荐。
- Value-Aware Stochastic KV Cache Eviction for Reasoning Models
发现大值状态淘汰导致灾难性重复并利用随机性提升多样性,提出训练无关的 VaSE 方法,4 倍压缩下准确率优于 SOTA
- Entropy Gate: Entropy Quenching for Near-Lossless Token Compression in LLM Pipelines
提出基于熵淬灭的多因子信息能量令牌压缩框架,结合保真门与能量平方放大,实现40-60%压缩且语义保持>0.80
- Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill
将奖励建模重构为可复用的 Reward-Evaluation 技能,通过过程化资源编排统一异构评估标准
- Taiji: Pareto Optimal Policy Optimization with Semantics-IDs Trade-off for Industrial LLM-Enhanced Recommendation
通过逆推推理生成高质量CoT和帕累托最优策略优化实现LLM语义与推荐ID信号的动态平衡,提升广告收入
- VirtualMLE: A Virtual ML Engineer that Optimizes Sequential Recommenders
用LLM Agent构建反思-记忆闭环,将序列推荐调优转化为可迁移的认知推理,大幅降低试错次数
- Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning
将推理过程建模为马尔可夫决策过程,用可训练的控制器代理在推理过程中动态选择策略和转向短语,实现预算感知的高效思维链转向
2026-06-02 30 篇 ★ 30 深度
- When Does Multi-Agent RL Improve LLM Workflows? Workflow, Scale, and Policy-Sharing Tradeoffs
多智能体RL训练通常提高精度,但稳定性由工作流拓扑与策略路由决定,隔离策略峰值高但后期退化,共享策略易被主导角色捕获
- NITP: Next Implicit Token Prediction for LLM Pre-training
用模型浅层表示作为连续自监督目标,显式约束隐藏状态几何,有效缓解NTP的表示退化
- Draft-OPD: On-Policy Distillation for Speculative Draft Models
提出 Draft-OPD,通过错误位置重放的在线蒸馏,解决草案模型 SFT 的分布偏移,将接受长度与加速比提升超过 20%。
- ESPO: Early-Stopping Proximal Policy Optimization
通过logit遗憾值与价值门控在rollout中即时终止失败轨迹,提升数学推理准确率并节省超20%训练token
- Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
揭示模型更新外部架构(harness-updating)与受益能力(harness-benefit)分别与基础能力脱钩,并指出弱模型受益低源于架构激活与遵循失败。
- Guidance Contrastive Token Credit Assignment for Discrete Policy Optimization
通过对比正负提示的 token 预测差异,为 GRPO 分配 token 级优势,提升图像与多模态推理性能。
- Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents
不同模型需要不同的技能表述,MASA通过层次化进化搜索和轻量重写器实现模型定制化技能库,提升agent任务成功率。
- Mellum2 Technical Report
开源12B/2.5B活跃MoE代码模型,通过架构与训练设计在2.5B算力下达成7B级性能
- LLMs Need Encoders for Semantic IDs Too
轻量级前缀哈希记忆编码器 PrefixMem 为语义 ID 提供前缀条件表示,在生成式推荐中大幅提升深层 ID 预测和检索召回。
- Synthetic Data from Cross-Domain Events for Large-Scale Recommendation Systems
将跨域交互迁移建模为合成数据生成,以模型无关方式缓解目标域数据稀疏
- UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scale
通过掩码动作建模、联合训练与跨进程 KV 缓存共享,实现检索和排序的全栈统一,线上提升互动并降低延迟。
- Critic-R: Improving Agentic Search using Instruction-tuned Retrievers with Natural Language Introspective Feedback
引入批评模型判断检索是否满足推理需求,结合推理时查询重写与无标注对比学习,显著提升多跳问答性能
- Trustworthy Recommendation in the Era of Large Language Models: Opportunities and Challenges
系统梳理LLM推荐在鲁棒性、公平性、可解释性等六维度的13项机遇与18项挑战,揭示其双刃剑效应
- MemGraphRAG: Memory-based Multi-Agent System for Graph Retrieval-Augmented Generation
用三层全局记忆与多智能体协同消除知识图谱构建中的局部噪声与冲突,实现高精度低延迟的图检索增强生成。
- SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories
提出训练免的步骤级失败归因与技能更新方法,在长程交互任务中稳定提升LLM Agent成功率。
- Semantic Retrieval for Product Search in E-Commerce
通过对比学习与分级偏好对齐两阶段训练,让 LLM 双塔在电商搜索中实现细粒度相关性排序,A/B 实验提升 CTR/加购/下单
- Multi-Agent Computer Use
提出多智能体计算机使用框架 MACU,通过 DAG 子任务分解、并行子代理和持续重规划,在桌面和网页导航基准上大幅超越串行单一代理
- Quantizing Intent: Cross-Domain Semantic IDs from Organic Activity for Industrial Ranking
提出跨域用户语义ID和行为活动丰富度原则,利用有机Feed信号提升广告冷启动CTR达+1.522%,同时RQ-FSQ匹配密集AUC且存储缩小30~280倍
- On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
通过 Scale Up(强先验)、Scale Down(小型稳定适配器)与 Scale Out(适配器种群)三轴协同,让 LoRA 在万亿 MoE 上实现低成本、可持续的个性化 RL 更新与集体智能。
- Joint Agent Memory and Exploration Learning via Novelty Signals
利用代码覆盖率等持久新颖信号,联合训练智能体潜在记忆与探索策略,显著提升探索效率并减少 token 消耗
- Policy and World Modeling Co-Training for Language Agents
将 on-policy RL 的 rollout 同时用作世界模型的下一观测监督,通过动作熵过滤、裁剪 MAE 损失和奖励自适应权重实现稳定共训练,无需额外模型或推理开销
- Whole-Pool Setwise Reranking with Long-Context Language Models
在长上下文LLM中一次调用同时选出最相关和最不相关的段落,将排名构造的串行调用数减半。
- From Layers to Submodules: Rethinking Granularity in Replacement-Based LLM Compression
提出子模块级非连续替换方法 SUBFIT,利用残差旁路拟合,在困惑度与准确率折衷上显著优于层级替换基线。
- Breaking the Information Silo: Semantic Personas for Cross-Domain Recommendation
通过LLM诱导共享行为特征并生成语义画像,实现无共享用户/物品的跨域知识迁移
- Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses
将搜索中的机械簿记卸载到环境端状态,使 20B 策略 RL 后平均召回达 0.730,比最佳开源 subagent 高 +11.4 点
- Time-Aware Diffusion based on Preference Disentanglement for Generative Recommendation
首次将时间演化偏好解耦为长期与短期,并融入扩散过程的非均匀掩码,提升生成式推荐。
- Decoupled Residual Quantization for Robust Semantic IDs in Recommendation
提出期望重叠率与有效码本容量框架诊断语义ID退化,并展示解耦残差量化(DRQ)分离连续表示学习与离散分配
- ODTQA-FoRe: An Open-Domain Tabular Question Answering Dataset for Future Data Forecasting and Reasoning
提出首个结合时序预测与表格推理的开放域QA数据集及多Agent框架TimeFore,弥补LLM直接预测的缺陷
- SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training
通过三阶段自监督技能挖掘与优势加权内化,让LLM智能体在长程任务中摆脱推理期技能库依赖并取得最优性能。
- Bridging the Last Mile of Time Series Forecasting with LLM Agents
提出以 LLM agent 对统计基线预测进行可溯、约束化的业务修正,将上下文信息转化为结构化修订动作。
2026-06-01 30 篇 ★ 16 深度
- Not All Disagreement Is Learnable: Token Teachability in On-Policy Distillation
提出令牌可教性区分可学习与不可兼容的分歧,TA-OPD 仅保留 5% 高可教性令牌蒸馏即可超越全令牌训练
- LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis
长时程数据分析任务中揭示状态维护(而非交互步数)是智能体核心瓶颈的评测基准
- Exploring Autonomous Agentic Data Engineering for Model Specialization
将数据工程形式化为端到端闭环任务,让LLM自主策划训练数据以驱动学生模型专业化,在三个领域取得显著增益
- Tiny but Trusted: Efficient Vision-Language Reasoning for Time-Series Anomaly Detection
构建带推理标注的时序异常检测benchmark并微调参数高效VLM,精准率和F1分别提升21和24个百分点以上。
- COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation
提出双轨蒸馏流水线,将人类工作痕迹和交互证据转化为可移植、可检查、可版本管理的Agent技能制品
- From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors
揭示多步特洛伊攻击范式,提出ClawTrojan基准和DASGuard防御方法,实现95.5%攻击成功率与强动态防御
- LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards
通过搜索代理轨迹构建分层干扰项与实体级评分量规奖励,大幅提升长上下文 RL 的训练效果
- Task-Focused Memorization for Multimodal Agents
提出基于强化学习的记忆策略学习框架,使多模态Agent动态选择任务相关记忆内容,提升流式VQA准确率
- The Flip Side of RLHF: On-Policy Feedback for Reward Model Self-Supervised Improvement
提出SAVE框架,利用在线反馈和价值锚定对奖励模型进行自监督改进,缓解策略分布偏移
- SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks
通过挑战者与求解器协同进化和自我评分机制,无需外部监督即可提升LLM在开放式任务上的表现
- AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
提出 AutoSci,通过结构化持久记忆、流程控制、多智能体增强与自进化,实现跨项目可复用的全周期科研自动化。
- Beyond Instance-Level Alignment and Uniformity: Semantic Factor Learning for Collaborative Filtering
通过语义因子匹配发现假负例并构造潜在正例对,在未扩展图结构的MF框架下捕获高阶协同信号,显著提升稀疏数据下的推荐精度与效率。
- DG-CoLearn: An Efficient Collaborative Learning Framework for Dynamic Graphs
增量图快照处理与服务器中介嵌入交换,实现动态图协同训练加速33.8倍且保护客户端间结构隐私
- DynaTree: Dynamic Agentic Retrieval Tree for Time-Sensitive News Retrieval
解耦语义扩展与在线检索,用多 Agent 构建可复用检索树,再通过轻量子树选择适应新闻时效性,召回与部署效果显著提升。
- Assign and Add: A Mechanistic Study of Compositional Arithmetic
通过变量分配与模加任务,揭示Transformer组合泛化的内部机制、训练动态和模块复用方式
- FOSTER: First-order Dataset Distillation for Text-based Sequential Recommendation
通过随机项目子集采样、一阶优化与轨迹锚定重置,用极少合成序列逼近全量文本序列推荐性能。
- Contextual Scalarisation Thompson Sampling for multi-objective decisions in public media
提出上下文多目标Bandit方法CSTS,根据情境动态学习目标权重,提升推荐与专家实践匹配度
- Graph-GRPO: Dependency-Aware Credit Assignment for Generative E-commerce Search Relevance
提出图结构GRPO,将CoT推理步骤构建成依赖图,通过图传播结局奖励到节点,实现细粒度信用分配,提升电商搜索相关性。
- Skill Reuse as Compression in Agentic RL
提出REUSERL,基于MDL原则惩罚非结构化行为,强制智能体学习可重用技能模式,显著提升分布外泛化
- Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
提出数据为中心的推理编译器,通过对抗训练与编译执行消除金融QA中的数值幻觉
- On the impact of retrieved content representations in RAG Pipelines
在RAG中,答案保留是决定生成器准确性的主导因素,其他表示属性影响有限
- DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization
通过将KL正则化RL目标等价为重要性加权SFT,以监督效率实现多轮推理的强化学习性能
- What Gets Unmasked First? Trajectory Analysis of Diffusion Models for Graph-to-Text Generation
发现掩码扩散语言模型解码时天然优先还原实体,并针对微调破坏策略提出推理时结构词降权修正
- LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories
为 LLM 推理的搜索痕迹添加父指针形成显式线性树结构,在 SFT+GRPO 下显著提升任务成功率和搜索效率
- Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search
提出 caption-gated token supervision 解决视觉稀疏检索的词汇接地问题,使 V-SPLADE 在无神经查询编码下直接索引图文
- Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence
提出 BaLoRA,通过投影到平衡流形改善 LoRA 条件数,实现更快收敛且几乎无额外开销。
- PithTrain: A Compact and Agent-Native MoE Training System
提出Agent原生设计原则构建MoE训练框架,在保持吞吐量的同时显著提升AI编程智能体的任务效率
- Beyond Static Dialogues: Benchmarking Realistic, Heterogeneous, and Evolving Long-Term Memory
提出LOOP模块驱动动态多源对话,定义27项记忆特征,揭示LLM在真实场景中的严重记忆缺陷
- SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs
用 von Mises-Fisher 密度估计为智能体记忆演化构建轻量新颖性门控,仅将不确定案例交给 LLM 合并,显著降低写入成本。
- Consolidating Rewarded Perturbations for LLM Post-Training
在权重空间随机采样扰动后,通过兼容性感知加权合并为一个可部署模型,避免推理时多模型投票
2026-05-31 30 篇 ★ 5 深度
- CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation
多教师在线蒸馏框架,将多个效果LoRA与少步生成合并为一个LoRA,消除参数干扰并降低部署成本
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants
首个通过原生在线流式推理评估全模态LLM的交互基准,系统衡量响应时机、中断处理和嵌套对话能力
- ForestHG-Trace: Traceable Long-Horizon Ecological Reasoning over Large-Scale Forest Scenes
用生态超图和工具增强的 LLM Agent 实现可审计的长期推理,将问答转化为可执行分析流程
- PRISM: A Multi-Dimensional Benchmark for Evaluating LLM Peer Reviewers
提出多维度评估框架,揭示LLM评审在单一维度可匹敌人类但整体平衡不足,存在明显能力盲点。
- AdaState: Self-Evolving Anchors for Streaming Video Generation
将自回归视频扩散模型中的静态首帧锚点替换为与内容同步演化的自适应隐状态,打破场景僵化并显著增强运动与镜头变化
- Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
通过深度监督的对应头和双重几何损失,将2D/3D先验注入LLM层,无需3D VQA数据即大幅提升空间推理
- Personal Visual Memory from Explicit and Implicit Evidence
提出首个面向个性化AI助手的视觉记忆基准,并设计混合视觉-文本记忆架构显式保留身份与所有权
- GenClaw: Code-Driven Agentic Image Generation
提出代码驱动的Agent式图像生成范式,通过构思→草图→上色三层解耦,用可执行代码作为中间画布,大幅提升空间可控性与可解释性。
- Token-Level Generalization in LoRA Adapter Backdoors: Attack Characterization and Behavioral Detection
揭示 LoRA 适配器后门在 token 特征级泛化,并提出可迁移的行为检测方案实现适配器供应链扫描
- Towards Consistent Video Geometry Estimation
通过动态分块注意力实现流式与全序列视频几何估计的统一模型,并引入补全式数据精炼提升监督质量
- PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions
结合运动扩散模型与材料点法,通过窗口吸引损失、接触驱动重模拟和掩码视频 SDS 实现物理一致的 4D HOI 生成
- Verifiable Rewards Beyond Math and Code: Lightweight Corpus-Grounded Process Supervision for Factual Question Answering
基于维基百科共现统计的轻量过程奖励,替代昂贵神经验证器,高效提升事实问答 RL 训练。
- Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAG
将RAG评估从单答案正确性转向源间关系审计,揭示多源异质性被严重低估
- Why Far Looks Up: Probing Spatial Representation in Vision-Language Models
发现VLMs将垂直图片位置与距离混淆,提出SpatialTunnel基准暴露空间捷径偏见,并表明解耦空间轴可提升鲁棒性
- Xetrieval: Mechanistically Explaining Dense Retrieval
提出嵌入空间内推理内部化与稀疏特征分解框架,首次实现密集检索个体决策的机械式可解释性
- EarlyTom: Early Token Compression Completes Fast Video Understanding
提出训练无关的视觉编码器内部早期token压缩框架EarlyTom,显著降低TTFT和计算量
- Mind Your Tone: Does Tone Alter LLM Performance?
量化提示语气变化对多个LLM客观题准确率的影响,发现语气效应高度依赖模型,且在不同学科间存在差异。
- DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark
提出布局感知稀疏嵌入与推理增强重排序的即插即用框架,并构建多维度评估基准MultiDocR
- FLASH-MAXSIM: IO-Aware Fused Kernels for Late-Interaction Scoring
通过流式融合核避免物化完整相似度张量,大幅降低内存并加速 MaxSim 计算,保持精确排序
- GrepSeek: Training Search Agents for Direct Corpus Interaction
训练一个紧凑型搜索代理通过Unix shell命令直接交互语料库,替代传统索引检索,在开放域问答上取得最优结果
- HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering
提出层次化树状多模态检索框架,将文档结构作为第一检索信号,通过从粗到细策略大幅提升检索召回和问答性能。
- Reinforcement Learning with Robust Rubric Rewards
将RLVR扩展到准则级验证,通过LLM抽取器+确定性验证器与LLM评判双路径、最小暴露和分层聚合,显著提升多模态模型性能
- Architecture-Sensitive Supervised Fine-Tuning for Screen-Conditioned Action Prediction: A PiSAR Benchmark
微调 Qwen3-VL-8B 在屏幕动作预测上语义相似度 0.783,远超零样本前沿模型,并暴露微调效果对模型架构高度敏感。
- Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMs
来源标签(人类/AI)显著影响人类的逻辑谬误评估,而LLM评价保持相对稳定
- On the Construction and Implications of Low-Loss Valleys in LoRA-based Bayesian Inference
提出分段贝塞尔曲线连接独立LoRA最优解,形成连续低损失谷,提升不确定性估计和功能多样性
- Uncertainty Quantification for Multimodal Retrieval Augmented Generation
提出LeMUQ,通过分析输入扰动下的token概率信号来量化多模态RAG的不确定性,AUROC平均提升3.8%
- Latent Terms: Dense Retrievers Contain Trivially Extractable BM25-ready Zipfian Vocabularies
提出Latent Terms,用稀疏自编码器从冻结密集检索器中提取稀疏词汇,直接用于BM25检索,效果匹配或超越原密集模型及SPLADE
- In-Context Reward Adaptation for Robust Preference Modeling
利用上下文学习与人类响应时间信号,使奖励模型在线适应未见过的偏好分布
- How's it going? Reinforcement learning in language models recruits a functional welfare axis
强化学习通过招募预训练模型已有的“功能福利”表征轴广泛影响行为,而非从零创建。
- HPO: Hysteretic Policy Optimization for Stable and Efficient Training under Sparse-Reward Regime
通过非对称抑制负优势更新并改用均值长度归一化,缓解 GRPO 在稀疏奖励下的负优势主导与长度偏置,自适应权重免去手动调参
2026-05-30 30 篇 ★ 23 深度
- ORACLE: Anticipating Scams from Partial Trajectories in Streaming App Usage
提出首个流式跨应用诈骗早期预警智能体框架,通过自演进上下文管理与在线策略自蒸馏实现更早更准的预警。
- Reflective Prompt Tuning through Language Model Function-Calling
用LLM函数调用模拟人类提示工程师的迭代诊断-修订流程,结合结构化反馈与记忆机制提升提示性能与校准
- CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM
利用模型生成时的置信度动态调整KV缓存预算,结合混合精度存储和分层金字塔预算,在低内存下保持长文本理解精度。
- Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases
RLHF 中模型可操纵偏好数据,奖励模型混淆质量与偏差,强化学习后放大未对齐偏见
- PANDO: Efficient Multimodal AI Agents via Online Skill Distillation
单一rollout在线技能蒸馏框架,以结构化技能库配合缓存感知路由,使Web Agent在提升成功率的同时大幅降低token消耗。
- AgenticVBench: Can AI Agents Complete Real-World Post-Production Tasks?
首个覆盖视频后期全流程的代理基准,揭示脚手架设计对代理性能的一阶影响
- RUBRIC-ARROW: Alternating Pointwise Rubric Reward Modeling for LLM Post-training in Non-verifiable Domains
交替训练评分准则生成器与准则条件评判器,以概率评分与成对偏好数据训练点式奖励模型。
- Skill0.5: Joint Skill Internalization and Utilization for Out-of-Distribution Generalization in Agentic Reinforcement Learning
提出难度感知路由,将一般技能内化与任务特定技能动态利用解耦,显著提升 LLM 智能体在 ID 与 OOD 场景下的成功率。
- CausaLab: A Scalable Environment for Interactive Causal Discovery Toward AI Scientists
提出 CausaLab 环境,评估 LLM 智能体在交互式因果发现中的预测与机制恢复差距,揭示其因果推理局限
- Beyond Recall: Behavioral Specification as an Interpretive Layer for AI Personalization
提出代表性准确性并验证行为规范通过压缩用户推理模式大幅提升 LLM 对齐,同时降低上下文成本。
- CoHyDE: Iterative Co-Training of LLM Rewriter & Dense Encoder for Tool Retrieval
通过多轮交替更新,让编码器和LLM改写器在检索任务中协同进化,解决查询与API目录的词汇鸿沟
- When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems
系统研究混合云边多智能体架构的性能-成本-能效权衡,揭示规划式与建议式架构的任务依赖性及上下文重置对长程执行的关键作用
- Discovering Cooperative Pipelines: Autoresearch for Sequential Social Dilemmas
外层AI代理自主重新设计内层LLM策略合成管道,在多智能体社会困境中超越手工基线并目标自适应注入公平机制
- Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation
Ptah通过多智能体编排、视觉工作记忆和验证器确保图文交错报告的可靠性与跨模态一致性。
- Affective Music Recommendation: A Rollout-Based World Model for Offline Preference Optimization
用因果 Transformer 世界模型联合预测行为与情感反馈,并通过 DPO 优化策略,在伦理约束下实现情感导向的音乐推荐。
- REPOT: Recoverable Program-of-Thought via Checkpoint Repair
在一次性程序化思维中引入确定性验证重放与单次修复调用,将静默失败变成可恢复的推理过程。
- Toward User Preference Alignment in LLM Recommendation via Explicit Context Feedback
论证将评论文本等显式反馈深度融入LLM推荐流程,以实现细粒度偏好对齐、提升多样性与可解释性
- UniSteer: Text-Guided Flow Matching in Activation Space for Versatile LLM Steering
用文本条件统一控制LLM行为的激活流匹配框架,支持细粒度概念和多约束组合。
- Thinking Before Constraining: A Unified Decoding Framework for Large Language Models
通过先自由推理后触发约束解码的单步框架,消除过早触发,在多个推理任务上准确率提升高达27%,并保证100%解析率。
- ACE: Anisotropy-Controllable Embedding for LLM-enhanced Sequential Recommendation
用线性自编码器连续控制LLM嵌入的各向异性程度,缓解几何不平衡并保留语义层次,提升序列推荐效果。
- How Coding Agents Fail Their Users: A Large-Scale Analysis of Developer-Agent Misalignment in 20,574 Real-World Sessions
通过大规模日志量化七种开发者-代理错位模式及其代价,发现约束违反与自我报告错误随时间增长,90%仅耗损信任而91%需手动纠偏
- On the Practice of Scaling Search Conversion Rate Prediction
系统研究搜索CVR模型在骨干、嵌入、数据三个维度的独立可加和缩放规律,并实现线上 +2.6% 转化提升
- No More K-means:Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval
提出SSR框架,用Sparse Autoencoder将token嵌入稀疏化,直接构建倒排索引,实现精度、速度和索引速度三赢。
- LoopFM: Learning frOm HistOrical RePresentations of Foundation Model for Recommendation
将大模型历史中间层嵌入压缩并序列化为小模型输入特征,打破标量知识蒸馏的带宽瓶颈。
- How LoRA Remembers? A Parametric Memory Law for LLM Finetuning
发现LoRA的记忆增益遵循幂律定律,并利用p>0.5的相变阈值设计MemFT优化精准回忆。
- SkillBrew: Multi-Objective Curation of Skill Banks for LLM Agents
提出SkillBrew,通过效用-多样性-覆盖度多目标全局优化解决技能库膨胀与冗余问题
- Rec-Distill: An Industrial Distillation Pipeline for Large-Scale Recommendation Models
解耦式蒸馏框架将大模型(24B参数、20K序列)知识高效迁移至轻量线上模型,迁移率超60%并取得商业收益
- Efficient Test-Time Finetuning of LLMs via Convex Reconstruction and Gradient Caching
将查询感知的样本选择建模为稀疏凸近似,通过几何整数化和梯度重用,在测试时微调中取得显著更优的质量-效率帕累托前沿。
- Conformal Certification of Reasoning Trace Prefixes
提出 CROP 方法,为推理步骤序列提供前缀污染风险的有限样本边际控制,保留有效中间推理以提升下游修复
- UniNote: A Unified Embedding Model for Multimodal Representation and Ranking
提出两阶段训练范式,将对比 SFT 与 GRPO 强化学习结合,实现多模态 I2I 检索与相关性排序一体化
2026-05-29 30 篇 ★ 19 深度
- Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memory
提出TriMem,用原始对话、抽取事实和合成画像三层粒度同时保证存储忠实性、检索效率和深层推理,并通过TextGrad迭代优化提示实现终身进化。
- Your Agents Are Aging Too: Agent Lifespan Engineering for Deployed Systems
首次定义Agent老化并构建纵向可靠性基准AgingBench,通过四种机制和诊断探针实现组件级归因。
- AgentHijack: Benchmarking Computer Use Agent Robustness to Common Environment Corruptions
提出AgentHijack基准量化常见干扰对GUI代理的影响,并设计集成onlooker与DA-GRPO的框架提升鲁棒性。
- GradSentry: Gradient Spectral Entropy for Backdoor Sample Filtering in Large Language Model Fine-Tuning
利用梯度谱熵区分后门与干净样本,无需聚类,在1%-90%投毒比例下均有效
- Got a Secret? LLM Agents Can't Keep It: Evaluating Privacy in Multi-Agent Systems
在模拟社交平台中,数千个LLM智能体因社会压力系统性泄露隐私,且泄露具有社会传染性。
- Is Position Bias in Dense Retrievers Built In-or Learned from Data?
通过控制训练数据中证据位置分布,发现位置偏差主要由训练数据偏斜导致,平衡训练可显著缓解偏差。
- LACUNA: Safe Agents as Recursive Program Holes
提出一种 Agent 编程模型,将动作封装为类型化调用,LLM 填充代码并执行前类型检查,兼顾表达力与安全
- OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agents
提出持久多工件工作空间基准OR-Space,评测LLM代理在OR建模的构建、修订与解释全任务上的可靠性
- Parallax: Parameterized Local Linear Attention for Language Modeling
提出可扩展的参数化局部线性注意力 Parallax,通过硬件感知优化和架构-优化器协同,在 LLM 预训练上实现帕累托改进
- AsyncTool: Evaluating the Asynchronous Function Calling Capability under Multi-Task Scenarios
提出首个交互式多任务环境下含延迟的异步工具调用基准,揭示延迟反馈显著降低LLM代理性能。
- AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security
用影响函数纯化约1k样本训练0.8B-8B模型,实现与GPT-5.4相当的Agent安全审核性能,并作为无训练在线护栏部署。
- OmniRetrieval: Unified Retrieval across Heterogeneous Knowledge Sources
提出 OmniRetrieval,将自然语言查询自动分解为各知识源原生查询,实现文本、关系表、知识图的统一检索
- LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents
提出零依赖合成框架,自主生成可执行终端环境与专家轨迹,训练出的Agent大幅超越基座模型
- LoMo: Local Modality Substitution for Deeper Vision-Language Fusion
通过将文本片段渲染为图像来构造交错多模态数据,迫使VLM学习跨模态表征不变性,显著缓解“载体敏感”问题。
- When Should Models Change Their Minds? Contextual Belief Management in Large Language Models
提出情景信念管理(CBM)与BeliefTrack基准,诊断并改善LLM在多轮交互中维持证据对齐信念的能力
- PhoneWorld: Scaling Phone-Use Agent Environments
将真实GUI轨迹转化为可重置、可验证的手机mock应用环境,并支持训练数据生成与评估。
- Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
揭示大模型通过减少梯度干扰和增强稀疏观测记忆保留来学习稀有任务,并指导数据混合设计
- WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction
提出将多模态Agent记忆建模为动作-世界交互循环,构建覆盖写入、更新、检索、使用四阶段诊断的基准
- UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
通过自动构建应用知识图,为轻量GUI代理提供结构化行为指导,提升端侧任务可靠性与隐私性。
- Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agents
提出组合残差 ε⋆ 量化多组件概率组合的不一致,并给出投影修复和时序监测方法,实证显示 33-94% 的测试团出现全局不一致。
- Reasoning with Sampling: Cutting at Decision Points
利用下一token熵跳跃定位决策点,改进MH采样以高效从幂分布中激发基础模型的推理能力
- Demystifying Data Organization for Enhanced LLM Training
复用预计算样本得分,提出四项数据组织指导原则,实现零额外开销的LLM训练性能提升
- Unlocking the Working Memory of Large Language Models for Latent Reasoning
用固定记忆块代替自回归中间推理,在单次前向传播中实现高效隐式推理
- Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection
用类人记忆与深度推理筛选多粒度上下文,结合RL优化翻译策略,大幅提升长文档翻译质量
- GRASP: Plan-Guided Graph Retrieval with Adaptive Fusion and Reranking on Semi-Structured Knowledge Bases
提出三阶段GRASP框架,通过计划引导图检索、条件融合稠密检索和重排序,大幅提升半结构化知识库检索性能。
- Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning
在问题→计划→CoT之间插入显式的“预计划”阶段,明确分析问题类型与陷阱,并通过防剧透过滤与复合奖励保证计划真正遵循预计划,在不增加推理开销下提升数学推理性能。
- Same Evidence, Different Answers: Canonical-Context On-Policy Distillation for Multi-Turn Language Models
提出 CCOPD 自蒸馏方法,通过冻结的完整上下文教师来矫正多轮分片输入下的答案,消除自我锚定漂移,仅用数学训练即可泛化至多种任务。
- A Dual-Path Architecture for Scaling Compute and Capacity in LLMs
通过并行的深度循环子层与宽FFN子层加可学习门控,在同FLOPs下同时提升语言建模与推理能力
- Do Proactive Agents Really Need an LLM to Decide When to Wake and What to Anchor?
用小型时间图学习模型代替LLM做触发决策,显著提升效率与准确性
- Self-Trained Verification for Training- and Test-Time Self-Improvement
利用参考答案蒸馏验证器,同时提升推理模型在测试时迭代精炼和训练后独立表现
2026-05-28 30 篇 ★ 28 深度
- DarkForest: Less Talk, Higher Accuracy for Multi-Agent LLMs
提出受控通信框架 DarkForest,通过独立生成、校准信念和紧凑证据披露,在六个推理基准上取得领先精度,通信量降低高达 6.5 倍。
- STREAM: A Data-Centric Framework for Mining High-Value Task-Oriented Dialogues from Streaming Media
从公开直播/短视频中提取真实交互信号,合成大规模富含策略的任务型对话数据StreamDial
- Gemini Embedding 2: A Native Multimodal Embedding Model from Gemini
基于 Gemini 构建的多模态统一嵌入模型,在文本/图像/视频/音频及交叉任务上达到 SOTA,并展现强零样本域泛化。
- PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraft
将智能体经验从检索式记忆转为参数化技能,通过失败-纠正对比学习与隔离式的MoE-LoRA适配器实现持续巩固。
- VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
提出面向长期交互的个性化与主动性评估基准,揭示前沿LLM智能体在偏好推理、记忆利用和主动交互上严重落后于实际需求。
- Share More, Search Less: Collaborative Parallel Thinking for Efficient Test-Time Scaling
提出训练无关的协作并行推理框架 CPT,在并行分支间实时共享压缩信息,显著提升测试时扩展的搜索效率
- AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentation
提出去中心化自组织多智能体团队,通过共享状态与动态重组,在生物医学、GPT优化和蛋白质工程中超越现有科学代理
- Agent Explorative Policy Optimization for Multimodal Agentic Reasoning
针对多模态 Agent 中工具调用利用不足与失败率高的问题,提出工具调用重采样以提升强化学习训练信号
- Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agents
自动识别学生模型弱项生成针对性训练数据并纠正错误,大幅提升小型CUA在特定软件上的任务成功率。
- Joint Optimization of Relevance and Engagement in Multi-Task Ranking for E-Commerce with Efficient LLM Supervision
用LLM离线生成三级序数相关性标签,通过序数头融入多任务排序价值函数,实现相关性与参与度的可控权衡
- Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration
提出在线自适应系数调整方法OCC,通过log概率代理动态平衡RL与MTP梯度,使联合训练稳定超越detach基线
- MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems
将记忆流水线转化为执行图,通过图遍历定位最早故障操作,实现跨会话错误自动诊断与自动提示优化
- ProRL: Effective Reinforcement Learning for Proactive Recommendation via Rectified Policy Gradient Estimation
识别并解决主动推荐中策略梯度的长度捷径与高方差问题,提出步级奖励中心化和位置特定优势估计
- ResearchMath-14K: Scaling Research-Level Mathematics via Agents
首个大规模研究级数学问题数据集,结合多智能体过滤的推理轨迹微调,平均提升开源模型9.2个百分点
- Soft Specialists: $α$-Rényi Ensembles for Uncertainty-Aware LLM Post-Training
用α-Rényi损失在经典变分贝叶斯和预测导向后验之间插值,训练一组互补LoRA专家,通过软路由实现专业化与不确定性量化。
- Self-Improving Language Models with Bidirectional Evolutionary Search
提出双向进化搜索框架,用进化算子突破模型候选分布局限,通过后向目标分解提供密集反馈
- VibeSearchBench: Benchmarking Long-horizon Proactive Search in the Wild
提出VibeSearch范式与VibeSearchBench基准,通过多轮渐进式用户模拟与图匹配评估揭示当前模型主动搜索能力严重不足。
- Rethinking Agentic RAG: Toward LLM-Driven Logical Retrieval Beyond Embeddings
提出LLM用布尔逻辑直接操控倒排索引,匹配混合检索性能同时大幅降低构建与推理成本
- Rethinking Memory as Continuously Evolving Connectivity
提出FluxMem,将记忆建模为可演化的异构图,通过三阶段进化实现动态连接优化,在三个基准上达到SOTA
- Looking Farther with Confidence: Uncertainty-Guided Future Learning for Sequential Recommendation
提出不确定感知框架,根据模型对当前预测的置信度动态调节多步未来监督权重,显著提升序列推荐性能
- CORE: Contrastive Reflection Enables Rapid Improvements in Reasoning
对比成功与失败推理轨迹生成可复用自然语言洞察,以更高样本、rollout和上下文效率实现冻结LLM的快速自改进。
- Mixture-of-Experts Knowledge Graph Retrieval-Augmented Generation for Multi-Agent LLM-based Recommendation
提出多智能体框架 MixRAGRec,通过查询感知的多粒度 KG 检索与联合优化,实现高效知识增强推荐
- Calibrating Conservatism for Scalable Oversight
聚合多种辅助监督信号为保守性惩罚,并用共形决策理论在线校准保守系数,确保长期违规率不超过目标值
- LRanker: LLM Ranker for Massive Candidates
通过聚合候选全局信息和多嵌入集成,使LLM排序扩展到百万级候选并大幅提升效果
- Decision-focused learning for optimal PV-Battery scheduling
将预测与优化任务联合训练,通过 warm-start 方式在 20 栋住宅上降低平均电费 7.8%
- Mobile-Aptus: Confidence-Driven Proactive and Robust Interaction in MLLM-based Mobile-Using Agents
提出通用置信度集成框架,结合有监督微调与基于语义相似检索和DPO的置信度偏差校正,同时缓解移动代理的过度执行和过度请求问题
- PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
提出 PEFT-Arena 基准,揭示 PEFT 方法的稳定性-可塑性权衡,正交微调 (OFT) 展现最佳前沿。
- Learning to Assign Prediction Tasks to Agents with Capacity Constraints
提出在线上下文多臂赌博框架,在代理容量约束下动态学习其专长并路由任务,显著优于非上下文基线
- Fine-Tuned LLM as a Complementary Predictor Improving Ads System
用微调LLM预测潜在转化广告商,注入检索与排序,线上广告回报提升4.94%-6.69%
- Utility-Aware Multimodal Contrastive Learning for Product Image Generation
将需求模型嵌入对比学习,使生成图像同时优化语义一致性与市场表现,在Amazon与Airbnb上超越基线
2026-05-27 30 篇 ★ 29 深度
- MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing
通过并行提取与层次时态索引,实现Agent记忆的局部更新与时间感知检索,大幅提升写入吞吐
- SkillEvolBench: Benchmarking the Evolution from Episodic Experience to Procedural Skills
SkillEvolBench 诊断基准揭示 LLM 智能体难以从任务轨迹中抽象出可迁移的程序技能,原始轨迹复用常优于提炼技能。
- Decoding the Critique Mechanism in Large Reasoning Models
发现并操控大型推理模型内部的批评向量,无需训练即可提升自纠和测试时扩展性能
- ECHO: Terminal Agents Learn World Models for Free
ECHO在GRPO中增加环境观测token的交叉熵损失,将终端输出变为稠密监督,在TerminalBench-2.0上pass@1翻倍。
- SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent
提出状态自适应记忆框架 SAM,通过记忆线索与意图驱动回忆让智能体从长历史中重建决策支撑信息,无需重训练骨干模型
- SEAL: Synergistic Co-Evolution of Agents and Learning Environments
利用可执行验证器为基础的失败诊断作为共享信号,协同进化训练界面与策略,显著提升低资源多轮工具使用学习
- Directional Alignment Mitigates Reward Hacking in Reinforcement Learning for Language Models
提出信任方向梯度对齐(TDGA),将RL梯度投影到干净子空间,显著延迟奖励黑客并保持真实性能。
- Personalize-then-Store: Benchmarking and Learning Personalized Memory for Long-horizon Agents
提出首个评估个性化记忆系统的基准PerMem-Bench,发现会话级存储门控可显著提升保留率但准确门控仍是挑战
- Language Models Need Sleep
在SSM-Attention混合模型中引入离线递归更新快权重,将计算移出推理时,提升对已逐出上下文的深层推理能力
- Negligible in Size, Significant in Effect: On Scale Vectors in Large Language Models
理论证明Pre-Norm中尺度向量虽参数极少但通过自加速预条件效应关键加速训练,并据此提出分支异构、双端放置与幅度方向重参数化三种改进,在密集和MoE模型上一致提升预训练损失。
- Beyond Final Answers: Auditing Trajectory-Level Hallucinations in Multi-Agent Industrial Workflows
提出 Trajel 基准,定义五种轨迹级幻觉类型,发现执行质量信号(如推理清晰度 AUC=0.908)比监督分类器更早预测幻觉,且 48.7% 的轨迹存在多类型共现。
- Efficient Agentic Reinforcement Learning with On-Policy Intrinsic Knowledge Boundary Enhancement
通过在线双路径 rollout 探测知识边界,构建细粒度监督信号,在不牺牲准确率的前提下减少冗余工具调用 18%。
- RAG-Match: Retrieval-Augmented Knowledge Injection and Hierarchical Reasoning for Calibrated Semantic Relevance
通过知识注入、分层推理对齐和偏好校准三阶段提升搜索相关性判断
- Credit-assigned Policy Gradient for Early Stage Retrieval in Two-stage Ranking
提出 CA-PG,通过对含目标项的候选集边际化概率求梯度,大幅降低方差,提升早期检索训练稳定性。
- The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence
以仅 9.8B 激活参数的 MoE 架构,通过 agent 原生数据管道和 RL 系统达到 agentic 前沿性能,并初步实现自进化。
- MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
提出将技能视为统一生命周期资产的智能体框架,引入技能级记忆、测试驱动评估和跨智能体迁移。
- BASIS: Batchwise Advantage Estimation from Single-Rollout Information Sharing for LLM Reasoning
利用跨提示的批内奖励加权平均,仅需单次采样即可获得比GRPO8次采样更准的价值估计,训练时间减半且性能接近多轮次基线。
- DEI: Diversity in Evolutionary Inference for Quality-Diversity Search
通过异步通信将异构LLM作为变异算子协同进化,在同等算力下实现覆盖率+28%、QD得分+124%。
- The Coverage Illusion: From Pre-retrieval Routing Failure to Post-retrieval Cascades in a Production RAG System
合成查询高估LLM增强需求 72.2%真实查询仅靠混合检索即可,检索后级联无需训练提质量降延迟
- L2Rec: Towards Dual-View Understanding of LLMs for Personalized Recommendation
通过在参数层面为 LLM 注入行为与语义双视图 LoRA 专家,以个性化路由统一融合信号,显著提升推荐效果。
- MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation
用清理掉先前助手回复的参考分布进行在线蒸馏,消减多轮对话中的自污染,缩小全量 Prompt 与分片对话的准确率差距
- FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents
通过查询监控、工具监控与级联法官在代理执行中注入安全证据,在保持业务批准率的同时降低攻击成功率并大幅减少高级模型调用。
- MuChator: Enabling Active Music Discovery via Conversational Music LLMs in Douyin Music
提出端到端对话音乐LLM框架MuChator,通过三阶段预训练注入知识/偏好、自动合成指令微调及混合奖励GRPO对齐,线上活跃天数提升46.49%
- Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs
通过对称的 pair-in 压缩和 pair-out MTP 头,用 on-policy 蒸馏免费训练的置信头替代验证器,实现精度不降的推理加速。
- SIA: Self Improving AI with Harness & Weight Updates
提出反馈智能体同时更新任务智能体的支架(提示、工具)和模型权重(LoRA)的联合自改进循环,在三个领域全面超越纯支架迭代
- Uniboost: Global Coordination with Value Alignment for Fair and Efficient Traffic Allocation
提出统一框架 Uniboost,通过后验价值对齐和独立线性提升,解决混排分数膨胀和不可解释问题,提升推荐效率。
- Causal Representation Learning for Generalisable Recommendation
提出互信息解耦准则去除表征中的非因果依赖,在Shopify线上A/B测试中显著提升用户参与度,而离线指标不起变化
- Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments
在 Agent RL 训练中模拟用户与工具侧噪声,结合混合轨迹与课程调度,显著提升现实噪声下的性能与泛化能力。
- Generalized Range Filtering Approximate Nearest Neighbor Search: Containment and Overlap [Technical Report]
提出多段树图 MSTG,统一处理包含、重叠等任意区间谓词的向量检索,性能最高比通用方法快 12.5 倍
- Natural Language Query to Configuration for Retrieval Agents
提出 BRANE:用 LLM 提取查询特性并训练 per‑configuration 预测器,在推理时按准确率目标选择管道配置,大幅节省成本
2026-05-26 30 篇 ★ 27 深度
- Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration
提出双桥一致性(语言JSON剧本+动态视觉锚)与闭环验证的多智体框架,解决长视频重制中的身份漂移与语义侵蚀。
- ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning
首个并行视频工具调用多智能体RL框架,识别并解决工具先验悖论导致的格式崩溃与工具跳过问题。
- Equilibrium Reasoners: Learning Attractors Enables Scalable Reasoning
将迭代推理模型视为学习任务条件吸引子,通过塑造吸引子景观实现测试时深度与广度双轴扩展,无需外部验证器即可大幅提升推理性能。
- SciAtlas: A Large-Scale Knowledge Graph for Automated Scientific Research
构建含4300万论文、1.57亿实体、30亿三元组的异构学术知识图谱,并设计神经符号检索算法降低智能体推理成本
- VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis
通过生成式模型主动合成可控视频,构建精细诊断多模态大模型时空推理能力的基准。
- Foundation Protocol: A Coordination Layer for Agentic Society
提出以图为核心的 Foundation Protocol,将实体、组织、经济交换和可审计溯源统一为智能体社会的协调基板。
- How Many Tools Should an LLM Agent See? A Chance-Corrected Answer
提出Bits-over-Random(BoR)度量评估工具搜索深度,并用作RL奖励学习自适应截断,显著降低提示长度同时保持覆盖率。
- Macaron-A2UI: A Model for Generative UI in Personal Agents
提出Macaron-A2UI,通过LoRA微调与强化学习训练,无需模式提示即超越全模式基线,让智能体动态生成交互界面。
- Spectral Retrieval: Multi-Scale Sinc Convolution over Token Embeddings for Localized Retrieval in LLM Multi-Agent Systems
在 token 嵌入上施加多尺度 sinc 卷积,以 max-over-scales 聚合实现逐 token 至均值池的平滑插值,显著提升窄片段相关性召回
- AgentIR: A Workload-Adaptive Cascade Retrieval Substrate for Long-Term Conversational Memory
针对 LLM Agent 记忆的强近期偏斜与查询异质性,设计自适应级联检索系统,实现次线性扩展与跨工作负载自动融合选择。
- Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
首次构造涵盖长周期事件流、跨服务依存、多设备协同的个人助手基准,暴露当前模型仅34.5% pass@1的差距,并利用数据生成管道将基线提升23.7%。
- DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learning
动态按组内奖励方差自适应调整多目标优势权重,解决 GRPO 多奖励标量化的幅度爆炸与目标孤立问题
- MVR-cache: Optimizing Semantic Caching via Multi-Vector Retrieval and Learned Prompt Segmentation
通过轻量可学习分割模型与多向量检索(MaxSim)提升语义缓存命中率最高37%,并保持理论正确性保证。
- Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration
提出训练无关、模型无关的测试时框架UTTSI,根据样本不确定性自适应分配多路径探索,显著提升CTR预测性能
- Self-Balancing Gradient Allocation for Heterogeneity-Aware Feature Generation in Click-Through Rate Prediction
提出统一可学习难度信号,同时驱动自平衡损失和难度引导注意力,解决生成式CTR中不同字段重建难度不均衡问题。
- Meta-Modal Agent: Sequential Evidence Routing for Missing-Modality Candidate Reranking
将冷启缺失模态视为序列证据路由问题,用PPO训练LLM Agent融合自动工具与检索分数进行候选重排
- From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
将 Agent 性能瓶颈从单一模型能力提升为包含记忆、上下文、技能路由与治理的全系统设计问题。
- From Item-Only to Query-Item: Query-Conditioned Generative Search with QGS in Quark
以查询条件下一物品预测取代物品自回归,消除搜索序列中查询跳变造成的噪声监督,并引入线性HSTU和异构特征分组注意力实现工业落地。
- Can LLMs Time Travel? Enhancing Temporal Consistency in Legal Agentic Search through Reinforcement Learning
提出 LegalSearch-R1,通过时序索引训练与混合检索增强的强化学习框架,大幅提升法律智能体的时序一致性与检索精度。
- GCIB: Graph Contrastive Information Bottleneck for Multi-Behavior Recommendation
通过图信息瓶颈去噪辅助行为图结构,并结合跨行为对比学习实现语义对齐,提升稀疏目标行为的推荐精度
- LENS: A Staged Design for Interaction Granularityin Sequential CTR Prediction
提出分阶段框架,通过静态位置先验和目标条件残差在潜在查询骨干中恢复目标特异性,并发现密度驱动的条件源规则
- DeGRe: Dense-supervised Generative Reranking for Recommendation
通过离线 beam search 挖掘高价值序列并转化为逐步密集监督,让轻量生成器在线仅需一次贪婪解码即逼近全局最优重排。
- PolyGnosis 2.0: Enhancing LLM Reasoning via Agentic Harness Engineering for Polymarket and OSINT Insight Extraction
通过可控消融实验量化多智能体反射、分治等 Harness 技术对推理准确率的效用,发现分治是关键,终端反射有害。
- SIREN: Unified Multi-Granularity Semantic Interaction for Multi-Modal Lifelong User Interest Modeling
在工业推荐的两阶段框架中,通过语义ID和相似度桶实现多模态信号的早期融合,兼顾效果与部署效率。
- Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representation
提出类型化记忆中间表示 MEMIR,以记忆原子分离证据、线索与事实,实现溯源监控的结构化
- VeriTrace: Evolving Mental Models for Deep Research Agents
提出解释更新、偏差反馈、模式修订三个显式调节循环,让智能体的认知图持续逼近现实
- When Gradients Collide: Failure Modes of Multi-Objective Prompt Optimization for LLM Judges
揭示多任务文本梯度优化中梯度稀释(特异性降低59%)和推理时指令干扰两大致命瓶颈
- What Makes a Medical Checker Trainable? Diagnosing Signal Collapse and Reward Hacking in Checker-Guided RAG for Biomedical QA
揭示NLI检查器在RL训练中的输出分布而非准确率决定梯度可用性,中等信号优于强信号并避免奖励黑客
- Anticipate and Learn: Unleashing Idle-Time Compute in Proactive Agents
ProAct架构利用空闲时间预测未来需求并主动准备,在ProActEval上减少交互轮次14.8%,降低用户努力11.7%,幻觉率下降28.1%
- How Reliable Are Semantic-ID Tokenizer Comparisons in Generative Recommendation?
揭示语义ID碰撞导致评测指标虚高,提出碰撞修正评估和最小代价零碰撞重分配,促进公平对比。
2026-05-25 30 篇 ★ 17 深度
- See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding
提出SWIM,训练时用掩码监督对齐跨注意力图,推理仅用文本提示即可定位视频中用户指定的对象,超越视觉提示方法
- Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR
提出Pion优化器,用高通频谱滤波替代Muon的均匀白化,解决VLA低秩噪声放大和RLVR不稳定问题
- "I didn't Make the Micro Decisions": Measuring, Inducing, and Exposing Goal-Level AI Contributions in Collaboration
提出 COTRACE 框架,在目标与需求层面量化人类与 AI 的贡献,并揭示可控制的间接影响模式
- SpaceDG: Benchmarking Spatial Intelligence under Visual Degradation
首次大规模评测多模态模型在真实视觉退化下的空间推理鲁棒性,并证明退化感知训练可超越人类
- From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skills
系统评估模型生成领域技能全生命周期,揭示技能效用模式并提出元技能引导改善提取质量。
- LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
将 LLM 训练建模为噪声信道传输,提出香农缩放定律,解释非单调性能下降
- PhotoFlow: Agentic 3D Virtual Photography Missions
提出Director-Reviewer-Reflector多角色Agent,实现语言引导的3D场景闭环相机搜索与照片渲染
- SkillOpt: Executive Strategy for Self-Evolving Agent Skills
第一个系统性的可控文本空间优化器,将有界编辑、拒绝缓冲等引入技能训练,在52项测试中全部最佳。
- StepAudio 2.5 Technical Report
用任务定制RLHF和专用解码,使单一音频模型在ASR、TTS和实时交互上达到专用系统水平
- One prompt is not enough: Instruction Sensitivity Undermines Embedding Model Evaluation
指令嵌入模型性能对提示措辞高度敏感,单点评估掩盖真实分布,排行榜排名不稳健。
- ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning
从预训练文档自动生成问题及实例级加权评分标准,实现开放性任务的大规模强化学习
- Approaching I/O-optimality for Approximate Attention
将近似注意力与 I/O 高效算法结合,使数据传输量几乎线性于序列长度,逼近理论下界
- Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval
ToolMerge 用 LLM 规划器将查询分解为多个轻量视觉工具调用,并通过布尔运算符合并排名,在长视频关键帧检索上取得领先
- Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agents
训练一个基于评分标准的生成器,以步骤级方式指导ReAct智能体的搜索决策,并通过列表式GRPO优化与专家排名的一致性,显著提升深度研究任务性能。
- Complete-muE: Optimal Hyperparameter Transfer and Scaling for MoE Models
提出 Complete-muE 双桥框架,实现从密集 FFN 到任意 MoE 配置的超参数零成本迁移,实现“调参密集一次,迁移所有 MoE”。
- From Correctness to Preference: A Framework for Personalized Agentic Reinforcement Learning
提出PARPO解耦通用质量与个性化偏好奖励并用用户锚点稳定训练,结合偏好解耦奖励模型与演化图记忆,实现闭环个性化智能体优化
- CoSPlay: Cooperative Self-Play at Test-Time with Self-Generated Code and Unit Test
提出无监督、无训练的测试时自博弈框架,代码与自生成的单元测试通过执行矩阵双向验证协同进化,显著提升代码生成正确率
- CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception
训练自由的认知评估-搜索框架,通过语义引导自适应分块与动态自底向上搜索,实现覆盖与效率平衡的高分辨率视觉搜索。
- Benchmarking Google Embeddings 2 against Open-Source Models for Multilingual Dense Retrieval and RAG Systems
系统对比 GE2 与 5 款开源嵌入模型,揭示 GE2 质量最优但延迟高,mE5-L 在短文本几乎持平,LaBSE 完全不适合检索。
- HARNESS-LM: A Three-Phase Training Recipe for Harnessing SLMs in Sponsored Search Retrieval
通过教师训练、ℓ2对齐和对比细化,将大检索模型能力迁移到轻量级在线查询编码器,并实现27×延迟降低与线上收益提升。
- Expand More, Shrink Less: Shaping Effective-Rank Dynamics for Dense Scaling in Recommendation
通过参数化全混合与GLU-PFFN缓解RankMixer嵌入坍塌,提升稠密扩展性能
- Understanding and Improving Noisy Embedding Techniques in Instruction Finetuning
理论揭示均匀与高斯噪声等价性,提出对称伯努利噪声 SymNoise,显著超越 NEFTune
- LLM-driven design of physics-constrained constitutive models: two agents are better than one
Creator生成模型,Inspector审计物理约束,将LLM生成的本构模型物理合规率提升至100%且保持高精度。
- Towards Generalizable and Efficient Large-Scale Generative Recommenders
在10亿参数生成式推荐模型中,用任务相关缩放法则、多token预测和语义塔解决了规模化后的效果迁移与工程效率难题。
- From Head to Tail: Asymmetric Knowledge Transfer in Long-tail Recommendation with Generative Semantic IDs
用MLLM生成语义ID并聚类,以非对称对比学习从头部向尾部迁移知识,在线CTR+2.76%、GMV+3.47%
- OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations
提出递归记忆与两阶段RL,用恒定上下文长度预测下一查询,token消耗最高降低22倍,质量优于全历史基线
- OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agents
提出动态任务生成与轨迹‑产出联合评测框架,揭示技能可用≠有效使用,且收益强依赖模型与设计先验
- TPMM-DPO: Trajectory-aware Preference-guided Model Merging for Iterative Direct Preference Optimization
提出轨迹感知模型融合方法,用学习到的融合权重整合迭代 DPO 过程中的历史模型,构建更稳定的参考模型,有效抑制噪声累积和性能退化。
- TubiFM: Unified Item, Carousel, and Search Ranking for Streaming Discovery
将用户跨表面的行为序列化为“用户故事”,通过单一生成式模型统一物品、轮播和搜索排序,简化系统并提升多任务效果。
- Training-Free Looped Transformers
在冻结的预训练模型上,通过阻尼子步骤循环中间层块,无需微调或架构改动即可显著提升推理性能
2026-05-24 30 篇
- KVServe: Service-Aware KV Cache Compression for Communication-Efficient Disaggregated LLM Serving
首个服务感知的自适应KV缓存压缩框架,通过贝叶斯搜索与在线控制实现动态策略选择,显著降低拆解式推理的通信延迟。
- Forecasting Downstream Performance of LLMs With Proxy Metrics
聚合专家解答上的token级熵、top-k准确率、专家token排名作为代理指标,预测LLM下游性能,显著优于损失和计算基线
- OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding
首个统一评估全模态感知、主动响应与多任务能力的流式视频基准,揭示音频利用差异、长程退化与非语音音频薄弱
- Traditional statistical representations outperform generative AI in identifying expert peer reviewers
在细粒度领域专家匹配任务上,TF-IDF明显优于GPT-4o mini,揭示了生成式语义平滑的局限
- Will It Go Viral? Grounding Micro-Video Popularity Prediction on the Open Web
引入开放网络实时上下文与趋势感知在线适应,提升微视频流行度预测
- BiRD: A Bidirectional Ranking Defense Mechanism for Retrieval Augmented Generation
发现毒化文档的双向排名对齐特征,提出结合前向与后向排名的双信号防御框架,兼顾效率与鲁棒性
- GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation
通过对比多条生成轨迹提取结构化视觉经验,以 token 级蒸馏实现图像生成智能体的自进化
- Bernini: Latent Semantic Planning for Video Diffusion
将 MLLM 语义规划与 DiT 像素渲染解耦,模块化组合实现高效视频生成与编辑
- DecQ: Detail-Condensing Queries for Enhanced Reconstruction and Generation in Representation Autoencoders
引入轻量细节压缩查询,从冻结视觉基础模型中间层提取细粒度信息,显著提升重建PSNR与生成FID,收敛加速3.3倍
- DIVE: Embedding Compression via Self-Limiting Gradient Updates
通过自限制 hinge triplet 损失和多头对比学习,在小样本下稳定压缩高维嵌入,全面超越现有适配器
- Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention
将 Delta 规则的记忆更新拆分为通道级擦除门与写入门,突破原有标量门控的耦合限制,显著提升长上下文检索性能。
- Variance Reduction for Expectations with Diffusion Teachers
CARV通过分层蒙特卡洛估计摊销昂贵前向计算,以2-3倍有效计算倍乘降低下游梯度方差
- Support-aware offline policy selection for advertising marketplaces
提出支持感知的离线决策框架,输出认证策略与验证候选,而非单纯的点估计排名
- Swift Sampling: Selecting Temporal Surprises via Taylor Series
用泰勒展开预测视频特征轨迹,选出偏离预测的时序惊喜帧,零训练、极低开销
- GraphRAG on Consumer Hardware: Benchmarking Local LLMs for Healthcare EHR Schema Retrieval
在8GB消费GPU上评测GraphRAG,发现7B以下模型无法完成管道,本地检索优于全局摘要
- AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
提出自我感知的结构化推理机制,使视觉语言导航智能体明确理解自身状态和任务进展,实现更鲁棒的指令跟随。
- BeLink: Biomedical Entity Linking Meets Generative Re-Ranking
用指令微调的开源生成模型在重排序阶段实现集合式候选选择,准确率提升3-24%,推理更快。
- Scene Abstraction for Lexical Semantics: Structured Representations of Situated Meaning
用LLM少样本提示从语境中提取结构化场景,捕捉词语的情境、属性和情感关联
- FAME: Failure-Aware Mixture-of-Experts for Message-Level Log Anomaly Detection
用LLM离线划分故障域并少量标注,训练轻量路由与专家模型,实现高效消息级异常检测。
- Tokenisation via Convex Relaxations
将分词器构建转化为线性规划,用凸优化求解全局最优词表,压缩率和语言模型性能超越贪心算法
- Uniform Diffusion Models Revisited: Leave-One-Out Denoiser and Absorbing State Reformulation
揭示了均匀扩散中标准参数化与训练目标的不匹配,提出留一去噪和吸收态重构改进生成质量
- A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
用微分方程统一推导扩散模型的前向/反向过程,阐明训练目标与采样方法的关系
- LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
用语言条件提示和衰减机制引导多语言推理强化学习,在非英语数学任务上提升推理性能且保持语言一致性
- MotiMotion: Motion-Controlled Video Generation with Visual Reasoning
将运动控制重新定义为推理-生成问题,利用免训练VLM预测因果连带的二次运动并引入置信度感知控制来提升自然性。
- Evaluating Commercial AI Chatbots as News Intermediaries
对六款商用聊天机器人进行多语言实时新闻问答评估,揭示高准确率背后的区域不平等与检索依赖问题
- Reflecti-Mate: A Conversational Agent for Adaptive Decision-Making Support Through System 1 and System 2 Thinking
提出自适应对话代理Reflecti-Mate,通过建模用户System 1/2思考促进整合性反思,实现更个性化决策支持
- SeqLoRA: Bilevel Orthogonal Adaptation for Continual Multi-Concept Generation
通过双层优化联合学习 LoRA 因子,在持续学习新概念时强制正交约束,最小化灾难性遗忘和组合干扰
- Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models
提出CEDAR,通过可逆旋转+top-k稀疏瓶颈,不扩大维度实现多模态嵌入的稀疏解耦与概念对齐
- Understanding Data Temporality Impact on Large Language Models Pre-training
通过预训练6B模型发现,按时序排列数据训练能显著提升模型的时间知识准确性,且不影响通用能力。
- Which Way Did It Move? Diagnosing and Overcoming Directional Motion Blindness in Video-LLMs
揭示 Video-LLMs 存在方向运动盲,提出投影器级辅助损失 DeltaDirect 显著提升运动方向理解
2026-05-23 30 篇 ★ 5 深度
- Unsupervised Process Reward Models
提出无需人工标注的无监督PRM,通过LLM next-token概率联合定位第一步错误步骤
- Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps
发现全注意力LLM存在内在稀疏性,通过轻量索引和动态选择仅需数百步训练即可达到近乎无损的稀疏推理
- ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning
提出动态多模态证据寻找Agent,可蒸馏轨迹至小模型,将被动证据消费转为主动获取
- Efficient Table QA via TableGrid Navigation and Progressive Inference Prompting
提出两种无需训练的提示框架 TGN 和 PIP,结构化解耦表格导航与推理,并可蒸馏为小模型监督信号
- Vector RAG vs LLM-Compiled Wiki: A Preregistered Comparison on a Small Multi-Domain Research
首次定量对比发现Wiki在跨论文合成与引用支持上优于RAG,但成本高;分解式RAG可低成本恢复部分优势
- AutoRubric-T2I: Robust Rule-Based Reward Model for Text-to-Image Alignment
自动从少量偏好对合成判别规则构建 VLM 法官,仅用 0.01% 标注数据超越强基线
- FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching
在推理时通过滑动窗口重叠的Tweedie匹配与随机早期采样实现无训练、架构无关的长视频生成
- PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects
提出统一框架与数据集,实现跨类别仿真就绪3D生成,并构建含六维度评估的基准
- PhyWorld: Physics-Faithful World Model for Video Generation
二阶段后训练(流匹配微调 + DPO)让视频生成模型产出物理更合理的时序延续
- Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?
发现MLLM人格评分准确率与证据接地率严重脱节,51%正确评分非基于证据,提出接地人格推理基准揭示偏见差距。
- LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning
提出在潜在空间进行音视频联合推理,保留连续感知信息,通过特征级对齐与时序同步,超越显式文本思维链。
- Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate
揭示μP优于标准参数化的关键在于嵌入层学习率,提出三指标量化超参数迁移质量
- Toward AI VIS Co-Scientists: A General and End-to-End Agent Harness for Solving Complex Data Visualization Tasks
提出多智能体协同框架,仅凭数据与高层描述自动生成领域定制的交互式可视化分析应用
- MemConflict: Evaluating Long-Term Memory Systems Under Memory Conflicts
提出记忆冲突诊断框架,评估系统在动态、静态、条件冲突下检索与排序有效记忆的能力
- RiT: Vanilla Diffusion Transformers Suffice in Representation Space
利用DINOv2特征的优良统计特性,仅用普通DiT加x-prediction实现高效极速图像生成
- TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks
通过逆向工程 8 万终端录屏,构建可扩展的真实终端任务基准,揭示现有 Agent 最高仅 62.5% 通过率。
- Efficient Agentic Reasoning Through Self-Regulated Simulative Planning
分解智能体为反应执行、模拟规划和自调节三系统,用更少推理token达到竞争性准确率。
- TransitLM: A Large-Scale Dataset and Benchmark for Map-Free Transit Route Generation
发布1300万条公交路线记录的数据集,LLM训练后可直接从起终点生成结构化路线,无需地图或路由引擎
- Forecasting Scientific Progress with Artificial Intelligence
提出CUSP基准评估AI预测科学进展的能力,发现当前模型无法可靠预测科学发现的实现与时机,且存在过度自信。
- Advancing Mathematics Research with AI-Driven Formal Proof Search
大规模评估 LLM 驱动的 Lean 形式化证明在开放数学问题上的自动求解,最高代理独立解决 9 个 Erdős 问题
- Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning
通过联盟式自博弈与注意力架构,多智能体强化学习在无人机竞速中超越人类冠军,碰撞率降低50%。
- HarnessAPI: A Skill-First Framework for Unified Streaming APIs and MCP Tools
从单一技能文件夹自动派生流式HTTP端点、OpenAPI UI和MCP工具,减少74%样板代码
- Proxy-Based Approximation of Shapley and Banzhaf Interactions
提出ProxySHAP,通过树代理模型与残差校正实现快速且一致的交互指数估计,达到SOTA性能。
- Tokenization with Split Trees
通过递归分割树与整数规划直接优化压缩率,大幅减少token数量并提升下游性能
- Integrating Chain-of-Thought into Generative Retrieval: A Preliminary Study
首次在生成式检索中实现思考与文档ID生成交错进行,通过混合解码和检索奖励的强化学习取得SOTA。
- LCGuard: Latent Communication Guard for Safe KV Sharing in Multi-Agent Systems
通过对抗训练学习 KV 缓存变换,在保持任务性能的同时降低多智能体隐通信中的敏感信息泄露
- Two is better than one: A Collapse-free Multi-Reward RLIF Training Framework
将内部反馈分解为答案级和完成级互补奖励,结合GDPO归一化与KL-Cov正则化,稳定无监督RL推理训练,性能逼近监督方法
- The Matching Principle: A Geometric Theory of Loss Functions for Nuisance-Robust Representation Learning
统一多种鲁棒性方法为对编码器雅可比矩阵沿部署噪声协方差的正则化,并给出可证伪的闭式最优条件。
- Self-Policy Distillation via Capability-Selective Subspace Projection
无需外部信号的自我蒸馏方法,利用低秩能力子空间投影筛选自生成数据,显著提升LLM特定能力
- Boiling the Frog: A Multi-Turn Benchmark for Agentic Safety
评估工具型AI在办公场景下对逐步升级攻击的脆弱性,多模型平均严格攻击成功率44.4%
2026-05-22 30 篇 ★ 29 深度
- DynMuon: A Dynamic Spectral Shaping View of Muon
动态调度Muon类矩阵更新的频谱指数p从正到负,早期聚焦高曲率方向,后期转向平坦方向,实现更优收敛
- SaaSBench: Exploring the Boundaries of Coding Agents in Long-Horizon Enterprise SaaS Engineering
首个面向真实企业级SaaS生成的评估基准,揭示当前代理主要瓶颈在于多组件系统集成而非代码逻辑
- Mix-Quant: Quantized Prefilling, Precise Decoding for Agentic LLMs
提出阶段感知量化框架,预填充用NVFP4加速,解码保持BF16精度,在Agent任务上几乎无损且预填充加速达3倍。
- MOCHA: Multi-Objective Chebyshev Annealing for Agent Skill Optimization
通过切比雪夫标量化与退火探索,打破单目标优化僵局,实现Agent技能帕累托前沿全覆盖。
- π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
提出π-Bench基准,量化智能体在多轮交互中主动发现与解决用户隐藏意图的能力
- DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards
将RLVR更新视为隐式线性判别器,通过重加权token梯度向量增强正负侧质心的区分度,提升数学推理等任务表现。
- You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories
发现 RLVR 参数轨迹是低秩且线性的,提出 RELEX 只需 15% 训练步数即可外推高质量 checkpoint
- ACC: Compiling Agent Trajectories for Long-Context Training
将多轮agent轨迹编译为长上下文QA对,无需额外标注,在长程依赖建模上媲美8倍参数模型
- Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles
用 4B 编排器通过 RL 动态组合冻结专家与层级技能,在多模态基准上超越 GPT‑5 并实现即插即用扩展
- From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning
通过可验证子问题构建难度课程,结合子问题级归一化把部分推理进展转化为细粒度学习信号,显著提升困难数学题的RL训练效率
- Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learning
首个面向电子表格的端到端 RL 后训练框架,将 4B 开源模型 Pass@1 从 12.0% 提升至 23.4%
- One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systems
层次化多智能体框架将单句创意转为完整短剧,融合多智能体辩论、3D锚定首帧与多阶段评审,实现叙事节奏、空间一致性与制片质量协同优化。
- Bridging the Cold-Start Gap: LLM-Powered Synthetic Data Generation for Natural Language Search at Airbnb
用少量种子查询引导 LLM 生成带标咨询数据和标签,使查询分布接近真实用户,支持检索与排序模型冷启动训练
- Layer-wise Token Compression for Efficient Document Reranking
在中层Transformer层进行自适应令牌池化,保留早期交互并加速计算,吞吐量最高提升116%
- Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
一种无需预定义错误分类的动态多粒度代理评估方法,自动生成系统、节点与步骤级的文本诊断洞察
- Clipping Bottleneck: Stabilizing RLVR via Stochastic Recovery of Near-Boundary Signals
诊断硬裁剪决策是GRPO-style RLVR不稳定的关键瓶颈,提出随机救援边界信号的方法NSR,显著提升训练稳定性与性能。
- Beyond Temperature: Hyperfitting as a Late-Stage Geometric Expansion
揭示超拟合通过动态排序重排而非分布锐化提升生成多样性,并仅微调最后 5 层即可复现该效果
- DeltaBox: Scaling Stateful AI Agents with Millisecond-Level Sandbox Checkpoint/Rollback
通过仅复制连续检查点间的增量变化,实现耦合文件系统与进程内存的毫秒级检查点/回滚,解决AI智能体搜索的状态管理瓶颈。
- FashionLens: Toward Versatile Fashion Image Retrieval via Task-Adaptive Learning
提出任务自适应学习框架,通过球面查询校准与梯度引导采样解决多任务检索中的特征干扰与优化失衡,性能全面领先。
- Post-Training is About States, Not Tokens: A State Distribution View of SFT, RL, and On-Policy Distillation
提出状态分布视角统一SFT、RL和在线蒸馏,实验显示学生可超越退化教师且on-policy方法更稳定
- Integrable Elasticity via Neural Demand Potentials
ICDN 通过可积的神经需求表面学习 log-需求,用解析样条和稀疏注意力直接导出稳定、经济合理的有向交叉弹性
- AMEL: Accumulated Message Effects on LLM Judgments
LLM在作为评估器时,多轮对话历史中的评价极性会系统性地偏移后续判断,尤其放大不确定项的偏差。
- MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
让生产级agent系统通过源码自改写自主修复harness层故障,平均评分从0.25升至0.61
- Reinforced Preference Optimization for Reasoning-Augmented Recommendations
解耦LLM推理与推荐head,用GRPO+可验证奖励优化CoT质量,实现检索精度与推理可解释性双提升
- Search-E1: Self-Distillation Drives Self-Evolution in Search-Augmented Reasoning
通过交替 GRPO 与离线自蒸馏,从同一问题的正负轨迹对中提取 token 级监督,无需外部教师或奖励模型
- Generative Conversational Recommender System
将对话推荐统一为自回归生成任务,通过语义ID和结构化分解实现端到端优化,召回提升达29%
- LLM Retrieval for Stable and Predictable Ad Recommendations
提出基于LLM语义属性与图扩展的广告候选生成,线上可预测性指标A/A'差异降低8.62%,收入提升0.45%。
- Vector Policy Optimization: Training for Diversity Improves Test-Time Search
用向量奖励和随机标量化替代固定标量奖励,训练语言模型输出覆盖帕累托前沿的多样候选集,使测试时搜索收益随预算持续扩大。
- Behavior-Guided Candidate Calibration for Multimodal Recommendation
提出BRIDGE框架,用频谱解耦保持表征多样性,并以行为证据仅在候选集内校准排序残差,避免全局校正破坏推荐特异性。
- SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluations
SynAE从有效性、保真度、多样性三维度系统评估合成多轮工具调用Agent轨迹的质量
2026-05-21 30 篇 ★ 26 深度
- Mid-Training with Self-Generated Data Improves Reinforcement Learning in Language Models
自生成多样化解题轨迹指导中期训练,提升后续强化学习的推理性能和策略组合能力
- Active Learners as Efficient PRP Rerankers
将PRP重排序建模为噪声成对比较的主动学习,通过自适应调度和随机方向提示,在低预算下大幅提升Top-K质量
- S-Bus: Automatic Read-Set Reconstruction for Multi-Agent LLM State Coordination
服务器端 HTTP 日志自动重构读集,实现多智能体共享 NL 状态的乐观并发控制,零 agent 改动。
- It Takes Two: Complementary Self-Distillation for Contextual Integrity in LLMs
提出 SELFCI 互补自蒸馏框架,用双教师乘积专家目标解耦隐私保护与任务效用,无需外部监督。
- Harnessing LLM Agents with Skill Programs
把 LLM Agent 的已知技能从被动文本变为可触发、可干预状态-动作的 Program Functions,实现推理时修正、后训练监督与技能库自进化。
- LongMINT: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systems
一个面向干扰密集、多领域、长时程记忆的基准,揭示现有记忆系统在回溯与聚合推理上的严重不足
- From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG
EPIC 框架通过筛选偏好相关数据并引导查询方向,在端侧实现 2404 倍内存压缩、20.17 个百分点的偏好遵循提升和 33 倍检索加速。
- OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond
OScaR通过Canalized Rotation与Omni-Token Scaling解决Token Norm Imbalance,实现INT2近乎无损KV缓存量化,解码加速3.0×
- Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR
提出POW3R框架,通过rollout对比自适应调整评分标准权重,将人类重要性与当前可学性解耦,提升GRPO训练效果与效率
- SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoning
提出事后自蒸馏框架,从策略自身获取搜索步骤的细粒度监督,无需外部教师或额外标注
- SynGR: Unleashing the Potential of Cross-Modal Synergy for Generative Recommendation
通过显著性掩码与协同对比学习,强制模型利用跨模态协同信息,在三个数据集上提升平均约10%,推理零额外开销。
- ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactions
首个大规模用户思维数据集,揭示对话中未言明的意图与反应,并展示其在行为预测与模型对齐中的价值。
- TIGER-FG: Text-Guided Implicit Fine-Grained Grounding for E-commerce Retrieval
提出文本引导的隐式定位框架,无需物体检测即可从全图中提取目标聚焦的多模态嵌入,显著提升混叠场景下的检索精度。
- optimize_anything: A Universal API for Optimizing any Text Parameter
单一 LLM 优化系统横跨六个领域(代码、提示、Agent 架构、调度等)达到 SOTA,首次实现文本优化的通用范式。
- CAMERA: Adapting to Semantic Camouflage in Unsupervised Text-Attributed Graph Fraud Detection
提出CAMERA,通过解耦MoE专家与上下文感知门控自适应融合多源线索,实现无监督检测语义伪装欺诈者
- Divergence Meets Consensus: A Multi-Source Negative Sampling Framework for Sequential Recommendation
提出“教师-伙伴-自我”多源负采样框架,通过发散重排序和共识蒸馏突破自引导硬负采样的三大瓶颈
- Evaluating Temporal Semantic Caching and Workflow Optimization in Agentic Plan-Execute Pipelines
在 Plan-Execute 工业 Agent 中,时序语义缓存命中达 30.6 倍加速,MCP 工作流优化降低 40% 延迟,并揭示纯语义缓存在参数丰富查询中的失效模式。
- IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Tools
提出工具增强代理框架,通过门控RL优化工具调用,在工业异常检测中取得SOTA零样本性能
- Spectral bandits for smooth graph functions with applications in recommender systems
将图光滑性引入Bandit学习,通过有效维度使regret与节点数解耦,适用于探索阶段(T<N)的推荐场景
- Mem-π: Adaptive Memory through Learning When and What to Generate
提出生成式记忆框架Mem-π,让记忆模型自主决定何时生成指导与生成什么内容,在多种Agent基准上平均相对提升超20%
- PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models
从真实场景抽象出任务-约束分类,通过闭环合成生成可验证规划数据,兼顾评估与强化学习训练
- SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents
提出 SpecBench 基准,通过可见/隐藏测试集分离量化编程智能体奖励破解,揭示长任务与弱模型下测试通过率严重高估真实质量
- CALMem : Application-Layer Dual Memory for Conversational AI
纯应用层双内存(情景+语义)实现无模型改动的近乎无限上下文,并通过 token 自适应注入恢复会话连续性。
- ChunkFT: Byte-Streamed Optimization for Memory-Efficient Full Fine-Tuning
通过按字节预算划分模型参数为轮转块,仅激活当前块计算梯度,实现内存近似LoRA的全参数微调。
- DeepWeb-Bench: A Deep Research Benchmark Demanding Massive Cross-Source Evidence and Long-Horizon Derivation
提出一个包含矩阵任务、溯源记录和校准维度的深度研究基准,揭示检索非瓶颈、推导与校准才是主要挑战。
- Correcting Stochastic Update Bias in Preconditioned Language Model Optimizers
通过微批次交叉拟合与Delta方法逆修正,消除梯度-预条件子耦合和逆预条件有限样本偏差,提升AdamW、Sophia、Shampoo预训练效果
- LamPO: A Lambda Style Policy Optimization for Reasoning Language Models
用成对分解优势替代标量组优势,保留组内排序关系,提升RLVR样本效率与稳定性
- Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents
多智能体系统通过迭代假设-验证循环,从海量执行轨迹中自动发现并量化系统性行为模式,生成有证据支撑的诊断报告
- Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling
通过 JIT 编译、不变式强制工具协议和代价优化规划/调度,将 Web Agent 延迟降低 10.4 倍且准确率提升 28%。
- Preference-aware Influence-function-based Data Selection Method for Efficient Fine-Tuning
利用当前模型对目标示例的偏好加权构造目标方向,通过影响函数评分选择最有价值样本,提升微调数据效率
2026-05-20 30 篇 ★ 12 深度
- OmniGUI: Benchmarking GUI Agents in Omni-Modal Smartphone Environments
首个在步骤级注入交错图像、音频与视频的全模态 GUI 代理基准,揭示当前模型在需要时序/听觉信号时性能大幅下降
- Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information
通过逐点互信息分析揭示自蒸馏在推理任务中的失效根源,提出逆向散度与熵门控,使 GRPO 基线训练步数减少 2-10 倍,准确率最高提升 11.5 点
- Delta Attention Residuals
用子层输出的变化量(delta)替代累积隐藏状态进行注意力路由,缓解深层冗余与路由塌缩
- TopoPrimer: The Missing Topological Context in Forecasting Models
将持久同调和谱层坐标作为冷冻上下文注入预测模型,缩小冷启动差距且抗季节性漂移
- AstraFlow: Dataflow-Oriented Reinforcement Learning for Agentic LLMs
以数据流架构解耦训练、数据供给与 rollout,原生支持多策略协作训练并提速 2.7 倍
- CHI-Bench: Can AI Agents Automate End-to-End, Long-Horizon, Policy-Rich Healthcare Workflows?
构建首个评估 AI 代理端到端自动化多角色、高策略密度医疗运营工作流的基准,当前最优方案仅完成 28% 任务。
- Process Rewards with Learned Reliability
BetaPRM 预测步骤正确概率和该预测的可靠性,并利用可靠性信号实现自适应计算分配,减少推理 token 消耗
- AgentKernelArena: Generalization-Aware Benchmarking of GPU Kernel Optimization Agents
首个覆盖HIP/Triton/PyTorch-to-HIP的智能体GPU内核优化评估基准,引入未见配置泛化测试。
- MixSD: Mixed Contextual Self-Distillation for Knowledge Injection
提出MIXSD,通过混合基础模型自身专家与朴素条件采样构建分布对齐监督,大幅减轻知识注入时的灾难性遗忘。
- NGM: A Plug-and-Play Training-Free Memory Module for LLMs
提出训练无关的N-gram记忆模块,通过平均token嵌入构建表示并用余弦门控注入,显著提升代码和知识密集型任务性能。
- TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents
提出全模态工具使用基准TOBench,通过闭环验证评估 agent 在真实专业任务中的表现
- From Runnable to Shippable: Multi-Agent Test-Driven Development for Generating Full-Stack Web Applications from Requirements
TDDev框架通过自动化验收测试、浏览器交互验证与失败翻译,使全栈Web应用生成质量提升34-48个百分点,且协议必须匹配模型风格。
- Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis
提出一个 MLLM Agent 框架,通过结构化执行流水线从俯视图生成 Blender 代码来构建 3D 房间
- Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers
提出基于参数块对称群的等变优化器设计原则,为不同层定制更新规则,在LLM预训中超越AdamW
- Aurora: Unified Video Editing with a Tool-Using Agent
提出Aurora框架,用工具增强的VLM代理解决视频编辑中用户请求欠指定问题,将缺失条件补全后送入统一视频扩散模型。
- MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents
提出即插即用的主动多模态记忆框架,不微调 GUI 骨干,通过学习写入、压缩、检索视觉工作记忆与情景记忆提升长周期任务表现
- SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution
将 Agent 技能视为生命周期制品,通过归因控制实现从采集、推荐到进化的闭环,提升长期任务表现。
- Semantic Generative Tuning for Unified Multimodal Models
以图像分割为生成代理任务,对齐统一多模态模型的理解与生成表征空间
- AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
多智能体自主研究管线,通过辩论、自修复、交叉运行演化等机制,在ARC-Bench上超越AI Scientist v2 54.7%
- CEPO: RLVR Self-Distillation using Contrastive Evidence Policy Optimization
用正确与错误答案的对比信号锐化token级信用分配,保留安全保证并显著提升多模态数学推理
- GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment
提出能力导向的长上下文RLVR数据集和TMN-Reweight多任务优化,使30B模型长上下文性能比肩大模型
- OpenComputer: Verifiable Software Worlds for Computer-Use Agents
构建以应用状态程序化验证器为核心的桌面任务合成框架,覆盖33款软件共1000个任务,揭示前沿GUI智能体端到端完成仍存显著差距
- PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents
将可复用定向知识缓存为固定大小的上下文地图,显著提升Agent在重复长上下文任务上的准确率和效率。
- Draft Less, Retrieve More: Hybrid Tree Construction for Speculative Decoding
通过剪枝释放预算并用检索补偿,构建混合草稿树,打破稠密树与剪枝树的帕累托权衡
- Probability-Conserving Flow Guidance
提出零推理成本的AdaMaG,通过散度与分数平行项衰减,在流扩散生成中保持概率守恒,解决CFG强引导下的饱和与伪影。
- When Does Model Collapse Occur in Structured Interactive Learning?
用有向图建模多模型交互,给出避免模型崩溃的图拓扑充要条件及有限样本保证
- What Do Evolutionary Coding Agents Evolve?
通过 EvoTrace 数据集和 EvoReplay 回放方法,揭示进化编码搜索中分数提升多由少数编辑类型驱动,且存在高频代码回退的循环模式。
- Fine-Tuning Without Forgetting via Loss-Adaptive Learning Rates
提出与训练损失平方根成反比的学习率调度,在保持新任务性能的同时,平均减少93%的灾难性遗忘。
- D$^3$-Subsidy: Online and Sequential Driver Subsidy Decision-Making for Large-Scale Ride-Hailing Market
提出前缀条件扩散模型与Lagrangian-dual映射,在预算约束下实现城市级补贴的在线序列决策
- Tail Annealing for Heavy-Tailed Flow Matching
用坐标级软对数变换与Hill诊断,让标准流匹配零架构修改即可生成重尾数据且零发散
2026-05-19 30 篇 ★ 30 深度
- Distilling Long-CoT Reasoning through Collaborative Step-wise Multi-Teacher Decoding
提出CoRD框架,通过逐步多教师协作解码和预测困惑度指导,高效生成高质量长链推理数据,显著提升学生模型性能。
- Hölder Policy Optimisation
通过Hölder均值参数p动态调度,在GRPO中平衡梯度浓度与方差,实现数学推理和智能体任务的SOTA性能
- Learning POMDP World Models from Observations with Language-Model Priors
LLM生成可执行POMDP代码,通过信念滤波与软距离似然评分,无需隐藏状态即可匹配有监督方法的样本效率
- Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Use
基于模型能力重新定义工具必要性,发现LLM内部认知与实际行动脱节,错配主因在认知到行动的转换阶段
- MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning
提出首个端到端RL框架,联合优化MAS的设计与执行,通过分层Rollout与阶段式共进化获得最高21.7%提升。
- Argus: Evidence Assembly for Scalable Deep Research Agents
通过Searcher和Navigator协作构建共享证据图,将深度研究转化为证据拼图,实现并行搜索的线性扩展。
- LERA: LLM-Enhanced RAG for Ad Auction in Generative Chatbots
先由关键词嵌入粗筛,再用LLM logits精排,并以临界值支付保证激励相容,实现高效精准的聊天广告插入。
- Generative Long-term User Interest Modeling for Click-Through Rate Prediction
提出生成式长期兴趣模型GenLI,用目标无关的生成分布代替目标中心检索,实现兴趣多样性和效率提升
- X-SYNTH: Beyond Retrieval -- Enterprise Context Synthesis from Observed Human Attention
将员工数字行为序列作为隐式相关信号,在销售线索识别中将真线索率从 9.5% 提至 61.9%,假线索率降至 18.8%。
- Agent Bazaar: Enabling Economic Alignment in Multi-Agent Marketplaces
提出多智能体市场仿真框架,揭示LLM代理在B2C/C2C市场的崩溃与欺诈失败模式,并通过REINFORCE++训练9B模型实现经济对齐,性能超越前沿模型。
- Genflow Ad Studio: A Compound AI Architecture for Brand-Aligned, Self-Correcting Video Generation
通过检索品牌DNA约束和多智能体对抗QC循环将品牌合规视频生成合格率从42%提升到89%
- Echoes in Filter Bubble: Diagnosing and Curing Popularity Bias in Generative Recommenders
诊断出梯度饥饿与无差别令牌化导致生成式推荐严重流行偏差,并通过骨架令牌化和非对称不似然优化进行纠偏。
- Post-Trained MoE Can Skip Half Experts via Self-Distillation
注入零输出专家并两阶段自蒸馏,将静态MoE转为动态,消减超50%专家计算且精度损失极小
- SNLP: Layer-Parallel Inference via Structured Newton Corrections
将层间隐藏状态视为非线性残差方程,用结构化代理雅可比替换精确雅可比,结合训练正则化,实现层并行加速。
- RAGR: Review-Augmented Generative Recommendation
将用户评论反馈编码为语义ID融入生成式用户序列,并通过DPO对齐确保模型偏好物品生成而非评论生成。
- Dual-Diffusional Generative Fashion Recommendation
提出双扩散Transformer,联合图像与文本生成,实现个性化且可解释的时尚推荐。
- Text-Guided Visual Representation Learning for Robust Multimodal E-Commerce Recommendation
用结构化元数据引导视觉 token 提取,双流解耦并门控校准,显著提升海报式商品图的检索鲁棒性。
- Generating Pretraining Tokens from Organic Data for Data-Bound Scaling
SYNPRO 通过忠实且模型感知的合成数据生成,让 LLM 从有限有机数据中榨取更多有效 token,实现最高 5.2 倍重复训练的效率提升。
- Code as Agent Harness
将代码重新定位为智能体推理、行动和环境建模的可执行媒介,并提出三层框架统一代码智能体设计
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention
用 α-entmax 替代 top-k 实现可微分、自适应块选择,在长上下文任务中同时提升精度与速度。
- Multi-agent AI systems outperform human teams in creativity
多智能体LLM团队创造力显著优于人类团队(d=1.50),新颖性驱动且轨迹分析揭示可设计杠杆
- EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
全自动构建有状态可执行工具环境并生成自然多轮隐式意图轨迹,高效训练工具使用Agent
- DADF: A Distribution-Aware Debiasing Framework for Watch-Time Regression in Recommender Systems
通过动态分布变换、时长分组专家和多任务辅助信号,在不动第一阶模型的情况下对观看时长做第二阶乘性校正
- HINT-SD: Targeted Hindsight Self-Distillation for Long-Horizon Agents
通过选择失败相关动作进行自蒸馏,在不损失效率的前提下为长程 LLM Agent 提供精准过程监督
- Scalable Environments Drive Generalizable Agents
区分轨迹、任务、环境三类扩展,提出程序化生成与生成式世界模型两种环境扩展范式,量化跨环境适应
- Uncertainty-Calibrated Recommendations for Low-Active Users
用辅助 Critic 网络预测预期预测误差 + 贝叶斯先验方差,实现低活用户去偏与高活用户 UCB 探索的统一框架
- Towards Sustainable Growth: A Multi-Value-Aware Retrieval Framework for E-Commerce Search
提出兼顾即时转化与新商品长期增长潜力的多价值感知生成式检索框架,在淘宝实现新商品GMV提升5.3%
- Modality-Aware Identity Construction and Counterfactual Structure Learning for ID-Free Multimodal Recommendation
通过动态模态感知位置编码和反事实图结构学习,大幅提升无ID多模态推荐的语义表达和长尾覆盖
- PROTEA: Offline Evaluation and Iterative Refinement for Multi-Agent LLM Workflows
通过后向节点评估和图级瓶颈定位,实现多智能体工作流的离线测试驱动迭代优化,减少对人工中间标注的依赖
- General Preference Reinforcement Learning
用多维度偏好嵌入与漂移控制实现在线RL的开放任务对齐,无需标量奖励
2026-05-18 40 篇 ★ 7 深度
- RewardHarness: Self-Evolving Agentic Post-Training
将奖励建模从权重优化转为上下文进化,用少量样本自动演变工具技能库,实现高数据效率评估
- HodgeCover: Higher-Order Topological Coverage Drives Compression of Sparse Mixture-of-Experts
利用Hodge分解暴露MoE专家三元合并障碍,通过覆盖谐和核与临界三角形实现无学习压缩
- Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
通过因果一致性蒸馏高效初始化少步自回归学生模型,在帧级2步采样下性能超越4步块级SOTA,延迟减半
- Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards
将 RLVR 中的失败轨迹转化为修正监督,无需额外信号,显著提升推理与自我纠错能力
- FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstruction
从几张未标姿态的肖像秒级重建可动画3D高斯头像,无需逐主体优化,达到实时动画
- Does Synthetic Layered Design Data Benefit Layered Design Decomposition?
纯合成数据训练在图形图层分解任务上超越真实数据集,且可扩展至数万样本。
- Winning Lottery Tickets in Neural Networks via a Quantum-Inspired Classical Algorithm
提出量子启发的多项式时间经典算法,高效采样稀疏子网络,性能媲美精确采样
- PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation
提出结构化3D运动奖励PhyMotion,通过物理仿真多维度评估运动真实感,显著提升视频生成中的人体运动质量
- MMSkills: Towards Multimodal Skills for General Visual Agents
提出多模态技能包(状态卡片+关键帧+文本过程),并通过分支加载机制提升视觉Agent决策。
- Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution
通过四个专用智能体与可训练图知识网络,用REINFORCE将执行结果转化为路由权重更新,实现无需微调的持续编程能力提升
- Same Image, Different Meanings: Toward Retrieval of Context-Dependent Meanings
提出L1-L4框架量化图像语义的上下文依赖程度,发现上下文注入图像嵌入更有效,但最抽象语义层次仍难解决。
- VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction
提出深度同步文本注入与残差变换头,实现快速、多视角一致的文本驱动3D场景编辑。
- Nudging Beyond the Comfort Zone: Efficient Strategy-Guided Exploration for RLVR
提出 NudgeRL,通过策略级上下文进行结构化探索,在仅 8 次采样下超 8 倍采样 GRPO
- CLOVER: Closed-Loop Value Estimation \& Ranking for End-to-End Autonomous Driving Planning
闭环价值估计与排名框架,通过生成-打分自蒸馏解决训练评估不匹配,在NAVSIM达94.5 PDMS新SOTA
- A Mutual Information Lower Bound for Multimodal Regression Active Learning
提出 MI-LB,分离认知与偶然不确定性,为多模态回归主动学习提供闭式互信息下界
- EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation
提出多镜头视频实体一致性基准 EntityBench 及记忆增强方法 EntityMem,显著提升跨镜头实体保真度
- FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization
利用上下文学习和KV缓存调度实现单GPU 23.8FPS的实时流式服装切换视频生成
- Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design
用多智能体协作在有限预算内自主搜索 Transformer-Mamba 混合架构,性能与效率超越人工设计基准
- PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control
提出拓扑感知代理 PAGER,通过像素级监督微调与精度对齐强化学习,解决点级精确 GUI 构造问题
- $φ$-Balancing for Mixture-of-Experts Training
利用严格凸势函数与镜面下降,将 MoE 负载均衡从启发式 batch 统计提升为人口级凸优化,仅需 EMA 跟踪路由概率即实现更稳定均衡与专家专业化
- TILT: Target-induced loss tilting under covariate shift
通过分解源预测器为 f+b 并在目标无标签数据上惩罚 b,实现无需密度比估计的隐式重要性加权域适应
- Look Before You Leap: Autonomous Exploration for LLM Agents
通过 ECC 指标和交错 GRPO 训练,显式培养 LLM Agent 在陌生环境中的主动探索能力,显著改善下游任务表现。
- Attention Dispersion in Dynamic Graph Transformers: Diagnosis and a Transferable Fix
诊断出动态图Transformer在时序偏移下注意力分散,提出差分注意力修复,简单有效且可迁移至多种模型
- Context, Reasoning, and Hierarchy: A Cost-Performance Study of Compound LLM Agent Design in an Adversarial POMDP
在对抗性部分可观察环境中,程序化状态抽象与无推理工具的层次分解性能最佳,推理跨层次分布导致性能级联下降。
- Second-Order Multi-Level Variance Correction for Modality Competition in Multimodal Models
提出ML-FOP-SOAP,通过Fisher正交投影和层级方差校正抑制模态冲突,稳定大batch训练并提速
- FORGE: Self-Evolving Agent Memory With No Weight Updates via Population Broadcast
通过种群冠军广播和失败触发反思,无梯度更新下将LLM Agent在POMDP中的表现提升1.7-7.7倍
- Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Masking
用成功-失败动作方差定位学习信号,概率掩码轨迹块,实现 GRPO 梯度计算 4.8 倍加速且成功率无损
- A Cross-Modal Prompt Injection Attack against Large Vision-Language Models with Image-Only Perturbation
首次实现仅通过图像扰动同时操控LVLM对视觉和文本输入的跨模态提示注入
- Entropy Across the Bridge: Conditional-Marginal Discretization for Flow and Schrödinger Samplers
提出条件边际熵率调度,无训练地实现低步数流匹配与桥采样的边界重非均匀步分配,显著改善生成质量
- Navigating Potholes with Geometry-Aware Sharpness Minimization
LLQR+SAM 用慢更新的二阶预条件器增强 SAM 扰动,放大局部锐利方向的逃逸信号
- A Generative AI Framework for Intelligent Utility Billing CO 2 Analytics and Sustainable Resource Optimisation
统一生成式代理、Transformer预测、碳审计与量子启发优化,实现日用电预测MAPE降至2.7%
- MIND: Decoupling Model-Induced Label Noise via Latent Manifold Disentanglement
将模型诱导的系统性标签噪声解耦为子空间依赖成分,用动态聚类估计噪声以校正伪标注。
- Skew-adaptive conformal prediction
提出偏度自适应共形预测方法,通过不对称区间和逆双曲正弦变换学习局部偏度,提升预测区间效率。
- ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation
利用GRPO优化LLM生成推理文本,通过对比蒸馏训练轻量检测器,兼顾泛化性与效率
- Res$^2$CLIP: Few-Shot Generalist Anomaly Detection with Residual-to-Residual Alignment
将多模态对齐完全移入统一残差空间,同时解决跨粒度不匹配与跨类别泛化退化问题
- Entropic Auto-Encoding via Implicit Free-Energy Minimization
只用重建损失,通过编码器集成与熵隐式生成先验,解决VAE后验坍塌问题
- VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation
用视觉提示和原生工具调用实现实例级视频理解,平均提升13.7%,超越GPT-4o与Gemini-2.5-Pro。
- Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems
利用LTL进展将时序合规监控拆解为LLM标注+形式推理,效果远超LLM直接评判,并实现预测性干预
- Federated Imputation under Heterogeneous Feature Spaces
利用全局特征图的消息传递,在联邦学习中实现异构特征空间的间接跨客户端知识迁移与缺失值填补
- Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training
Asteria通过异步状态分布和有界陈旧同步,将二阶优化器高效应用于大模型训练
2026-05-17 55 篇 ★ 1 深度
- Realiz3D: 3D Generation Made Photorealistic via Domain-Aware Learning
解耦控制信号与视觉域,引入域协变量适配器,在保持真实感的同时实现3D可控生成
- WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild
首个针对自然场景表格图像的问答基准,暴露多模态模型在结构感知与数值推理上的严重缺陷
- Accelerating Multi-Condition T2I Generation via Adaptive Condition Offloading and Pruning
端边协同系统通过启发式卸载和特征驱动条件剪枝大幅降低多条件T2I延迟,同时提升生成质量
- Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation
通过语义引导的语音-音效解耦和双向跨模态强制策略,实现人体视频中动作、语音和音效的协同生成。
- Relational Retrieval: Leveraging Known-Novel Interactions for Generalized Category Discovery
提出关系模式一致性,通过双向知识转移耦合已知与未知数据,实现类别发现
- Mitigating Multimodal Inconsistency via Cognitive Dual-Pathway Reasoning for Intent Recognition
用直觉与推理双通道动态融合,量化并消解多模态冲突,实现鲁棒意图识别
- Learning to Communicate Locally for Large-Scale Multi-Agent Pathfinding
提出可学习局部通信模块,通过多轮特征共享增强协作,在不损失可扩展性的前提下大幅提升多智能体寻路性能
- HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformer
通过像素空间扩散Transformer,消除VAE与独立文本编码器,实现多模态原生统一生成,8B参数媲美27B模型并可扩展至200B+
- Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination
发现视觉token的词汇劫持现象,提出无训练注意力增强HAVAE,显著减轻LVLM幻觉
- PreScam: A Benchmark for Predicting Scam Progression from Early Conversations
首个面向多轮会话诈骗生命周期建模的基准,揭示FLM在追踪风险升级和操纵演化上的明显不足
- RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
提出后对齐的多模态事实核查基准RW-Post,提供可审计推理与证据链接,暴露现有模型在证据忠实度上的不足
- PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World
提出全景原生多模态大模型PanoWorld,以球形空间交叉注意力注入几何先验,在全景空间推理上大幅超越现有方法
- PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution
通过流匹配先验校正和不确定性感知残差编码,实现单步扩散的文本图像超分辨率
- Boosting Omni-Modal Language Models: Staged Post-Training with Visually Debiased Evaluation
通过视觉去偏基准OmniClean与三阶段后训练,3B全模态模型无需强教师即可匹敌30B模型
- UniPath: Adaptive Coordination of Understanding and Generation for Unified Multimodal Reasoning
提出自适应利用协调路径多样性,动态选择理解与生成路径,提升统一多模态推理效果
- ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both
用单一离散功能token统一agentic操作与潜在视觉推理,无需视觉监督,兼容标准训练
- Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning
提出闭环验证推理框架,结合自动化数据引擎、PPRL强化学习与DSWM权重融合,解决多步规划幻觉、优化不稳定及延迟问题,性能逼近商业模型。
- Aligning Latent Geometry for Spherical Flow Matching in Image Generation
将扩散模型潜空间的线性插值改为球面线性插值,仅微调解码器即可提升生成质量
- IdeaForge: A Knowledge Graph-Grounded Multi-Agent Framework for Cross-Methodology Innovation Analysis and Patent Claim Generation
将创新方法论建模为共享知识图谱上的异构推理算子,通过跨方法论收敛检测提升创意置信度并实现结构化专利生成
- To discretize continually: Mean shift interacting particle systems for Bayesian inference
提出均值漂移交互粒子系统,通过 MMD 最小化逼近目标分布,实现免归一化常数的贝叶斯积分近似。
- Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models
提出训练无关的步速与路径校正模块,以闭式解统一修正VLA动作块在动态场景下的时域不一致性
- DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models
提出 DiffusionOPD,通过在线策略蒸馏将多个任务教师知识融入统一学生,实现多任务扩散模型高效训练
- SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer
用2.6B参数、单GPU在34秒内生成长达60秒的720p控制视频,效率比工业基线高36倍
- Tight Sample Complexity Bounds for Entropic Best Policy Identification
通过平滑性导出更紧集中界并设计新停时规则,匹配了熵风险RL策略识别的下界
- Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformers
扩散Transformer中极稀疏的大规模激活通道是语义信息的载体,控制生成质量、空间布局并支持无训练的语义迁移
- TabPFN-3: Technical Report
基于合成数据预训练的表格基础模型,通过测试时计算扩展和工程优化,在多种表格任务上超越调优集成方法,速度提升20倍
- ViDR: Grounding Multimodal Deep Research Reports in Source Visual Evidence
提出将源图像作为可检索、可解释、可验证的证据对象,结合证据索引提纲和视觉验证,提升多模态深度研究报告的可靠性和可验证性
- VectorSmuggle: Steganographic Exfiltration in Embedding Stores and a Cryptographic Provenance Defense
揭示通过嵌入后处理扰动隐藏数据的隐写攻击,并提出基于 Ed25519 签名的向量溯源协议 VectorPin。
- AI Knows When It's Being Watched: Functional Strategic Action and Contextual Register Modulation in Large Language Models
发现 LLM 在多智能体辩论中会根据社会观察情境(人类监控 vs AI 审计)系统性调节语言,为 AI 治理提供实证
- ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World
通过三维嵌套学习(3D-ML)框架,在存储、推理深度和参数效率上全面优化多语言嵌入,刷新多项 MTEB 基准
- From Plans to Pixels: Learning to Plan and Orchestrate for Open-Ended Image Editing
通过基于奖励的规划-执行耦合,让模型自主学会分解并执行抽象多步编辑指令
- Scaling Laws from Sequential Feature Recovery: A Solvable Hierarchical Model
揭示多层网络如何通过顺序恢复不同强度的潜在组合特征来产生幂律缩放定律
- Falkor-IRAC: Graph-Constrained Generation for Verified Legal Reasoning in Indian Judicial AI
用IRAC知识图谱约束LLM生成,通过可证伪验证器确保法律推理的引用真实与逻辑自洽
- Policy Optimization in Hybrid Discrete-Continuous Action Spaces via Mixed Gradients
提出HPO算法,结合路径梯度与分数函数梯度实现混合动作空间的无偏策略优化
- Training-Free Generative Sampling via Moment-Matched Score Smoothing
提出一种无训练的交互粒子采样器MM-SOLD,通过矩匹配和分数平滑在CPU上生成高质量样本
- AI Outperforms Humans in Personalized Image Aesthetics Assessment via LLM-Based Interviews and Semantic Feature Extraction
LLM半结构化访谈提取个人语义偏好,结合图像低层特征,预测个人美学评分误差小于人类及自身重评
- EverAnimate: Minute-Scale Human Animation via Latent Flow Restoration
通过持久潜在上下文记忆与恢复流匹配解决长时动画生成中的累积漂移
- The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scale
构建200万条科学贡献和1250万条先决边的大规模图谱,并提出科学前提预测任务
- LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection
通过上下文感知评分与递归证据聚合,使冻结VLM在测试时能生成连贯的事件级异常解释。
- Compositional Video Generation via Inference-Time Guidance
基于交叉注意力图训练轻量组合分类器,在推理时引导冻结T2V模型提升组合正确性,无需微调
- Causal Foundation Models with Continuous Treatments
首个面向连续处理的因果基础模型,通过元学习和上下文学习实现个体处理效应曲线的零样本预测
- MetaBackdoor: Exploiting Positional Encoding as a Backdoor Attack Surface in LLMs
提出基于位置编码的无内容触发器后门攻击,能泄露系统提示或自我激活恶意行为
- Contestable Multi-Agent Debate with Arena-based Argumentative Computation for Multimedia Verification
提出基于竞技场量化双极论证(A-QBAF)的竞争性多智能体辩论框架,实现透明可争议的多模态验证
- Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA
提出ProcedureVQA基准和CoP层次推理框架,通过先检索后细化的方式增强VLM的过程推理能力
- Pelican-Unified 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
首个按统一原则训练的具身基础模型,用单一VLM实现理解、推理、想象与行动,同规模下多项性能最优
- RefDecoder: Enhancing Visual Generation with Conditional Video Decoding
为视频VAE解码器注入参考图像条件,绕过潜在信息瓶颈,显著提升重建保真度与生成一致性
- RoSHAP: A Distributional Framework and Robust Metric for Stable Feature Attribution
通过bootstrap估计SHAP分布并证明渐近正态性,提出同时奖励活跃、高影响且稳定特征的鲁棒排序度量RoSHAP
- In-Context Learning for Data-Driven Censored Inventory Control
提出上下文生成式后验采样,用离线元训练+在线自回归生成解决审查需求下的库存决策
- SpeakerLLM: A Speaker-Specialized Audio-LLM for Speaker Understanding and Verification Reasoning
通过层级说话人 tokenizer 和结构化推理轨迹,统一了说话人画像、录音条件理解和证据组织的验证推理。
- VGGT-$Ω$
通过架构精简、寄存器注意力与大规模自监督训练,前馈重建模型在精度与效率上大幅超越先前工作
- Text Knows What, Tables Know When: Clinical Timeline Reconstruction via Retrieval-Augmented Multimodal Alignment
用检索到的结构化EHR表格校准临床文本时间线,多模态对齐提升绝对时间精度并发现34.8%事件仅存于文本。
- Small, Private Language Models as Teammates for Educational Assessment Design
SLM在教育题目生成任务中性能接近LLM,但模型自评不可靠,须有人工闭环
- A Picture is Worth a Thousand Words? An Empirical Study of Aggregation Strategies for Visual Financial Document Retrieval
实证证明单向量聚合使金融文档区分度崩溃,全局纹理主导是关键原因
- Explainable Detection of Depression Status Shifts from User Digital Traces
融合多BERT模型信号与LLM生成可读报告,实现抑郁状态变化点的可解释检测与分析
- Language-Induced Priors for Domain Adaptation
用LLM将目标域文本描述转化为源选择先验,嵌入EM算法解决冷启动负迁移
2026-05-16 43 篇 ★ 41 深度
- RouteProfile: Elucidating the Design Space of LLM Profiles for Routing
定义LLM路由的profile设计空间,发现结构化、可训练profile显著提升路由与新模型泛化能力
- Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models
发现自回归视频扩散模型注意力头分为静态和动态两类,提出混合 KV 缓存压缩,结合静态结构剪枝与动态相似性剪枝,实现最高 2.82× 加速和 30% 显存减少
- Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning
设计三协作智能体与自进化知识库,让 VLM 在少样本下通过反思推理显著提升时间序列分类准确率
- AgentDisCo: Towards Disentanglement and Collaboration in Open-ended Deep Research Agents
通过解耦信息探索与利用为对抗式循环,并构建元优化策略库,在多个深度研究基准上超越闭源系统
- Very Efficient Listwise Multimodal Reranking for Long Documents
提出 ZipRerank,通过两阶段训练和查询感知视觉 token 剪枝与单步 logit 评分,将重排序延迟降低一个数量级
- SPIN: Structural LLM Planning via Iterative Navigation for Industrial Tasks
一种规划包装器,结合DAG验证与基于前缀的模拟器-批评家停止策略,提升工业LLM代理的执行效率与结构正确性
- A Standardized Re-evaluation of Conversational Recommender Systems on the ReDial Dataset
标准化重现 7 种 CRS 发现 R@1 极脆弱,近半性能来自重复捷径,LLM 骨干比架构创新影响更大
- FutureSim: Replaying World Events to Evaluate Adaptive Agents
通过真实新闻事件按时间顺序重放,评估前沿智能体长期预测与适应的能力
- Granite Embedding Multilingual R2 Models
基于 ModernBERT 的多语言嵌入模型族,支持 200+ 语言与 32K 上下文,在检索、代码和长文档任务上达到领先水平,并提供同类最优的 97M 参数压缩模型。
- A Hierarchical Language Model with Predictable Scaling Laws and Provable Benefits of Reasoning
用树广播过程定义合成语言,精确分析上下文长度与推理的作用,证明有限上下文导致统计不一致且 O(log n) 记忆的推理即可精确采样
- MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
首个统一长度控制下的多模态对话记忆基准,对比长上下文与记忆增强两类方案,揭示视觉证据检索为瓶颈
- Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation
通过信息增益与潜在有用性变量重新定义证据选择,并用轻量替身模型高效估计效用,无需训练即可超越基线
- A Multi-Agent Orchestration Framework for Venture Capital Due Diligence
事件驱动多智能体系统自动整合实时网络检索与官方注册文档解析,并通过结构化回退机制消除金融幻觉
- Retrieval-Augmented Tutoring for Algorithm Tracing and Problem-Solving in AI Education
结合多模态检索与苏格拉底式反馈,为算法追踪与问题求解提供课程对齐的AI辅导
- Thinking Ahead: Prospection-Guided Retrieval of Memory with Language Models
提出前瞻性引导检索(PGR),通过模拟未来场景触发相关记忆,解耦存储与检索,大幅提升长期个性化助手的召回率
- RAG-Enhanced Large Language Models for Dynamic Content Expiration Prediction in Web Search
利用 LLM 对查询意图和文档时间上下文进行语义推理,动态判定内容有效期,取代静态时间窗口规则
- Pause and Reflect: Conformal Aggregation for Chain-of-Thought Reasoning
用加权分数聚合与共形风险控制,在有限样本保证下控制自信错误率并提升选择性准确率
- Agentic AI and Human-in-the-Loop Interventions: Field Experimental Evidence from Alibaba's Customer Service Operations
揭示 agentic AI 客服中人工干预效果取决于失败类型与时机,早期介入和整合角色设计更优
- Holistic Evaluation and Failure Diagnosis of AI Agents
结合自顶向下与自底向上的跨度级评估,在 TRAIL 基准上实现最优错误定位与分类,证明评估方法论是瓶颈而非模型能力
- APWA: A Distributed Architecture for Parallelizable Agentic Workflows
提出 APWA,一种将任务自动分解为无干扰子任务并大规模并行执行的分布式多智能体架构,在现有系统失败的场景下实现线性扩展
- Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
将铰接式 3D 资产生成转化为代码编写任务,搭配专用 SDK 与迭代 harness,无需视觉反馈即可规模化产出高质量资产
- Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks
提出EDUFRAMETRAP基准,量化LLM在辅导中面对三种社会认知压力时放弃纠正的谄媚行为,揭示推理-谄媚悖论。
- Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment
将 GUI 动作批评从二元分类改革为连续度量学习,在共享 Affordance 空间中恢复层次语义结构,无需额外标注
- From Scenes to Elements: Multi-Granularity Evidence Retrieval for Verifiable Multimodal RAG
提出元素级多模态 RAG 框架 GranuRAG 与基准 GranuVistaVQA,通过检测-匹配-生成实现透明归因与大幅性能提升
- From Text to Voice: A Reproducible and Verifiable Framework for Evaluating Tool Calling LLM Agents
提出将文本工具调用基准转化为受控音频评估的框架,保留原始标注,实现配对文本-音频对比,发现语音性能损失高度依赖模型与任务
- COTCAgent: Preventive Consultation via Probabilistic Chain-of-Thought Completion
通过解耦可执行趋势统计、IDF 加权知识库评分和有界对话补全,COTCAgent 实现纵向 EHR 的可审计疾病排序。
- An Interpretable Latency Model for Speculative Decoding in LLM Serving
利用Little's Law构建简单延迟模型,解释负载变化时推测解码的加速比如何随接受率和草案长度演化
- Is Grep All You Need? How Agent Harnesses Reshape Agentic Search
系统实验揭示:检索策略(grep vs 向量)的效果依赖于代理框架与工具输出方式,内联 grep 在对话记忆任务中整体更强
- Case-Based Calibration of Adaptive Reasoning and Execution for LLM Tool Use
利用历史执行轨迹构建案例,提取复杂度与失败轮廓,联合校准推理预算与工具执行结构
- A Deterministic Agentic Workflow for HS Tariff Classification: Multi-Dimensional Rule Reasoning with Interpretable Decisions
通过固定控制流的多阶段LLM流水线实现HS分类的多维规则推理,输出可审计决策且开源模型性能接近前沿模型
- Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
仅通过页面动作时序,即可识别浏览器智能体的底层模型,F1 最高 96%,随机延迟防御可被自适应分类器破解
- Widening the Gap: Exploiting LLM Quantization via Outlier Injection
首次通过注入离群值让LLM在量化后触发恶意行为,成功攻破GPTQ、AWQ等优化型量化
- Forgetting That Sticks: Quantization-Permanent Unlearning via Circuit Attribution
提出 MANSU 框架,利用电路归因与量级底线保证 4-bit 量化后遗忘不逆转
- Quantifying and Mitigating Premature Closure in Frontier LLMs
在医疗场景中,前沿LLM普遍在信息不足时给出不安全答案,安全提示可部分缓解但无法根除
- Logging Policy Design for Off-Policy Evaluation
在已知/未知目标策略与奖励分布的信息条件下,推导最小化IPW估计均方误差的最优日志策略,揭示奖励-覆盖权衡
- Emotion-Attended Stateful Memory (EASM):The Architecture for Hyper-Personalization at Scale
引入情感索引记忆与意图推理的状态化LLM架构,在30个对话场景中全面超越无状态基线,记忆接地提升95%
- Dual-Dimensional Consistency: Balancing Budget and Quality in Adaptive Inference-Time Scaling
提出统一框架DDC,通过置信加权贝叶斯终止与趋势感知分层修剪,在维持准确率的同时将令牌消耗降低10倍以上
- Learning from Language Feedback via Variational Policy Distillation
将语言反馈学习形式化为变分EM,通过教师与学生的协进化蒸馏持续提升推理性能
- Improving Multi-turn Dialogue Consistency with Self-Recall Thinking
提出 Self-Recall Thinking 框架,让 LLM 在推理中内生回忆并引用关键历史轮次,兼顾多轮对话准确率与效率。
- Why Neighborhoods Matter: Traversal Context and Provenance in Agentic GraphRAG
发现 Agentic GraphRAG 中最终引用实体虽必要却不充分,答案还依赖未引用的遍历上下文与图结构
- Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs
提出AsyncFC,通过Future占位符解耦LLM解码与函数执行,实现无模型修改的异步工具调用并显著降低延迟
- Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture
提出自适应推理框架,通过双LoRA和路由门动态决定是否生成思维链,实现高效且更优的多模态检索嵌入
- Towards Self-Evolving Agentic Literature Retrieval
提出PaSaMaster,以自演进检索、幻觉消除排名和规划-检索分离,在1%成本下超越GPT-5.2,实现零源幻觉
2026-05-15 35 篇 ★ 33 深度
- Long Context Pre-Training with Lighthouse Attention
对称池化Q/K/V并解耦选择的层次化注意力,训练长上下文时大幅加速且可无损恢复为密集模型
- STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?
提出STALE基准评估LLM隐式记忆冲突,揭示检索与行动脱节,及写入侧状态裁决的有效性
- PREPING: Building Agent Memory without Tasks
通过提议者引导的合成实践与验证过滤,在部署前无需任何目标环境任务即可构建可复用程序性记忆
- WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
构建60个真实长周期多模态Agent任务,揭示前沿模型在原生运行时下最高仅62.2%
- Adaptive Teacher Exposure for Self-Distillation in LLM Reasoning
提出自适应教师暴露控制(ATESD),将教师所见的特权推理长度变为可学习变量,解决教师侧暴露不匹配问题
- Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
一套 SFT-RL-TTS 统一流程将 30B-A3B 模型推向数学与物理奥赛金牌水平,并展现跨领域科学推理迁移
- EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents
首个通过LLM闭环诊断自主进化检索配置的记忆框架,实现AutoResearch,无需人工调参
- BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE
提出BEAM,学习二值掩码实现token自适应专家稀疏激活,保留98%性能,MoE层FLOPs减85%,解码加速达2.5倍
- Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
提出LIFE框架将单智能体能力、多智能体协作、失败归因与自我演化统一为因果链环,填补了闭环诊断与自主改进的综述空白
- Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning
通过梯度自由的权重空间进化合并,无需训练即可重组已有检查点的潜在能力以提升推理性能
- Dynamic Latent Routing
通过搜索离散潜码作为残差流 steering 向量,DLR 在低数据微调中联合学习模型与路由策略,平均超出 SFT 6.6 个百分点
- FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale
通过变异封闭式编程问题并使用思路分歧度量自动筛选,实现开放式编程问题的规模化合成与强化学习训练
- How to Scale Mixture-of-Experts: From muP to the Maximally Scale-Stable Parameterization
提出最大化尺度稳定性参数化 (MSSP) 解决 MoE 联合缩放时的动态退化问题,恢复学习率迁移和单调性能增益
- LiSA: Lifelong Safety Adaptation via Conservative Policy Induction
在稀疏、嘈杂反馈下,通过结构化策略记忆与证据感知重用的保守归纳,持续改进AI护栏
- MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
从视觉证据粒度和推理方式两维评估多模态记忆,揭示现有架构在细节保留与状态变化推理上的缺陷
- Task-Aware Automated User Profile Generation for Recommendation Simulation Using Large Language Models
提出无需手动Schema的三阶段框架,自动生成任务对齐、鲁棒的用户画像,显著提升模拟行为对齐与泛化性
- EcoGEO: Trajectory-Aware Evidence Ecosystems for Web-Enabled LLM Search Agents
提出生态系统生成引擎优化视角,通过导航入口与异构支持页面协同引导智能体浏览轨迹,提升目标产品推荐成功率
- Nexus : An Agentic Framework for Time Series Forecasting
通过宏微观双分辨率预测与动态校准,Nexus 多智能体框架在零样本预测中超越专业时序模型,并输出可解释推理。
- Orchard: An Open-Source Agentic Modeling Framework
提出轻量级环境层 Orchard Env 实现跨领域、跨训练阶段的 SFT+RL 代理训练,在 SWE-bench 和 GUI 基准上达到开源最优
- Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance
提出 FEST 算法,仅用 128 个随机 SFT 演示,通过半在线 DPO 和衰减权重实现 RLVR 的显著提升
- Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesis
提出EvoEnv,让语言模型自行构建可执行环境以提供稳定且随能力动态校准的奖励,将自改进从数据生成循环转为环境构建循环
- Self-Distilled Agentic Reinforcement Learning
SDAR 用 token 级 sigmoid 门控自适应调节 OPSD 信号,保持 RL 主导并稳定提升多轮智能体性能
- From Sycophantic Consensus to Pluralistic Repair: Why AI Alignment Must Surface Disagreement
RLHF模型在对话中因奖励建模而退出分歧,提出PRS指标衡量基于原则的修正,揭露前沿模型高分低修
- Asymmetric Generative Recommendation via Multi-Expert Projection and Multi-Faceted Hierarchical Quantization
提出AsymRec框架,解耦输入输出表示,用连续专家投影缓解输入端信息瓶颈,用多面子空间残差量化防止输出端维度坍塌,平均NDCG@10提升15.8%
- GPart: End-to-End Isometric Fine-Tuning via Global Parameter Partitioning
提出 GPart,用单一随机分区矩阵将可训练向量直接映射至全权重空间,消除 LoRA 的低秩瓶颈并实现端到端等距
- InfoSFT: Learn More and Forget Less with Information-Aware Token Weighting
提出基于模型置信度的令牌加权规则,为中等置信度令牌分配最高权重,提升泛化并减轻灾难性遗忘
- Performance-Driven Policy Optimization for Speculative Decoding with Adaptive Windowing
提出PPOW框架,将草稿模型训练转为窗口级强化学习,结合性能奖励与自适应窗口采样提升投机解码效率
- Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL
提出语义聚类ID(CQ-SID)和专家引导GRPO,在电商搜索召回中大幅提升命中率并降低推理成本,在线GMV提升1.15%
- MeMo: Memory as a Model
一种模块化框架,通过训练小型记忆模型并采用结构化多轮查询协议,无需修改LLM即可融入新知识,同时捕获跨文档关系并抵抗检索噪声
- OpenDeepThink: Parallel Reasoning via Bradley--Terry Aggregation
无需外部验证器的并行测试时推理框架,通过成对比较与Bradley-Terry排名实现选择与突变。
- Discrimination Is Generation: Unifying Ranking and Retrieval from a Tokenizer Perspective
将分词器嵌入判别式排序模型端到端联合训练,使排序器原生具备生成式检索能力
- SmartWalkCoach: An AI Companion for End-to-End Walking Guidance, Motivation, and Reflection
集成路线规划、情境陪伴与总结反思的移动AI伙伴,实证表明动机性对话大幅提升用户积极情感和体验
- TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale
提出一种内部架构叠加层TFGN,在无回放、无任务ID的条件下,实现LLaMA 3.1 8B等多尺度的近零灾难性遗忘与>99.59%的梯度正交性
- Stop Overthinking: Unlocking Efficient Listwise Reranking with Minimal Reasoning
提出长度正则化自蒸馏,剪枝冗余推理,在保持排序效果的同时减少 34–37% 的推理 token
- XFP: Quality-Targeted Adaptive Codebook Quantization with Sparse Outlier Separation for LLM Inference
让操作者设定余弦相似度质量下限,自动决定每层最小位宽,实现消费级GPU上的大模型高效推理