法律 AI // 资讯总览
需要被持续追踪的
法律 AI 信号。
本期索引按监管、判例、实务与研究归档;可依主题或关键字定位已发布记录。
法律 AI // 资讯总览
本期索引按监管、判例、实务与研究归档;可依主题或关键字定位已发布记录。
原题: Evaluating Bounded Autonomy in Regulated Agentic AI: A Diagnostic Harness with Constitutional Rewards, Escalation Labels, and Runtime Governance
涉及人工智能算法备案、生成式模型合规红线与法律科技核心准则。
该论文提出 RegLLM 诊断框架,用于评估受监管智能体工作流中的有界自主性。框架通过引用有效性、来源依据、模式合规、升级决策正确性、宪法原则一致性和不安全行动率六项指标,区分程序验证器、任务级升级标签及 AI 评审三类监督来源。其运行时监督器会拦截缺乏依据的回答、强制升级并记录干预,同一领域规则同时用于评估、训练奖励和服务端防护。小规模离线测试显示,启用治理后,升级召回率由 0 提升至 0.67,不安全行动率由 0.33 降至 0.08;两组单 GPU 微调试验则显示配置差异可能压过调参效果。论文明确指出,现有样本仅具诊断价值,尚不足以证明适配器效果或生产可用性。
展示来源全文,完整内容以原文页面为准。
arXiv:2609.37501v1 Announce Type: new Abstract: We propose RegLLM, a diagnostic harness for bounded autonomy in regulated agentic workflows. It instruments six trustworthiness signals: citation validity, source grounding, schema compliance, escalation correctness, constitutional alignment, and unsafe-action rate. Signals are distinguished by their source of supervision: programmatic verifiers, task-level escalation labels, or AI-judge scores. A deterministic runtime supervisor blocks ungrounded answers and forces escalation, logging interventions. The same domain constitution informs evaluation, training rewards, and serving guardrails. Task-level should-escalate labels make the act-versus-defer decision a measurable training signal. We demonstrate the harness at smoke scale. An offline reference run (n=12) lifts escalation recall from 0 to 0.67 and reduces unsafe-action rate from 0.33 to 0.08 when governance is enabled. Two single-GPU Qwen2.5-3B LoRA/DPO pilots (n=8, same seed and evaluation split) expose substantial variation: nominally identical RL-base configurations yield task success of 0.25 versus 0.12 and escalation recall of 1.0 versus 0.5. An answer-quality adapter changes recall from 1.0 to 0.5 in Run A, but from 0.5 to 1.0 in Run B. An escalation-aware variant produces no measurable change in Run B. These small pilots do not establish reliable adapter effects or production readiness. Their contribution is diagnostic: configuration variance can overwhelm apparent tuning effects on bounded-autonomy metrics, motivating larger evaluation sets and repeated runs.
文书与研报规范引注
《受监管智能体有界自主性诊断研究》(来源: arXiv cs.CL,发布日期: 2026/10/01,访问链接: https://arxiv.org/abs/2609.37501)