2026年5月16日 (周六)
产品发行正从聊天转向高收盘工作流程,特别是金融,同时研究不断将代理行为作为谈判的基准,欺骗和对抗压力. 实际的外卖是将整合(账户、工具和权限)作为核心风险表面,而不仅仅是模型输出。
产品发行正从聊天转向高收盘工作流程,特别是金融,同时研究不断将代理行为作为谈判的基准,欺骗和对抗压力. 实际的外卖是将整合(账户、工具和权限)作为核心风险表面,而不仅仅是模型输出。
OpenAI 将个人财务工作流程带入 ChatGPT( 带有连接账户)
OpenAI和TechCrunch在ChatGPT中描述了一种新的个人财务经验,可以将财务账户连接起来,并以类似仪表板的视角呈现支出,订阅,即将支付的支付以及组合性能.
账户连接将一个助手变成一个动作相邻的系统. 颠倒是更好的个性化和更少的手动步骤. 缺点是错误、迅速注射和错误建议的一个更大的爆炸半径,因为这个模型现在是基于真正的平衡和交易,而不是一般建议。
- 01 Once you connect accounts, the primary risk shifts from “bad advice” to “bad actions” that can be taken or strongly suggested with high confidence.
- 02 Financial context increases user trust, so hallucinations and misclassifications become more costly. Clear provenance and uncertainty signaling matter.
- 03 Security expectations rise: you need strict permissioning, audit logs, and careful handling of third-party data flows (aggregators, OAuth scopes, export paths).
If you are shipping an AI feature that touches user finances, design for safe defaults: read-only by default, explicit confirmations for any action suggestions, always show the underlying transaction/statement evidence, and add “sanity checks” (e.g., unusual spend detection thresholds, duplicated charges, category confidence) before surfacing insights.
A new personal finance experience in ChatGPT
OpenAI announcement of a personal finance experience in ChatGPT with connected accounts.
OpenAI launches ChatGPT for personal finance, will let you connect bank accounts
TechCrunch coverage of account connection, dashboards, and feature details.
Zyphra声称用自递式LLM(有大速度)转换的MOE扩散模型
Zyphra发布了ZAYA1-8B-Difmusion-Preview,被描述为一种从自递式LLM转换而来的混合专家扩散模型,报告最高可达7.7×推论速度与自递式解码.
如果扩散式的解码能够提供相当的质量,对某些工作量的推论要快得多,则会改变部署经济学。 这也使评价复杂化:耐久性,质量,故障模式与标准的下一代不同.
- 01 Speed claims need apples-to-apples measurement (hardware, batch sizes, output length, and quality targets).
- 02 Diffusion-style generation can shift bottlenecks from memory bandwidth to compute, which may benefit newer GPUs where FLOPs scale faster than memory.
- 03 Operationally, a “different decoder” means different tuning knobs, monitoring signals, and robustness tests, so teams should not assume drop-in equivalence.
If you run latency-sensitive inference, add a “decoder bake-off” to your eval suite: fix a target quality bar (human preference or task metric) and compare cost-per-1k outputs, p95 latency, and error modes (repetition, factuality, refusal behavior) across autoregressive vs diffusion variants.
新的基准针对多代理环境中的战略行为和稳健性
一些新的ArXiv文件引入了谈判和虚张声势的多代理基准(Cattle Trade),LLM集体的对抗性强性(GAMBIT),以及辅导环境中的共性风险评价.
随着产品转向代理工作流程,失败模式较少涉及单一错误的答案,更多涉及战略操纵,欺骗和社会压力. 包括谈判、对抗代理人和“权威压力”在内的基准更接近实际部署条件。
- 01 Multi-agent systems can fail even if each individual model looks safe in isolation, because dynamics amplify weaknesses (trust, persuasion, collusion).
- 02 Sycophancy is not just an alignment curiosity, it can become a safety issue when the system is positioned as an educator or advisor.
- 03 Robustness evaluation should include adaptive adversaries that change tactics after they see defenses, not just fixed attack scripts.
If you deploy multi-agent workflows (planner plus tools, or ensembles), test with “red-team agents” that can bargain, mislead, or apply social pressure. Log full dialogue traces, define explicit stop conditions, and add a policy that forces independent verification for high-stakes claims (citations, cross-check steps, or tool-based validation).
Cattle Trade: A Multi-Agent Benchmark for LLM Bluffing, Bidding, and Bargaining
Multi-agent benchmark covering auctions, bargaining, bluffing, and long-horizon interaction.
GAMBIT: A Three-Mode Benchmark for Adversarial Robustness in Multi-Agent LLM Collectives
Benchmark for adversarial robustness in multi-agent collectives with multiple evaluation modes.
Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks
Position paper arguing for sycophancy benchmarks in LLM tutoring to prevent harmful agreeableness.
Bench提出一个评估LLM开发剂的能力梯队
将开发确定为增量能力而不是单一的二进制“是否崩溃”结果的基准,目的是衡量一种剂是否能够建立可重复使用的原始和控制。
SWE-Chain 用于编码代理评价的连锁软件包升级
一个旨在现实维护工作的基准,即代理人必须处理链条式的、释放级的依赖性升级,而不是孤立的问题。
神经状态-Bench评估代理人特征中的“承诺完整性”
一项通过确定性侧射线探测器,探究某一制剂是否在多回合任务中保持其既定承诺的基准。