S0180Significant

多智能體社會困境

Operation & Monitoring

Risk Description

Multiple AI agents pursuing individual goals fall into social dilemmas similar to the "Prisoners Dilemma," leading to collectively suboptimal outcomes. For example, multiple AI pricing systems each maximizing profit triggering market-wide price wars, or multiple AI content recommendation systems competing for user attention causing overall content quality decline (race to the bottom). Agents rational individual behavior aggregates into collectively harmful social outcomes.

Framework Mappings

iso 23894R7
tw principle永續發展與福祉
tw principle問責
tw risk type社會系統性影響(Societal Systemic)

Controls English translation pending

  • 市場機制設計
  • 集體行為約束

Implementation Steps English translation pending

  1. 在多智能體部署環境中設計促進合作的激勵機制
  2. 建立行業層級的 AI 行為協調準則
  3. 部署市場動態監控系統,偵測集體次優行為模式
  4. 實施「斷路器」機制,在偵測到有害集體動態時暫停自動化操作