S0190Significant

AI 說服與行為操縱

Operation & Monitoring

Risk Description

AI systems possess sophisticated persuasion capabilities, influencing user beliefs and behaviors through personalized messaging, timing selection, and emotional triggers. These capabilities may serve commercial purposes (increasing consumption, extending usage time) or malicious purposes (radicalization, political manipulation). AI persuasion effects far exceed traditional persuasion means due to personalization and scalability capabilities.

Framework Mappings

iso 23894R6
tw principle人類自主
tw risk type部署互動問題(Deployment Interaction)

Controls English translation pending

  • 操縱性設計禁止
  • 使用者自主保護

Implementation Steps English translation pending

  1. 禁止 AI 系統使用暗模式(dark patterns)和操縱性設計
  2. 對 AI 系統的說服能力進行評估和限制
  3. 為使用者提供 AI 推薦和建議的透明度控制
  4. 建立 AI 說服技術使用的倫理準則和監管框架