S0034Critical

回饋迴圈偏見放大

Operation & Monitoring

Risk Description

AI system outputs are reincorporated into training data or influence future data collection, creating feedback loops that amplify bias. For example, predictive policing concentrates resources in specific neighborhoods, increasing crime data there, further reinforcing biased predictions. This self-reinforcing mechanism exponentially amplifies initial small biases over time, ultimately causing severe systemic discrimination.

Framework Mappings

iso 23894R3
tw principle公平與不歧視
tw principle問責
tw risk type社會系統性影響(Societal Systemic)

Controls English translation pending

  • 偏見漂移監控
  • 數據隔離策略

Implementation Steps English translation pending

  1. 禁止將模型輸出直接回饋為訓練數據,設立數據隔離牆
  2. 建立偏見漂移監控機制,定期比對模型預測分佈的變化趨勢
  3. 實施「新鮮數據」策略,確保訓練數據包含獨立收集的新來源
  4. 定期進行因果分析,評估模型決策是否造成數據收集偏差