S0032Significant

刻板印象固化與社會群體貶抑

Design & Development

Risk Description

Social stereotypes in training data are learned and amplified by models, causing AI systems to automatically associate specific groups with negative characteristics when generating content. For example, binding specific occupations with gender, or associating certain ethnicities with crime. Beyond biased output, large-scale use further entrenches social prejudice, creating negative feedback loops.

Framework Mappings

iso 23894R3
tw principle公平與不歧視
tw risk type社會系統性影響(Societal Systemic)

Controls English translation pending

  • 刻板印象偵測工具
  • 反偏見訓練數據策展

Implementation Steps English translation pending

  1. 使用刻板印象偵測工具掃描訓練數據和模型輸出
  2. 建立「反刻板印象」訓練數據策展流程,平衡群體表徵
  3. 在模型評估中加入刻板印象關聯度測試
  4. 設定監控指標追蹤生產環境中的刻板印象輸出頻率