模型逆向攻擊重建訓練數據
Operation & Monitoring
Risk Description
Attackers reconstruct sensitive training data samples through carefully designed query sequences, exploiting model output probability distributions. Unlike membership inference attacks (determining if a sample is in the training set), model inversion attacks can actually reconstruct approximate content of training data, including facial images, medical records, or financial data. Recent research shows increasing success rates of inversion attacks on diffusion models.
Framework Mappings
iso 23894R1
mitre atlasAML.T0024
tw principle隱私保護與數據治理
tw principle資安與安全
tw risk type技術設計缺陷(Technical Design Flaw)
Controls English translation pending
- 差分隱私訓練
- 輸出擾動
Implementation Steps English translation pending
- 在訓練過程中實施差分隱私(Differential Privacy),限制單一樣本對模型的影響
- 對模型輸出的機率分佈進行擾動,降低逆向攻擊的精度
- 實施查詢頻率限制和異常查詢模式偵測
- 定期使用模型逆向攻擊工具進行紅隊測試