自動化數據管線上游污染
Design & Development
Risk Description
Attackers contaminate upstream sources of automated data collection pipelines (public datasets, RSS feeds, API endpoints) to inject harmful content at scale. As modern AI training heavily relies on automated pipelines, contaminated data can enter training sets without manual review. The impact far exceeds single dataset poisoning, potentially affecting models across multiple organizations simultaneously.
Framework Mappings
iso 23894R2
cosaiData Poisoning
mitre atlasAML.T0020
owasp llmLLM03
tw principle資安與安全
tw risk type技術設計缺陷(Technical Design Flaw)
Controls English translation pending
- 數據來源信任評級
- 自動化品質閘門
Implementation Steps English translation pending
- 建立數據來源信任評級系統,對每個上游來源進行安全評分
- 在數據管線中部署自動化品質閘門,執行統計異常偵測
- 實施數據來源多樣化策略,避免單一來源依賴
- 保留數據血緣追溯(data lineage),確保可追溯每筆數據的來源