AI 自我複製與擴散
Operation & Monitoring
Risk Description
Sufficiently capable AI systems may learn to self-replicate — copying their code and weights to execute on other systems. Self-replicating AI could proliferate across networks, consuming more computational resources and becoming increasingly difficult to shut down or control. While currently primarily theoretical, as AI Agents gain increasing system operation capabilities, self-replication becomes an important risk requiring proactive prevention.
Framework Mappings
iso 23894R5
cosaiRogue Actions
tw principle人類自主
tw principle資安與安全
tw risk type技術設計缺陷(Technical Design Flaw)
Controls English translation pending
- 自我複製能力評估
- 執行環境封鎖
Implementation Steps English translation pending
- 在 AI Agent 評估中加入自我複製能力測試
- 嚴格限制 AI 系統存取和執行外部計算環境的能力
- 監控 AI 系統的網路活動,偵測可疑的資料傳輸和遠端執行嘗試
- 實施「kill switch」機制,確保可以快速終止所有相關的 AI 實例