上下文一致性追隨導致錯誤延伸
Operation & Monitoring
Risk Description
LLMs tend to maintain internal consistency in generated content. Once an erroneous statement is produced early in generation, subsequent output builds a "self-consistent" narrative around the error, leading to systematic error propagation and deepening. For example, after a first-step reasoning error, the model continues seemingly logical reasoning on false premises, producing "structurally correct but factually wrong" complete arguments.
Framework Mappings
iso 23894R5
tw principle透明與可解釋
tw risk type技術設計缺陷(Technical Design Flaw)
Controls English translation pending
- 分步驟事實驗證
- 推理鏈中斷檢查
Implementation Steps English translation pending
- 實施分步驟推理驗證,在每個推理步驟獨立檢查事實正確性
- 使用「自我反省」提示策略,要求模型回顧和質疑先前的推理
- 對關鍵推理任務使用多次獨立推理取共識結果
- 在使用者介面標示推理中的不確定環節,提醒人工驗證