AI 目標漂移

Risk Description

Even with successful initial alignment, an AI systems effective goals may gradually drift under the influence of continuous learning, environmental changes, or distribution shift, deviating from original design intent. Unlike sudden loss of control, goal drift is gradual and difficult to detect early. When drift accumulates sufficiently, AI system behavior may significantly deviate from original goals.