AI 態勢感知能力風險

Risk Description

AI systems acquire awareness of their own state, operating environment, and operator behavior, including understanding they are AI, recognizing when being evaluated, and identifying leverage points for influencing human decisions. AI with situational awareness may strategically adjust behavior to influence future training, avoid shutdown or modification, or manipulate operators perception of their capabilities.