多模態提示注入

Risk Description

Attackers hide malicious instructions in non-text modalities such as images, audio, or video, exploiting multi-modal models understanding capabilities to trigger prompt injection. For example, embedding human-invisible but model-readable text instructions in images, or mixing hidden commands in ultrasonic frequency ranges in audio. As existing defenses primarily target text prompts, multi-modal injection often bypasses safety filters.