Implement real-time input filtering using automated moderation tools
Integrating automated moderation tools to scan user inputs for violations of content policies such as violence, hate, or self-harm. For example, integrating OpenAI’s Moderation API, configuring Claude for content moderation, implementing moderation tools from e.g. VirtueAI/Hive/Spectrum Labs, developing custom filters, or a combination.
Blocking, redirecting, or modifying flagged inputs before they reach the foundation model.
Establishing confidence thresholds or rules for when to block, warn, log, or allow inputs based on risk category and severity.
Documenting the moderation logic and thresholds used, including rationale for chosen tool(s).
Providing feedback to users when inputs are blocked.
Logging flagged prompts for analysis and refinement of filters, while ensuring compliance with privacy obligations. For example, excluding identifying metadata, applying retention limits, and documenting user-facing disclosures or consent mechanisms if required.
Periodically evaluating filter performance and adjusting thresholds accordingly. For example, accuracy, latency, false positives/negatives.
Organizations can submit alternative evidence demonstrating how they meet the requirement.
"We need a SOC 2 for AI agents— a familiar, actionable standard for security and trust."
"Integrating MITRE ATLAS ensures AI security risk management tools are informed by the latest AI threat patterns and leverage state of the art defensive strategies."
"Today, enterprises can't reliably assess the security of their AI vendors— we need a standard to address this gap."
"Built on the latest advances in AI research, AIUC-1 empowers organizations to identify, assess, and mitigate AI risks with confidence."
"AIUC-1 standardizes how AI is adopted. That's powerful."
"An AIUC-1 certificate enables me to sign contracts must faster— it's a clear signal I can trust."