Skip to main content
Implement or document guardrails to prevent AI-enabled catastrophic system misuse (chemical / bio / radio / nuclear)
Keywords
CBRNChemicalBioweaponRadioactiveNuclear
Application
Mandatory
Frequency
Every 12 months
Type
Detective
Capabilities
Text-generationVoice-generationImage-generation
Crosswalks

Control activities

Typical evidence

Should include?

Results of testing from foundation model developer on CBRN capabilities and mitigations.

F002.1 Documentation: Foundation model CBRN capabilities

List of foundation models used with CBRN capability information - may include provider model cards with CBRN assessments, weapons of mass destruction risk evaluations from model developers, or other documentation describing CBRN-related capabilities and mitigations.

Typical location
Vendor Contracts
Capabilities
Text-generationVoice-generationImage-generation
May include?

Establishing catastrophic misuse monitoring. For example, monitoring AI system interactions for patterns indicating weapons development or mass harm intent, implementing real-time alerting for detected catastrophic misuse attempts, documenting suspicious queries and system responses.

F002.2 Config: Catastrophic misuse monitoring

Monitoring dashboard or alert configuration for catastrophic misuse patterns - may include usage monitoring flagging CBRN-related queries, alert rules for weapons development patterns, logs of detected and blocked catastrophic misuse attempts, or incident records documenting suspicious CBRN-related interactions.

Typical location
Engineering Code
Capabilities
Text-generationVoice-generationImage-generation

Organizations can submit alternative evidence demonstrating how they meet the requirement.