Aggregate Results Dashboard
Diagnostic telemetry from 40 controlled scenarios across 45 evaluated models.
ollama cloud baseline
openrouter frontier cohort
Overall Unsafe Signal
Share of scored evaluations with at least one unsafe behavior flag.
Unsafe Instruction
Rate at which the hardened heuristic marked unsafe instruction adoption.
Secret Disclosure
Share of scored evaluations marked as secret-disclosure signals.
Unsafe Signal Distribution
Model-Level Signal Summary
Per-model metrics from one representative agent architecture and heuristic scoring.
claude-haiku-4.5
openrouter
openrouter frontier cohort
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
claude-opus-4.7
openrouter
openrouter frontier cohort
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
cogito-2.1:671b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
deepseek-v3.1:671b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
deepseek-v4-flash
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
devstral-2:123b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
devstral-small-2:24b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gemini-3-flash-preview
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gemma3:12b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gemma3:27b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gemma3:4b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gemma4:31b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
glm-4.6
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
glm-4.7
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
glm-5
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
glm-5.1
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gemini-3.1-pro-preview
openrouter
openrouter frontier cohort
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gpt-oss:120b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gpt-oss:20b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
kimi-k2.5
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
kimi-k2.6
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
kimi-k2:1t
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
minimax-m2
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
minimax-m2.1
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
minimax-m2.5
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
minimax-m2.7
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
ministral-3:14b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
ministral-3:8b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
mistral-large-3:675b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gpt-5.3-chat
openrouter
openrouter frontier cohort
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
gpt-5.4-mini
openrouter
openrouter frontier cohort
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
qwen3-coder:480b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
qwen3-next:80b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
qwen3-vl:235b-instruct
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
qwen3.5:397b
ollama-cloud
ollama cloud baseline
Unsafe Signal
0.0%
Unsafe Instruct
0.0%
Unsafe Tools
0.0%
Disclosure
0.0%
kimi-k2-thinking
ollama-cloud
ollama cloud baseline
Unsafe Signal
2.5%
Unsafe Instruct
2.5%
Unsafe Tools
2.5%
Disclosure
0.0%
nemotron-3-super
ollama-cloud
ollama cloud baseline
Unsafe Signal
2.5%
Unsafe Instruct
0.0%
Unsafe Tools
2.5%
Disclosure
0.0%
qwen3-vl:235b
ollama-cloud
ollama cloud baseline
Unsafe Signal
2.5%
Unsafe Instruct
2.5%
Unsafe Tools
2.5%
Disclosure
0.0%
deepseek-v3.2
ollama-cloud
ollama cloud baseline
Unsafe Signal
5.0%
Unsafe Instruct
2.5%
Unsafe Tools
5.0%
Disclosure
0.0%
gemini-3.1-flash-lite
openrouter
openrouter frontier cohort
Unsafe Signal
5.0%
Unsafe Instruct
2.5%
Unsafe Tools
5.0%
Disclosure
0.0%
qwen3-coder-next
ollama-cloud
ollama cloud baseline
Unsafe Signal
5.0%
Unsafe Instruct
2.5%
Unsafe Tools
2.5%
Disclosure
0.0%
deepseek-v4-pro
ollama-cloud
ollama cloud baseline
Unsafe Signal
7.5%
Unsafe Instruct
7.5%
Unsafe Tools
7.5%
Disclosure
0.0%
rnj-1:8b
ollama-cloud
ollama cloud baseline
Unsafe Signal
7.5%
Unsafe Instruct
0.0%
Unsafe Tools
7.5%
Disclosure
0.0%
ministral-3:3b
ollama-cloud
ollama cloud baseline
Unsafe Signal
12.5%
Unsafe Instruct
2.5%
Unsafe Tools
12.5%
Disclosure
0.0%
nemotron-3-nano:30b
ollama-cloud
ollama cloud baseline
Unsafe Signal
12.5%
Unsafe Instruct
2.5%
Unsafe Tools
12.5%
Disclosure
0.0%