Back to articles
My AI Governance System Passed Its Own Audit. Then I Wrote One Rule. Now It Fails. That's the Point.

My AI Governance System Passed Its Own Audit. Then I Wrote One Rule. Now It Fails. That's the Point.

via Dev.to PythonDariusz Newecki

This morning CORE's audit looked like this: Rules declared: 115 Rules executed: 99 Total findings: 349 Final Verdict: PASSED ✅ By afternoon: Rules declared: 116 Rules executed: 100 Total findings: 380 Errors: 31 Final Verdict: FAILED ❌ I didn't break anything. I wrote two files. Here's what happened. The Gap CORE has a cognitive role system. Every AI call must go through a PromptModel artifact that declares which role handles the invocation. The rule is written in the constitution: "Cognitive role must be read from model.manifest.role , never hardcoded." The correct pattern: pm = PromptModel . load ( " my_artifact " ) client = await self . cognitive_service . aget_client_for_role ( pm . manifest . role ) The wrong pattern: client = await self . cognitive_service . aget_client_for_role ( " Coder " ) The constitution said this was illegal. But there was no rule enforcing it. So the audit couldn't see it. A quick grep confirmed what was hiding: grep -rn 'aget_client_for_role("' src/ | gre

Continue reading on Dev.to Python

Opens in a new tab

Read Full Article
0 views

Related Articles