{"id":1126,"date":"2026-11-02T23:30:00","date_gmt":"2026-11-02T23:30:00","guid":{"rendered":"https:\/\/cotocus.org\/blog\/?p=1126"},"modified":"2026-11-02T23:30:00","modified_gmt":"2026-11-02T23:30:00","slug":"aiops-for-security-eight-rules","status":"publish","type":"post","link":"https:\/\/cotocus.org\/blog\/aiops-for-security-eight-rules\/","title":{"rendered":"AIOps for Security: Eight Rules Worth Pinning Up"},"content":{"rendered":"<p>Every discipline eventually compresses into a handful of rules you could shout across a room, and the machine-assisted side of security operations is old enough to have its set. <strong>AIOps for Security<\/strong> \u2014 anomaly detection, alert ranking, LLM-assisted investigation, and the autonomy question they raise \u2014 has produced its rules the hard way, through deployments that skipped them. Here are the eight we think deserve a spot above the desk, written the way we&#8217;d explain them to a teammate over coffee.<\/p>\n<h2>Why AIOps for Security needs rules at all<\/h2>\n<p>Because enthusiasm is not evidence, and the failure stories all rhyme. A scoring model goes live, tickets vanish, dashboards turn green \u2014 and months later someone discovers the model was quietly wrong about an entire category, or was right for reasons nobody could defend. The rules below exist to keep the wins while catching the surprises before they become incidents. Most take an afternoon to apply; skipping any of them costs more. None of them is ours alone \u2014 every one traces back to a documented deployment, a published trial, or a researcher who got tired of watching the same accident repeat.<\/p>\n<ol>\n<li><strong>Score actions, not products.<\/strong> Autonomy attaches to what the system does, never to what the brochure says. Closing a phishing ticket, disabling an account, isolating a host \u2014 each earns its own level on its own file. The rungs: watch, advise, close unaided, act reversibly, and a top tier no machine reaches. Ask a vendor &#8220;which level is this, for which action?&#8221; and you will learn more in the pause than in the pitch. Platforms routinely hold several levels at once across their action set, so a single product-level answer is usually a dodge.<\/li>\n<li><strong>Learn your base rate before believing any accuracy number.<\/strong> Fifty million daily events with fifty real threats means one hostile item per million. A filter misfiring on one clean item in ten thousand leaves alerts at 0.9% precision \u2014 112 reads for every genuine catch \u2014 while a misfire rate of one per million lifts precision to 47.4%. Axelsson drew the same curve in 2000: attacks at 0.00002 with false alarms at 0.00001 gave 66.7% precision; relax the false alarms a hundredfold and 1.4% survives. Rare positives humble every loose detector, which is why the counting comes before the buying.<\/li>\n<li><strong>Make the machine earn each rung.<\/strong> Advising starts at a graded trial of 200-plus labelled alerts holding 30 or more genuine hits. Closing alone needs misses at 2% or lower over 150 true positives, canaries patrolling, a sealed holdout, and one-click reopen. Acting on systems demands wrong moves under 1% across 300-plus would-have-acted cases, rollback genuinely rehearsed, hard volume caps.<\/li>\n<li><strong>Never hand over the irreversible keys.<\/strong> The top of the ladder stays human permanently \u2014 not until the models improve, but as a design decision. Anything destructive, unrecallable, or reputationally unrecoverable belongs to people. Write it down so the next reorganisation doesn&#8217;t rediscover it the expensive way, and revisit the list whenever a new action class enters the queue, because &#8220;irreversible&#8221; has a habit of expanding once automation gets comfortable.<\/li>\n<li><strong>Split the categories or the average will lie to you.<\/strong> One deployment reported a 1% overall miss rate; zoom in and cloud-IAM alerts carried 42.3% misses, buried under a 9.1% phish rate inside the same average. Report per category, monthly, in writing. Averages comfort; categories inform.<\/li>\n<li><strong>Choose traps over spot-checks.<\/strong> Auditing a random slice of past closures barely tests anything: sample ninety-odd from a quarter&#8217;s auto-closes, find nothing wrong, and the true rate still sits near thirty-eight percent overhead, because spotless runs of n trials only cap the rate near 3-over-n. Canary records sample the danger on purpose \u2014 fifty a quarter, and the third one closed by the machine ends the privilege. Proving a 2% ceiling takes 236 graded cases with one miss found, 313 with two \u2014 arithmetic every buyer should be able to quote.<\/li>\n<li><strong>Treat every agent as attack surface.<\/strong> An agent that ingests attacker-authored text while holding outbound channels is a target with a mailbox \u2014 treat it the way you would treat any service account that also happens to read its mail. The NCSC&#8217;s 2025 argument still stands: prompt injection is not input validation with a better filter, because the model is a confusable deputy and deny-lists lose to endless rephrasing. Deterministic guards, least privilege, and outbound restrictions do the defending. A triage agent that can message users, upload files, or call external services has turned your detection layer into a delivery mechanism \u2014 audit those channels before an attacker does it for you.<\/li>\n<li><strong>Distrust &#8220;percent automated&#8221; as the goal.<\/strong> It measures ticket disposal, not threat disposal, and rewards exactly the wrong things. Gartner&#8217;s &#8220;AI washing&#8221; label exists because the vocabulary outruns the capability in a lot of decks. The honest headline number is the one from the blind trial: 93.5% of workload removable \u2014 alongside its twin, the 2 misses in 71 genuine threats that kept the agent off auto-close at a 2.8% miss rate with a 95% ceiling near 8.6%.<\/li>\n<\/ol>\n<h2>Two rules people argue about<\/h2>\n<p><em>&#8220;Can&#8217;t we just use the vendor&#8217;s number?&#8221;<\/em> Only as a prior, never as proof. Laboratory accuracy was earned on someone else&#8217;s traffic, someone else&#8217;s base rates, and someone else&#8217;s labelling choices; the first deployment audit almost always revises it downward. Gartner&#8217;s &#8220;AI washing&#8221; label exists precisely because the vocabulary travels faster than the capability, and a percentage that cannot name its sample size is marketing, not measurement.<\/p>\n<p><em>&#8220;What if we have no labels at all?&#8221;<\/em> Then the project starts with a spreadsheet, not a model. Export past dispositions, have two people independently classify a few hundred items, and measure how often they agree \u2014 that exercise alone usually teaches more about the queue than a quarter of vendor calls. Labels are the currency every later gate is paid in, and teams that skip this step find themselves unable to prove anything when the first hard question arrives.<\/p>\n<h2>Keeping the AIOps for Security rules honest<\/h2>\n<p>Rules fade unless something enforces them, so pin the enforcement to the calendar: monthly per-category scoring, an expiry date on every autonomy grant, and a standing question in each review \u2014 &#8220;what did the machine miss this month, and how do we know?&#8221; Teams building the wider skills behind this habit will find the <a href=\"https:\/\/cotocus.org\/blog\/essential-aiops-skills-every-modern-it-professional-needs\/\">Essential AIOps Skills Every Modern IT Professional Needs<\/a> a useful baseline, and the operational side pairs well with <a href=\"https:\/\/cotocus.org\/blog\/mastering-incident-management-with-aiops-for-faster-resolution\/\">Mastering Incident Management With AIOps for Faster Resolution<\/a>, which covers what happens when detection and response have to work as one motion.<\/p>\n<p>For the full specification behind rules one through four \u2014 the ladder, the gate values, the worked cases \u2014 the <a href=\"https:\/\/www.xopsschool.com\/aiops-for-security\/\">AIOps for Security cheat sheet worth bookmarking<\/a> collects it in one place. Planning sequences and milestones live in <a href=\"https:\/\/cotocus.org\/blog\/aiops-roadmap-a-practical-guide-for-devops-sre-and-operations-teams\/\">AIOps Roadmap: A Practical Guide for DevOps, SRE, and Operations Teams<\/a>, which slots the security branch into a longer operations journey.<\/p>\n<p>None of these eight rules needs a big budget. They need counting, writing things down, and the humility to let evidence outrank enthusiasm \u2014 a trade that pays for itself the first time the machine is wrong, and keeps paying every time after that. Print them, argue with them, cross a few out if you must; just don&#8217;t rediscover them by accident.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Eight field-tested rules for AIOps for Security: score actions not products, learn your base rate, earn every autonomy rung, and pick traps over spot-checks.<\/p>\n","protected":false},"author":4,"featured_media":1127,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[130],"tags":[],"class_list":["post-1126","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-it-operations"],"_links":{"self":[{"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/posts\/1126","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/comments?post=1126"}],"version-history":[{"count":1,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/posts\/1126\/revisions"}],"predecessor-version":[{"id":1162,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/posts\/1126\/revisions\/1162"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/media\/1127"}],"wp:attachment":[{"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/media?parent=1126"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/categories?post=1126"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cotocus.org\/blog\/wp-json\/wp\/v2\/tags?post=1126"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}