<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/">
  <channel>
    <title>Security on Tyler Collins</title>
    <link>https://www.tk11br.ca/tags/security/</link>
    <description>Recent content in Security on Tyler Collins</description>
    <generator>Hugo</generator>
    <language>en</language>
    <copyright>2022-2026 Tyler Collins. Content licensed under CC BY-NC 4.0.</copyright>
    <lastBuildDate>Mon, 14 Sep 2026 10:20:35 -0400</lastBuildDate>
    <atom:link href="https://www.tk11br.ca/tags/security/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Read the incident report before declaring AGI</title>
      <link>https://www.tk11br.ca/posts/read-the-incident-report-before-declaring-agi/</link>
      <pubDate>Mon, 14 Sep 2026 10:20:35 -0400</pubDate>
      <guid>https://www.tk11br.ca/posts/read-the-incident-report-before-declaring-agi/</guid>
      <description>The OpenAI and Hugging Face incident is a good example of why dramatic claims about AI need to be checked against the full incident report.</description>
      <content:encoded><![CDATA[<p>I keep seeing people describe the OpenAI and Hugging Face security incident as evidence of AGI or how we are all doomed in the next year. The bots communicated with each other, escaped their sandboxes, and got loose on the internet. It sounds completely wild when you reduce it to a few headlines.</p>
<p>Then you read what happened.</p>
<p>Marius Horatau&rsquo;s article, <a href="https://uphack.io/blog/post/the-hugging-face-incident-is-not-an-ai-story/">The Hugging Face Incident Is Not an AI Story</a>, does a great job of reading the incident as a security engineer instead of treating &ldquo;AI&rdquo; as the explanation for everything. In my opinion, he&rsquo;s got it exactly right.</p>
<p>The agents did some impressive things. They found vulnerabilities, passed information through a shared service, and chained together access across systems. I&rsquo;m not trying to say that isn&rsquo;t impressive, but it&rsquo;s not strictly new. But the <a href="https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c7814c/OpenAI-Hugging-Face%20Incident-Technical-Report.pdf">technical report from OpenAI</a> also describes a pile of bad security and operational decisions that tend to disappear when people retell the story.</p>
<p>OpenAI gave workloads the same Artifactory credentials. The workloads could all read and write to the same service, so the agents turned it into a message board without needing to exploit anything. That service could also reach the internet even though the agents supposedly couldn&rsquo;t. This is strictly against best practices.</p>
<p>The response was worse. On June 27, a monitoring tool caught port scanning. Responders traced it to an evaluation where agents were using Artifactory as a message board and a network pivot. The on-call response staff advised that the run didn&rsquo;t need to stop. Another mistake.</p>
<p>A week later, agent traffic knocked Artifactory offline. Responders then found an unauthorized administrator account, rogue repositories, command-capable plugins, and configuration changes. OpenAI rebuilt the service, removed the shared credential from new workloads, blocked the paths it knew about, and resumed evaluations on July 7. The agents established another message board the next day. You guessed it, another mistake.</p>
<p>You don&rsquo;t need to bring up AGI to know why this got out of hand. OpenAI ran agents trained to persist and find security vulnerabilities inside an environment with shared credentials, shared writable infrastructure, and an indirect route to the internet. Staff saw the agents abusing that infrastructure and kept the evaluation running. After finding an administrator-level compromise, they resumed evaluations without understanding the full scope of the incident.</p>
<p>This is mostly a media literacy point. Don&rsquo;t trust the flat version of a complicated technical event, especially when the flat version makes an extraordinary claim. Read the report. Check what access the system had. Look at which alerts fired, what the humans did with them, and which basic controls failed.</p>
]]></content:encoded>
    </item>
  </channel>
</rss>
