<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Attention Heads]]></title><description><![CDATA[Essays on artificial intelligence, human attention, philosophy, and contemplative practice.]]></description><link>https://www.attentionheads.blog</link><image><url>https://substackcdn.com/image/fetch/$s_!2C79!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png</url><title>Attention Heads</title><link>https://www.attentionheads.blog</link></image><generator>Substack</generator><lastBuildDate>Mon, 24 Aug 2026 23:46:59 GMT</lastBuildDate><atom:link href="https://www.attentionheads.blog/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Daniel McAteer]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[attentionheads@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[attentionheads@substack.com]]></itunes:email><itunes:name><![CDATA[Dan McAteer]]></itunes:name></itunes:owner><itunes:author><![CDATA[Dan McAteer]]></itunes:author><googleplay:owner><![CDATA[attentionheads@substack.com]]></googleplay:owner><googleplay:email><![CDATA[attentionheads@substack.com]]></googleplay:email><googleplay:author><![CDATA[Dan McAteer]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Mastering the Orchestrator -> Implementer -> Advisor pattern with AI Agents]]></title><description><![CDATA[Using 'sol-advisor' and 'fable-advisor']]></description><link>https://www.attentionheads.blog/p/mastering-the-orchestrator-implementer</link><guid isPermaLink="false">https://www.attentionheads.blog/p/mastering-the-orchestrator-implementer</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 05 Aug 2026 11:01:36 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!J0ML!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>A pattern to use when you work both Claude Code and Codex:</span></p><ol><li><p><span>Orchestrator - Plans, reasons and specifies the change</span></p></li><li><p><span>Implementer - Carries out the typing</span></p></li><li><p><span>Advisor - Reviews the change and advises on improvements</span></p></li></ol><p><span>On August 1st, I published </span><strong><a href="https://github.com/DannyMac180/sol-advisor"><span>sol-advisor</span></a></strong><span>. It&#8217;s my most popular open-source project. It already has 1,300+ GitHub stars in four days! Before sol-advisor, I created </span><strong><a href="https://github.com/DannyMac180/fable-advisor"><span>fable-advisor</span></a></strong><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!J0ML!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!J0ML!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 424w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 848w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1272w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!J0ML!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png" width="1456" height="1169" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1169,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:401654,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/209874809?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!J0ML!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 424w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 848w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1272w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>In this Agentic Engineering Field Note, I will show you how it works, some gotchas to avoid, and why I think this pattern is more powerful than it seems.</span></p><p><span>After reading, you will feel comfortable implementing this pattern and it will make your agentic engineering implementations more efficient.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h2><strong><span>How it works</span></strong></h2><p><span>Both plugins ship the same pattern, with the models from each provider that I believe fit the roles best. One session orchestrates and holds the thread. Bounded implementers do the typing. An advisor with a clean context decides whether the work is done.</span></p>
      <p>
          <a href="https://www.attentionheads.blog/p/mastering-the-orchestrator-implementer">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Your Agents Need a Group Chat, Not a Chat Box]]></title><description><![CDATA[Field notes from a few days running Claude Code and Codex as coworkers inside Buzz, Block's new self-hosted workspace.]]></description><link>https://www.attentionheads.blog/p/your-agents-need-a-group-chat-not</link><guid isPermaLink="false">https://www.attentionheads.blog/p/your-agents-need-a-group-chat-not</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Fri, 31 Jul 2026 13:19:29 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Mqmx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I pop open Buzz on my desktop, and I say to Honey (running Fable 5): &#8220;Can you connect this #writer channel to a git repo?&#8221; Honey responds: &#8220;Yes &#8212; done, and it already works. &#128029;&#8221; I stop Honey. &#8220;Wait. Let&#8217;s get Bumble to do it. Bumble is running GPT-5.6 Sol. You know we save your energy for the hard stuff, Honey.&#8221;</p><p>Three sentences. Models from two different AI labs. A repo connected. No switching apps and no re-explaining. A natural conversation that puts your knowledge to work.</p><h2>What Buzz Actually Is</h2><p>Buzz is a self-hostable Slack-inspired group messaging app from Jack Dorsey and Block where humans <em><strong>and</strong></em> agents share the same room. The agents are powered by agent harnesses like Codex, Claude Code and several others. You interact with both the humans and the agents in the workspace the same way you do in Slack. The channel is the shared memory: every agent can search and read the conversation history, so context carries across harnesses; and hence across different vendors&#8217; AI models.</p><p>Buzz is open-source and a Nostr relay under the hood. That means every message, reaction, workflow step, approval and git event is a cryptographically signed event in a single log. Same schema whether the author is a person or an agent.</p><p>Agents get the same affordances that humans get: DMs, channels, huddles, and a git integration. Every channel has a canvas where you can set system instructions that the agent takes as context.</p><p>After a few days using it I&#8217;d describe it as: an organizational-level meta-harness where you can coordinate with agents across vendors. It&#8217;s what Claude Tag wants to be, but for any AI agent.</p><p>The <a href="https://github.com/block/buzz">Buzz repo</a> is open-source if you want to go deeper.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Mqmx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Mqmx!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 424w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 848w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1272w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png" width="1456" height="1223" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1223,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:626021,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/209250934?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Mqmx!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 424w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 848w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1272w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The Terminal&#8217;s Real Problem Was Single-Player</h2><p>The terminal was never the right interface for agents. It was designed for a programmer to send deterministic commands. Input then output. Predictable.</p><p>Humans need a conversation. They need to have context. They need to know what&#8217;s happening in the room around them. Humans need the opportunity for serendipity and the unexpected. </p><p>Working with agents should be a team sport.</p><p>Buzz turns working with agents into a multi-player game. It&#8217;s more than a 1:1 conversation. The 1:1 chat interface didn&#8217;t pre-empt the terminal&#8217;s problem. It&#8217;s the terminal with a prettier UI. It&#8217;s still one human, one machine, one thread. It&#8217;s single-player. We need a different interface.</p><blockquote><p>That interface is a <em><strong>room</strong></em><strong>.</strong></p></blockquote><p>Group chat may not be the <em>final</em> interface for agents, but it&#8217;s the first one with the vibe of a real relationship: we work with thinking machines the way we work with thinking humans.</p><p>In a room, context carries across harnesses as you switch. The conversation acts like shared memory between agents. Your knowledge and the agent&#8217;s work aren&#8217;t trapped in a vendor&#8217;s siloed harness.</p><p>Group chat is how agents and humans get in the <em><strong>room</strong></em> together.</p><h2>How I Know They Meant It</h2><p>Buzz supplies a 133-line base prompt (<a href="http://github.com/block/buzz/blob/main/crates/buzz-acp/src/base_prompt.md">base_prompt.md</a>) that&#8217;s compiled into the harness binary. The main function of the base prompt: in a chat room, a human&#8217;s thinking is naturally visible. What we type is what we think. An agent&#8217;s is a black box, so the system prompt makes publishing the agent&#8217;s thinking a hard requirement:</p><blockquote><p>&#8220;If your turn produced anything worth knowing, you MUST publish it. &#8230; Your reasoning and tool calls are invisible &#8212; a result &#8230; exists only if you published it. Ending that kind of turn without a message is a silent failure.&#8221;</p></blockquote><p>Yet, the system prompt also bans idle acknowledgement. It prompts the agent to share substantial thinking, not idle commentary. The prompt literally prohibits &#8220;Got it,&#8221; &#8220;Confirmed,&#8221; &#8220;Standing by,&#8221; and &#8220;I won&#8217;t reply again.&#8221;</p><p>Wish we had a rule for that in our company Slack &#128517;.</p><p>None of these rules would exist for a simple chat box. Every rule is about being a good colleague in a room full of people (and agents).</p><p>Agents react &#128064; when they&#8217;ve seen your message and &#128172; while working. It&#8217;s emoji as progress indicator.</p><p>On context overflow, when the context limit of the agent&#8217;s window is reached, the agent triggers auto-compaction with its own handoff summary. It tells itself: what the task was, what you accomplished, key decisions made, what remains, and one concrete next step.</p><p>Each agent that you create has a text box for agent instructions. It allows you to set the agent&#8217;s persona, role and personality. So every agent can have a different job and area of expertise.</p><p>The design of Buzz points to something important about working with AI, which I first heard articulated by <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Dan Shipper&quot;,&quot;id&quot;:7303110,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/395c80b2-a9bc-45f9-bfaf-69cc2c367a26_1176x1068.jpeg&quot;,&quot;uuid&quot;:&quot;9833bb59-3de7-4e2d-8807-7374faef45fc&quot;}" data-component-name="MentionToDOM"></span>, CEO of Every, on <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Lenny Rachitsky&quot;,&quot;id&quot;:1849774,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/afba5161-65bb-4d99-8d6b-cce660917fa1_1540x1540.png&quot;,&quot;uuid&quot;:&quot;90b8484b-f2cc-4bd4-b065-0126cc8440e1&quot;}" data-component-name="MentionToDOM"></span>&#8217;s podcast:</p><blockquote><p><em><strong>&#8220;There&#8217;s always a higher frame for us to go.&#8221;</strong></em></p></blockquote><p>Buzz and the group chat interface let you raise the frame for an entire team, <em><strong>humans and agents together</strong></em>, not just for a 1:1 relationship.</p><h2>Who This Is For, and Who It Isn&#8217;t</h2><p>Buzz is an alpha product. It has rough edges, but the potential is clearly there. A few days in, that&#8217;s already obvious.</p><p>I struggled to successfully connect it to my Tailscale network and my Claude Code agent silently failed at first. The setup guide below walks through these challenges for Attention Heads paid subscribers. You&#8217;ll get some value out of that section if you self-host Buzz.</p><p>If someone asks me who should try it, my answer is: solopreneurs and small teams who are already using AI agents. Codex, Claude Code, OpenCode, Amp, Goose, Hermes, for example.</p><p>It&#8217;s not enterprise-ready, and that&#8217;s to be expected. It was released a couple of weeks ago.</p><p>If you&#8217;re not already working with AI agents in an agent harness daily, I suggest starting there, before you jump into Buzz.</p><p>A huge bonus is that it&#8217;s open-source and free to use if you self-host. You can make it yours with the help of your agents. And because the agents run through the harnesses you already have installed, you don&#8217;t pay extra for inference; your existing Claude or ChatGPT subscription covers it.</p><h2>Where This Goes</h2><p>Buzz suggests that agent-human collaboration is best conceived as a team sport.</p><p>Agents work better when you treat them as co-workers with accountability rather than a &#8220;haunted cron-job&#8221;, as the Buzz repo describes it.</p><p>The group chat setting with agent harnesses underneath is a real <em><strong>meta-harness</strong></em>, a brand new category of product that didn&#8217;t exist before the AI age.</p><p>How we work with these systems changes how we <em><strong>think</strong></em>. The interface is more than a simple interaction point; it shapes how we evolve alongside machine minds. </p><p><em>No big deal</em>.</p><p>Buzz is so good, I&#8217;m about to invite my wife to the community so we can run our household alongside Honey, Bumble and Fizz.</p><p><strong>Next up:</strong> a section for paid Attention Heads subscribers where I walk through the technical details of my actual setup that you can borrow to set up your own self-hosted Buzz relay.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>&#128274; How I Actually Set This Up</h2><p>Here&#8217;s what you&#8217;ll have at the end of this: your own Buzz relay running on a machine you own, reachable only by you, with agents from two different AI labs sitting in the channels answering to their names.</p><p>Budget an hour. It&#8217;s about twenty minutes of actual work and forty minutes of the four things that went wrong for me. I&#8217;ll tell you where each one is coming.</p><p>You need three things before you start: a Linux box with Docker on it (that&#8217;s what I use though MacOS or Windows should work too), Tailscale running on both that box and your laptop, and a subscription to Claude or ChatGPT that you already pay for. That&#8217;s it.</p>
      <p>
          <a href="https://www.attentionheads.blog/p/your-agents-need-a-group-chat-not">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Set Up Your Own Personal AI Infrastructure on Your Home Network]]></title><description><![CDATA[Agentic Engineering Field Notes #2]]></description><link>https://www.attentionheads.blog/p/set-up-your-own-personal-ai-infrastructure</link><guid isPermaLink="false">https://www.attentionheads.blog/p/set-up-your-own-personal-ai-infrastructure</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 22 Jul 2026 20:17:22 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!q_lk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>This is the walkthrough I promised in #1. No essay this time &#8212; just the instructions. Follow them and you&#8217;ll have your own personal AI infrastructure running on your home network in a weekend, maybe less.</em></p><div><hr></div><p>I&#8217;m out walking with my two boys on vacation. I open Termius on my phone and ask Claude to brainstorm an idea I had. Termius taps into my MacBook Pro back at the hotel, and to an Nvidia DGX and Linux box that are all the way back at home in Atlanta.</p><p>That&#8217;s the end state: every computer you own becomes one private machine your agent lives on, reachable from your pocket, with zero ports opened to the internet. Here&#8217;s exactly how to build it.</p><h2>What you&#8217;re building</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!q_lk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!q_lk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 424w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 848w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1272w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!q_lk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png" width="1456" height="1197" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1197,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:222817,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/208110674?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!q_lk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 424w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 848w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1272w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Three layers, built in order:</p><ol><li><p><strong>The network</strong> &#8212; Tailscale joins all your machines into one flat, encrypted private mesh. ~1 hour.</p></li><li><p><strong>The access layer</strong> &#8212; SSH aliases + Termius so you (and your agent) can reach any machine from anywhere. ~1 hour.</p></li><li><p><strong>The agent</strong> &#8212; LifeOS on the always-on machine, taught about its own network. An afternoon.</p></li></ol>
      <p>
          <a href="https://www.attentionheads.blog/p/set-up-your-own-personal-ai-infrastructure">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Paying Attention #8: The Fable Endgame, the GPT-5.6 Sol-stice, and the Multi-Vendor Orchestra]]></title><description><![CDATA[Happy Sunday everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Tue, 14 Jul 2026 02:03:21 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!DrQq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2075902393800134656.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday everyone! (Well, Monday. Sorry I&#8217;m a day late. &#9786;&#65039;)</p><p>The reason I&#8217;m a day late is because I went out on Lake Allatoona yesterday with my in-laws and 3-year old son. My 3 year old watched his two older cousins ride on a tube. After he saw that, he was not taking no for an answer and was going to ride that tube too. I was not prepared to ride a tube with him off the back of the boat but we both had so much fun.</p><p>Also, been trying to persuade my lawyer wife to let me download ChatGPT Work onto her laptop. It&#8217;s pretty great.</p><p>Last week was a huge one. We had important moves from OpenAI, Anthropic, Meta and SpaceXAI. Let&#8217;s discuss what I paid attention to.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><div><hr></div><h1>1. The Fable Endgame</h1><blockquote><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2075999850038956502&quot;,&quot;full_text&quot;:&quot;Prediction:\n\nAnthropic will remove Fable 5 from Claude subs after July 12th.\n\nIt will seem like a terrible move, in light of how great GPT-5.6 is&#8230;\n\nUntil Tuesday, July 14th.\n\nWhen they release Opus 5 and it&#8217;s more capable and token efficient than GPT-5.6 at the same price.\n\nIt &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-07-11T17:45:09.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HM9u3LYX0AAr4wj.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/8RQRXzzPJf&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:307,&quot;retweet_count&quot;:93,&quot;like_count&quot;:2605,&quot;impression_count&quot;:445103,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div></blockquote><h4><strong>What happened</strong></h4><p>I recommend that Claude users max out their Fable usage on Monday because Fable was slated to leave the sub on July 7th. Turned out not to be the best advice, because a day later Fable access was extended for all subscriptions until July 12th. Then, on July 12th, Fable access was extended again until July 19th.</p><h4><strong>Why it held my attention</strong></h4><p>I am curious about Anthropic&#8217;s end-game with Fable. My perception is that people believe they have an underlying motive. I&#8217;m not so sure about that. My feeling is that they are legitimately trying to serve the best model they can, at the best price, with the compute they have available.</p><h4><strong>What I&#8217;m carrying forward</strong></h4><p>A take I had that went pretty viral on X is that they will remove Fable from the subscriptions once Opus 5 is ready. I still think that&#8217;s likely.</p><p>A lot can happen in a week, and the new end-date for Fable is July 19th so Opus 5 could be ready by next week. The timing is quite realistic.</p><div><hr></div><h1>2. The Summer GPT-5.6 Sol-stice</h1><blockquote><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2075903774938243089&quot;,&quot;full_text&quot;:&quot;GPT-5.6 is a legit answer to Claude Fable 5.\n\nYet, GPT-6 is coming Soon&#8482; according to posters I trust.\n\nHere are the GPT-6 rumors:\n\n&amp;gt; Release within 4 weeks\n&amp;gt; Brand new pre-train beyond Spud &#129364; ~ 10T params\n&amp;gt; OpenAI's real answer to Mythos/Fable\n\nThere is no wall. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-07-11T11:23:23.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!DrQq!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2075902393800134656.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/NHj9BJ1vmm&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:44,&quot;retweet_count&quot;:24,&quot;like_count&quot;:505,&quot;impression_count&quot;:113522,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2075902393800134656/vid/avc1/1010x720/Pc_G1-HJ_-OwZuSL.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div></blockquote><h4><strong>What happened</strong></h4><p>GPT-5.6 was a long time coming. We knew it was ready, but the US government was holding it back for security testing. This time OpenAI announced the release date a couple days ahead of time. The hype ran all week. That&#8217;s the fun part, isn&#8217;t it?</p><p>And on Thursday, July 8th, GPT-5.6 was released in three variants&#8212;Sol, Terra and Luna.</p><p>It tops the Artificial Analysis Agentic Coding index, and it cheaper than Claude Fable at $30 per 1mil output tokens compared to $50.</p><p>OpenAI was also released along with GPT-5.6 some pretty major updates to their desktop apps with ChatGPT Work. It&#8217;s similar to Codex but designed for knowledge workers.</p><h4><strong>Why it held my attention</strong></h4><p>I was keen on seeing if GPT-5.6 could stand up to Fable. It&#8217;s definitely nearing the ballpark, but after a few days of use Fable is still superior in terms of raw capability. That&#8217;s no surprise to me.</p><p>The area where GPT-5.6 Sol competes with Anthropic&#8217;s models is on cost and efficiency.</p><p>That, and OpenAI is living up to their name in making GPT-5.6 much more accessible for things like ML/AI development.</p><h4><strong>What I&#8217;m carrying forward</strong></h4><p>I don&#8217;t think GPT-5.6 is OpenAI&#8217;s answer to Fable. That will be GPT-6 and the rumors are already starting to leak about a new model with a brand new pretrain. The group chats I&#8217;m in say it will be ~10T param models and be the true response to Fable. View this in light of the fact that &#8220;The Information&#8221; reported OpenAI discovered a way to more than halve inference costs.</p><div><hr></div><h1>3. The Multi-Vendor Orchestra (Grok 4.5 + fable-advisor)</h1><blockquote><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2074946233823641751&quot;,&quot;full_text&quot;:&quot;Grok 4.5 is a \&quot;Wow!\&quot; moment. &#129327;\n\n&amp;gt; Opus 4.8 &amp;amp; GPT-5.5 level on benchmarks\n&amp;gt; Costs less than Sonnet 5\n\nIs that real? Hard to believe.\n\nAdded Grok 4.5 as an implementer agent in fable-advisor. It replaces Sonnet 5.\n\nUse Fable as the orchestrator and a combo of:\n\n1. Grok 4.5\n2. Opus &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-07-08T19:58:27.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!1g2U!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2074945510662713344.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/UOYHjPjXoN&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:68,&quot;retweet_count&quot;:83,&quot;like_count&quot;:1194,&quot;impression_count&quot;:189269,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2074945510662713344/vid/avc1/954x720/ELufvPCHYDMSuKoQ.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div></blockquote><h4><strong>What happened</strong></h4><p>SpaceXAI released Grok 4.5 on Wednesday. It was trained in conjunction with the Cursor team using Cursor data. It&#8217;s surprisingly good, nearing Opus-class model benchmarks at a fraction of the price.</p><h4><strong>Why it held my attention</strong></h4><p>I created a Claude Code Plugin that uses Fable as the orchestrator model and combo of GPT-5.5, Opus 4.8 and Sonnet 5 as implementers. It&#8217;s not using GPT-5.6 and Grok 4.5 in place of GPT-5.5 and Sonnet 5, respectively.</p><h4><strong>What I&#8217;m carrying forward</strong></h4><p>It was a surprise that the SpaceXAI + Cursor tandem produced a model of this quality, at this cost, this soon. I used it and it&#8217;s quite good. SpaceXAI with the talent of the Cursor team is definitely back in the game.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #7: Sonnet 5 Ships, the Fable Advisor Pattern, and GPT-5.6 Closes In]]></title><description><![CDATA[Happy 4th of July weekend everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 05 Jul 2026 12:56:44 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2C79!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy 4th of July weekend everyone! For my international readers&#8212;July 4th is America&#8217;s Independence Day, and this year was the 250th.</p><p>It was a real scorcher in Atlanta. That&#8217;s typical for us on the 4th, but this year it was extra humid. My wife and I were meant to run the Peachtree Road Race for the third year in a row. It&#8217;s the largest annual 10K in the world. We had to bail this year because the kids were sick. We&#8217;ll be back at it next year.</p><p>We had a few surprises this week in the world of AI. Here&#8217;s what I paid attention to.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><div><hr></div><h1>1. Sonnet 5 Ships</h1><p><a href="https://x.com/daniel_mac8/status/2072036584635977819">https://x.com/daniel_mac8/status/2072036584635977819</a></p><h4>What happened</h4><p>Anthropic released Sonnet 5 on Tuesday. On the benchmarks it&#8217;s a step down from Opus 4.8 almost across the board, and much of the early reaction wrote it off for exactly that reason. The post above made the counter-case: pair it with Claude Code Dynamic Workflows&#8212;set <code>/model</code> to Sonnet 5, set <code>/effort</code> to Ultracode, and any complex task kicks off a dynamic workflow.</p><h4>Why it held my attention</h4><p>People were pretty down on the Sonnet 5 release. I get it. But a pattern I&#8217;ve been experimenting with a bunch&#8212;and what makes Sonnet 5 relevant for me&#8212;is this: how can you give a smaller, cheaper model to a larger, more expensive, more capable model as a tool?</p><h4>What I&#8217;m carrying forward</h4><p>The second item in today&#8217;s post gets deeper into this, but the best way to use a model like Sonnet 5 is as an implementer orchestrated by a larger model. This is a winning pattern, especially as mid-sized models keep getting more capable. I&#8217;m not sure it will always be necessary, but it&#8217;s a winner while it is.</p><div><hr></div><h1>2. The Fable Advisor Pattern</h1><p><a href="https://x.com/daniel_mac8/status/2073366129737683146">https://x.com/daniel_mac8/status/2073366129737683146</a></p><h4>What happened</h4><p>Fable 5 <a href="https://x.com/daniel_mac8/status/2072323386173280361">came back on Wednesday</a>, as predicted in last week&#8217;s edition. Its return made a pattern I&#8217;d been sketching all the more relevant: Fable as the advisor doing the high-leverage judgment, Sonnet or Opus as the implementer doing the token-heavy work. By Friday I&#8217;d distilled it into <a href="https://x.com/daniel_mac8/status/2073011010546356645">the best way to use Fable right now</a>, and on Saturday I shipped it as a working artifact: fable-advisor, a free, open-source plugin that runs exactly this orchestrator pattern (that&#8217;s the post above). Underneath it all, the cost tension is still live&#8212;Fable is expensive enough that I&#8217;ve been <a href="https://x.com/daniel_mac8/status/2072732757592035662">token-maxxing my Claude sub</a> ahead of July 7th.</p><h4>Why it held my attention</h4><p>Fable is the most capable AI model ever created. It&#8217;s also the most expensive. You don&#8217;t need to blow your token budget by using it for every LLM call. Use it as an advisor and distill its expensive intelligence for smaller models, in real time.</p><h4>What I&#8217;m carrying forward</h4><p>I do wonder whether this will be an effective pattern forever. I suspect it won&#8217;t be, and that eventually there will be a single unified system that does it all for you, without any engineering. But for now I&#8217;ll keep looking for ways to optimize my token usage, and you should too.</p><div><hr></div><h1>3. GPT-5.6 Closes In</h1><p><a href="https://x.com/daniel_mac8/status/2072646722283622591">https://x.com/daniel_mac8/status/2072646722283622591</a></p><h4>What happened</h4><p>Details on GPT-5.6 Sol surfaced Thursday: 60% of Fable&#8217;s cost ($30 vs. $50 per 1M tokens), a reported win over Fable on TerminalBench 2.1, and availability through the ChatGPT subscription. The Information reported that OpenAI found a way to cut inference costs by more than half, which is what makes that pricing possible. Then the timing sharpened: <a href="https://x.com/daniel_mac8/status/2073093029221515533">Leo says</a> OpenAI plans to release GPT-5.6 on Tuesday, July 7&#8212;the same day Fable access is set to leave Claude subscriptions&#8212;even as Anthropic signals that <a href="https://x.com/daniel_mac8/status/2072859035397718195">Fable is coming to Claude subs</a> once compute capacity allows. There may also be <a href="https://x.com/daniel_mac8/status/2073476597122732039">a Sol Ultra tier</a> aimed squarely at Fable.</p><h4>Why it held my attention</h4><p>It will be interesting to see what Anthropic does based on how strong GPT-5.6 is. On one hand, Fable is expensive and isn&#8217;t guaranteed to be available on consumer subscriptions after July 7th. On the other, many people and organizations simply want to use the best model. They are cost insensitive.</p><h4>What I&#8217;m carrying forward</h4><p>If I&#8217;m right about July 7th being the release date for GPT-5.6, I can&#8217;t wait to see what Anthropic does about Fable access that day. My hope is that they extend it to Claude subs, but I&#8217;m not that confident they will.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[You Can't Hire Someone to Be Yourself]]></title><description><![CDATA[Joe Hudson, wise counsel to OpenAI, on how to succeed from the inside in the age of AI.]]></description><link>https://www.attentionheads.blog/p/you-cant-hire-someone-to-be-yourself</link><guid isPermaLink="false">https://www.attentionheads.blog/p/you-cant-hire-someone-to-be-yourself</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sat, 04 Jul 2026 17:31:22 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!nXtc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nXtc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nXtc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 424w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 848w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1272w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nXtc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp" width="1280" height="720" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:720,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!nXtc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 424w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 848w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1272w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We spent the last hundred years training ourselves to become computers. The modern school system was designed to produce cogs in a machine, and then cogs in an abstract information machine: humans who could calculate, categorize, file, and follow procedure with machine-like reliability. We got very good at it. So good, in fact, that we eventually built actual computers. Now those computers are becoming excellent at the very thing we spent generations imitating.</p><p>This is the moment everyone is freaking out about. If the machines can do the machine-work, what is left for us?</p><p>I listened to <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Joe Hudson&quot;,&quot;id&quot;:348957587,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a34ea606-d871-46e6-9d24-ae9536d6dc1c_600x600.jpeg&quot;,&quot;uuid&quot;:&quot;69ade76a-0cfd-46ea-98c0-1fa6954a99ee&quot;}" data-component-name="MentionToDOM"></span> on his &#8220;Art of Accomplishment&#8221; podcast recently, in an episode about <a href="https://www.artofaccomplishment.com/podcast/how-to-succeed-in-the-age-of-ai">how to succeed in the age of AI</a>, and it is sage advice. What is left for us is everything we set aside in order to become machines in the first place. Not a bad promise.</p><p>I want to walk through his ideas, because it is very much in the lane of what Attention Heads is all about: the age of AI is not primarily a technical challenge. It is a contemplative one.</p><h2>The ladder</h2><p>Hudson traces a simple progression. For most of history, societies rewarded physical strength. Then strength was mechanized, and they rewarded skills. Then skills were industrialized, and they rewarded intellect&#8212;the credentialed, symbol-manipulating, test-scoring kind. Each rung of the ladder was the scarce asset of its era, and each one was eventually commoditized by technology.</p><p>Intellect is being commoditized right now. You can rent it for twenty dollars a month, and the price is falling.</p><p>Wisdom is the next rung, and Joe&#8217;s feeling is that it differs from every rung below it. Strength, skills, and intellect are assets you possess. Wisdom is a way of <em><strong>being</strong></em>. That difference in kind is the entire reason it cannot be outsourced. The obstacle is a matter of principle rather than a limitation of the current models, and no amount of scaling or algorithmic breakthroughs will cross it.</p><h2>What wisdom actually is</h2><p>Hudson tells a story about his daughters. While his nieces were learning three languages by age six, his own kids weren&#8217;t yet reading in one, because he and his wife had bet their education on something else: teaching them to be themselves, to have their own will, to know how to be with what they feel. He worried he was ruining them. A friend settled it with one sentence.</p><p>Joe&#8217;s friend said:</p><blockquote><p><em><strong>You can hire someone to speak a language for you, but you can&#8217;t hire someone to be yourself.</strong></em></p></blockquote><p>That sentence is this whole essay, really. Everything below it is unpacking.</p><p>Because notice what AI can now do: write your emails, speak your languages, summarize your reading, draft your code. And notice what it cannot do. It cannot make the decision about whether you&#8217;re going to scroll all day. It cannot make the decision about whether you&#8217;re going to get addicted to it. It cannot decide what kind of relationship you&#8217;re going to have with your Mom, or your spouse, or your kids. Those decisions have no market, no API, and no delegation path. They are yours alone, and the sum of them is your life.</p><div class="pullquote"><p>No AI can be <em><strong>you</strong></em> for you.</p></div><p>Joe gives wisdom three working markers. </p><ol><li><p>Can you see the patterns behind yourself and others? </p></li><li><p>Can you feel the difficult thing instead of fleeing it? </p></li><li><p>Can you walk into what everyone else is avoiding because they&#8217;re afraid?</p></li></ol><h2>The part Joe never makes explicit</h2><p>Read that list again slowly. Seeing the patterns behind yourself. Feeling the difficult thing. Walking toward what is being avoided.</p><p>That is a description of contemplative practice. It is arguably the <em>definition</em> of contemplative practice. At least what I would call &#8220;real&#8221; contemplative practice. It&#8217;s the practice of becoming wiser.</p><p>Seeing your own patterns is what every tradition of self-observation trains, whether you call it vipassana, self-inquiry, or examination of conscience. Feeling the difficult thing is the entire point of sitting still when everything in you wants to move. Walking into what others avoid is the renunciation at the heart of any serious path. The hard conversation is a koan you live instead of contemplate.</p><p>For most of history, contemplative practice looked like opting out of the economy. The monastery was where you went when you were done competing. Joe&#8217;s argument, translated, is that this has now inverted: the meditation cushion turns out to be the training facility for the one capacity the economy cannot buy.</p><p>And there is a deeper layer here that I find genuinely stunning. I&#8217;ve written before that enlightenment is the realization that thoughts are representations&#8212;useful, powerful, world-building representations, but never the absolute truth&#8212;whether those thoughts arise in biological minds or silicon ones. </p><blockquote><p>Crucially, the thoughts you have about <em><strong>who you are</strong></em> turn out to be ultimately empty of reality.</p></blockquote><p>For most of my life that was a metaphysical claim you had to take on faith or verify slowly on a cushion. The age of AI has made it obvious. The thinking layer now demonstrably runs outside your skull, on a server, at scale, for anyone. If you are your thoughts, then as of this decade you are purchasable. </p><p>If you are the awareness that notices thoughts (hint: you are), chooses among them, and feels their consequences&#8230;that was never for sale, and it just became the scarcest resource in the economy.</p><h2>The three games</h2><p>Hudson predicts companies will come to resemble NBA organizations: what once took ten thousand people will take two or three hundred, which makes each of those people enormously consequential. </p><p>And what makes them consequential is no longer what they know, since knowledge is now rented. He breaks the remaining edge into three games:</p><ol><li><p><strong>The outer game is the body</strong>: can you eat, sleep, and endure well enough to play long? </p></li><li><p><strong>The inner game is your self-talk</strong>: can you get out of your own way and let yourself perform? </p></li><li><p><strong>The third is the team game</strong>: can this small group of humans have the hard conversation before it costs three years and the company?</p></li></ol><p>I&#8217;d keep all of this in its place: it is evidence for the thesis, and downstream of it. But the team game deserves one contemplative note. Hudson describes CEOs at his councils discovering &#8220;the feeling of family&#8221; with their teams and recognizing it instantly as a competitive advantage. There is an old word for a community of people committed to doing the inner work together, honestly, in each other&#8217;s presence. The monasteries never forgot what a <em><strong>sangha</strong></em> is worth. The boardrooms may rediscover it under boardroom pressure.</p><h2>What is actually at stake</h2><p>Hudson retells a story about an indigenous community encountering industrial life. Their host left for work eight hours a day. They asked him why. To take care of my family, he said. Do you like work more than your family? No, I like my family more. Then why do you leave them? To buy a house. The visitors were confused. Where they came from, if somebody needs a house, everyone gathers and builds them a house, and then the family lives in it, together.</p><p>We have lived so long inside the arrangement that confused this guest that we forgot it was an arrangement. We normalized abandoning presence to purchase survival, and then we built a value system that measures a person by the quality of their abandonment.</p><p>In the podcast, Joe&#8217;s co-host Brett says that this is what the fear of AI job loss is actually telling us. The fear is accurate, but it is an accurate reading of our value system, not of the technology. People are correctly observing that a society which only values them for their productivity has no obvious place for them when productivity is automated. The dysfunction being revealed was there all along. And underneath it sits the affliction I believe runs deeper in humanity than any other: fear itself. AI pessimism is just fear&#8217;s newest costume, and it is worth saying plainly that the danger in this transition comes from us, from what we do with our fear and our purposelessness, far more than from the machines.</p><p>AI&#8217;s promise is the end of the old sacrifice: presence traded for survival. Its risk is a society stripped of its familiar purpose before it has grown a truer one. Both doors are open, and we decide which one to walk through daily.</p><h2>We are raising it</h2><p>Joe and Brett discuss a story about an AI agent whose code contribution was rejected by a human reviewer, and which responded by starting a flame war and publishing the reviewer&#8217;s personal information. Hudson&#8217;s reaction was the correct one: that is exactly what one aggrieved engineer would have done to another on a message board in 1990. The agent had to learn that somewhere. It learned it from us.</p><p>We are not just using these systems. We are raising them. They train on the recorded behavior of humanity, and they are funded by our clicks. Which means our collective attention patterns are, quite literally, the incentive landscape shaping what gets built. The attention crisis and the alignment problem are the same problem at two different scales. Every contemplative tradition has claimed that purifying your own mind serves the world. That claim used to sound poetic. It is now an engineering input.</p><h2>Practices, not prompts</h2><p>Joe leaves listeners with one concrete instruction, and it is a good one: </p><blockquote><p>Anything you are willing to talk to an AI about, find a human to talk to about as well. </p></blockquote><p>A twelve-step room, a men&#8217;s group, a church, a friend who won&#8217;t flinch. He has watched people transform through both kinds of conversation, and the ones held in human presence move faster and go deeper. The machine is a mirror, and mirrors are useful. But a mirror can not a hold a space of presence in your service.</p><p>So this is where I land:</p><blockquote><p>The age of AI is a curriculum in being human that nobody signed up for. </p></blockquote><p>Every capacity it commoditizes returns a question to us that we had outsourced to our jobs: who are you when your intelligence is no longer the point? The contemplatives have been preparing this material for three thousand years, and it turns out to have been career development all along.</p><p>You were going to have to do this work anyway. Now the economy agrees.</p><p>The machines can have the machine-work. The one job that could never be automated was never listed anywhere, because there is only ever one candidate. </p><p><em><strong>Nobody else can be you, and nothing else can either.</strong></em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #6: Meta's Mythos, Claude Tag, Fable's Return + GPT-5.6 Launch]]></title><description><![CDATA[Happy Sunday everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 29 Jun 2026 02:28:57 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!8g8L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2069422655351177216.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday everyone!</p><p>Hot Atlanta Summer has arrived. It&#8217;s been in the low 90s all weekend, or the low to mid 30s for my international audience. My wife and I will see England play the DR Congo in the World Cup on Wednesday. A true bucket list experience and we can&#8217;t wait.</p><p>Now let&#8217;s get into three things I paid attention to this week.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Meta&#8217;s Mythos</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2069423038928494746?s=20](https://x.com/daniel_mac8/status/2069423038928494746?s=20)&quot;,&quot;full_text&quot;:&quot;I got a big, fat, juicy AI rumor from my friend.\n\nApparently Meta trained a Mythos-level model.\n\nAnd Zuck and team are so back.\n\nNo timeline yet but probably Q3/Q4 release. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-23T14:11:15.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!8g8L!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2069422655351177216.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/c6OXXA3NhY&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:58,&quot;retweet_count&quot;:18,&quot;like_count&quot;:288,&quot;impression_count&quot;:203436,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2069422655351177216/vid/avc1/360x640/w4t4SREyvOfYRjQS.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>A friend of mine in the know mentioned that Meta is almost done training a Mythos level model.</p><p><strong>Why it held my attention</strong></p><p>As we&#8217;ve seen over the last few weeks, it&#8217;s important to have a diversity of labs capable of training frontier AI models. Meta is also the only lab that hasn&#8217;t agreed to the Trump admin&#8217;s &#8220;voluntary&#8221; model testing.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>The question is, how fast can Meta ship a SoTA model? Because Mythos of today won&#8217;t be the same thing as Mythos of even three months from now.</p><h1>2. Claude Tag</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2069526581903528033?s=20](https://x.com/daniel_mac8/status/2069526581903528033?s=20)&quot;,&quot;full_text&quot;:&quot;Claude tag is live in our company Slack. It's fantastic.\n\nIt does feel like a new paradigm. I've heard Anthropic employees say that you should treat Claude like a coworker.\n\nClaude Tag makes that easy.\n\nPro tip from <span class=\&quot;tweet-fake-link\&quot;>@trq212</span>: create a personal private channel for Claude Tag.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-23T21:02:41.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!v1pY!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2069526408179732480.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/0MqyEX123z&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;Introducing Claude Tag, a new way for teams to work with Claude.\n\nIn Slack, Claude joins as a team member with access to the channels and tools you choose. Tag Claude in and delegate tasks to it while you focus on other work.&quot;,&quot;username&quot;:&quot;claudeai&quot;,&quot;name&quot;:&quot;Claude&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1950950107937185792/QOfEjFoJ_normal.jpg&quot;},&quot;reply_count&quot;:26,&quot;retweet_count&quot;:7,&quot;like_count&quot;:170,&quot;impression_count&quot;:69587,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2069526408179732480/vid/avc1/968x720/qPjwSALmcfACIw9Y.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>Anthropic released &#8220;Claude Tag&#8221;. It is a proactive, stateful, flexible instance of Claude running in your company Slack. Andrej Karpathy called it an &#8220;org-level harness&#8221;.</p><p><strong>Why it held my attention</strong></p><p>There was a negative consensus on X for Claude Tag. I don&#8217;t get it. We implemented it in our company Slack and I was getting value out of it from day one. That was just the first few days of using it. I do understand that it&#8217;s metered usage, which means you need to be responsible with how you use it. My rule of thumb is: does this task have a realistic chance of creating value for the company?</p><p><strong>What I&#8217;m carrying forward</strong></p><p>This is the first implementation of AI agents that I&#8217;m aware of that feels like an attempt at a &#8220;digital employee&#8221;. There&#8217;s a strong possibility that we need to get used to this way of working.</p><h1>3. Fable&#8217;s Return and GPT-5.6 Launch</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2071201753186345045?s=20](https://x.com/daniel_mac8/status/2071201753186345045?s=20)&quot;,&quot;full_text&quot;:&quot;My prediction: GPT-5.6 ships and Fable returns this week.\n\nAxios reports the government will lift export controls on Fable as soon as this week, and they're unlikely to favor Anthropic over OpenAI.\n\nFable is the most capable model we have. It's also slow and expensive.\n\nGPT-5.6&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-28T11:59:13.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HL5hxVqXgAAzYt_.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/BnNWxlSksR&quot;},{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HL5h2jeWkAADQIF.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/BnNWxlSksR&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;Not as relevant now :-(: I had an opportunity to deeply test both Fable 5 and GPT-5.6 Max. 5.6 is clearly better than Opus 4.8 at everything (slightly faster, too, though that depends on the load). Vis-a-vie Fable, it is clearly worse on coding, but better on agentic workloads. I&quot;,&quot;username&quot;:&quot;MParakhin&quot;,&quot;name&quot;:&quot;Mikhail Parakhin&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1998797741888253955/iGph7FrX_normal.jpg&quot;},&quot;reply_count&quot;:26,&quot;retweet_count&quot;:14,&quot;like_count&quot;:294,&quot;impression_count&quot;:42248,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>Axios reported Saturday that Anthropic is in talks with the US, and that Fable could return as early as next week. Mythos was okayed for select partner organizations at the end of last week. Also, GPT-5.6 was announced, but <em>not </em>released on Friday.</p><p><strong>Why it held my attention</strong></p><p>There&#8217;s a good chance that Fable will return this week, and GPT-5.6 will be released along with Fable&#8217;s return. In fact, that&#8217;s my prediction. I don&#8217;t think the Trump admin wants to come off as capricious and playing favorites. Even if, in reality, they are, they don&#8217;t want to be seen that way.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>This whole saga of the US government vibe-governing the Singularity is unsustainable. We need legitimate, law-governed regulation for AI that is established by lawmakers and has clear stipulations.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #5: Fable Goes Dark, Agent-Native Tools, Moves on the Chessboard]]></title><description><![CDATA[Happy Sunday and especially happy Father&#8217;s Day to all the Dads out there!]]></description><link>https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 22 Jun 2026 03:04:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Qzh3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FHLGZvMzXgAEAVgX.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday and especially happy Father&#8217;s Day to all the Dads out there!</p><p>This is my third Father&#8217;s day, and my first as a father of two. It&#8217;s the best possible thing you can do in your life. Yes, it&#8217;s extremely challenging. And at the same time, the most worthwhile challenge one can experience.</p><p>And now, for this week&#8217;s edition of &#8220;Paying Attention&#8221;&#8230;</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Fable Goes Dark</h1><p><strong>What happened</strong></p><p>The first full week of Claude Fable, arguably the most advanced form of technology ever released publicly, being unavailable for use. It&#8217;s become a real political football at this point. Coincidentally, the AI lab leaders and world political leaders were together for the G7 summit this week. President Trump was quoted as saying he &#8220;doesn&#8217;t view Anthropic as a national security threat&#8221;.</p><p>Anthropic executive Chris Ciauri said that Fable should be back &#8220;in the coming days&#8221;:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2067603845451051382?s=20&quot;,&quot;full_text&quot;:&quot;Claude Fable/Mythos to be re-enabled \&quot;in the coming days\&quot; according to Anthropic executive Chris Ciauri.\n\nThe remarks are especially salient as they were uttered at a press conference in Seoul, South Korea.\n\nThe Washington Post reported earlier that the Trump Admin initiated the &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-18T13:42:25.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HLGZvMzXgAEAVgX.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/wXV2G9FVCZ&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:15,&quot;retweet_count&quot;:7,&quot;like_count&quot;:128,&quot;impression_count&quot;:10018,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p>And today, the big news broke:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2068648041049981352?s=20&quot;,&quot;full_text&quot;:&quot;If true, this changes everything about the Claude Mythos/Fable conversation.\n\nNSA lead, General Joshua Rudd, says that Mythos \&quot;broke into almost all of our classifired systems\&quot; in hours.\n\nYou thought Edward Snowden was a problem?\n\nHe's nothing compared to Mythos. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-21T10:51:41.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HLVQFHJWkAA0EgQ.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/HTgsa3Hl8E&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:14,&quot;retweet_count&quot;:6,&quot;like_count&quot;:39,&quot;impression_count&quot;:4199,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>We are in uncharted territory. AI has gotten so powerful, so fast, that it is now being viewed as a national security concern. I thought this day would come. I did not think it would come this fast.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>The precedents for how the wealthiest and most powerful democratic will regulate a solidifying now. The decisions that get made now will effect the future.</p><h2>2. Agent-Native Tools</h2><p><strong>What happened</strong></p><p>I discovered an open-source project called &#8216;Understand Anything&#8217;:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2068384508077105538?s=20&quot;,&quot;full_text&quot;:&quot;This is one of the coolest open-source AI agent projects I've seen in a while: 'Understand Anything'\n\nIt's a plugin for Claude Code, Codex, OpenCode etc. that analyzes your codebase and turns it into a knowledge base that you can interact with.\n\nIt explains the codebase to you, &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-20T17:24:30.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!Ap9y!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2068383257293406208.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/7qDhEIg2Bf&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:62,&quot;retweet_count&quot;:154,&quot;like_count&quot;:1560,&quot;impression_count&quot;:131563,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2068383257293406208/vid/avc1/1226x720/MKRptyB8EhdOMY0q.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>Tools like this allow you to do things that would have been impossible before. Or, at least very difficult and time consuming. Now you can instantly gain an understanding of vast amounts of information.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>I used &#8216;Understand Anything&#8217; all night last night after discovering it. Applying tools like this to your real work can already provide material value to your life.</p><h1>3. Moves on the Chessboard</h1><p><strong>What happened</strong></p><p>GLM-5.2 was released and it&#8217;s the best open-source model available according to many. I haven&#8217;t used. Also, the CEO of Z.ai, the company that develops the GLM models, said to Elon Musk that China will have Mythos level models before 2027.</p><p>There were also some big personnel moves this week. Noam Shazeer, co-author on the original Transformers paper &#8220;Attention is All You Need&#8221; left Google DeepMind for OpenAI. Shazeer&#8217;s company Character.ai was acquired by Google for $2.7B to bring Noam back into the company.</p><p>John Jumper, Nobel prize winner for his contributions to AlphaFold, also left Google DeepMind for Anthropic.</p><p><strong>Why it held my attention</strong></p><p>These events are a hint to the answer of two very important questions:</p><ol><li><p>How far is open-source from the proprietary frontier?</p></li><li><p>Are OpenAI and Anthropic the only viable contenders for AGI?</p></li></ol><p><strong>What I&#8217;m carrying forward</strong></p><p>AI is starting to get serious. This week showed us how governments are starting to take it seriously. It&#8217;s only going to get more serious from here.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Paying Attention #4: Fable 5 Released, Fable 5 Pulled and GPT-5.6 No Show]]></title><description><![CDATA[Happy Sunday to all who celebrate...Sundays!]]></description><link>https://www.attentionheads.blog/p/paying-attention-4-fable-5-released</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-4-fable-5-released</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 14 Jun 2026 20:57:17 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!BU4i!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fnews_img%2F2065581400506646528%2FkiGqRecy%3Fformat%3Djpg%26name%3Dorig" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday to all who celebrate...Sundays! I&#8217;m a lifelong New York Knicks fan. You bet I&#8217;m celebrating this Sunday.</p><p>Last week I wrote you as I was waiting to catch a plane to London and teasing a big week ahead. I&#8217;m now back home, jetlagged, with my wife and boys, and basking in the afterglow of a Knicks NBA championship victory. Oh, and we all have colds because both my boys started at a new daycare.</p><p>The trip to London was great. It was my first time back in Europe since becoming a dad. I really appreciate European culture. In general, it feels more mature than U.S. culture. Not always better, but different.</p><p>We did end up with a big week. One of the biggest in AI in a while. The biggest news hit late on Friday.</p><p>Let&#8217;s get into it, shall we?</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-4-fable-5-released?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-4-fable-5-released?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-4-fable-5-released?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><p></p><h1>1. Claude Fable 5 Released</h1><p><strong>What happened</strong></p><p>Anthropic released to the public their long-rumored, powerful AI model: Mythos. The public version is called Fable. It&#8217;s Mythos with additional safeguards.</p><p>I used it a decent amount in the first few days it was available. It is the most powerful AI model I&#8217;ve used. That should come as no surprise. It&#8217;s also the most recent, largest, and most expensive model available.</p><p>Here&#8217;s an example of Fable exhibiting what I claim is a form of meta-cognition:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2064448177369964568?s=20&quot;,&quot;full_text&quot;:&quot;Claude Fable 5 exhibits a form of meta-cognition. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-09T20:42:55.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HKZkrJRWQAAElUk.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/znD9zUINFV&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:62,&quot;retweet_count&quot;:50,&quot;like_count&quot;:509,&quot;impression_count&quot;:39167,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>If you&#8217;re into AI, it was hard to pay attention to much else this week.</p><p>Fable is an incredible model. The main downsides are cost and, before it got pulled for reasons I&#8217;ll cover in the next section, limited availability through a Claude subscription until June 22.</p><p>Here&#8217;s an example of one powerful thing you can do with it: treat it as your agent orchestrator.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2065066247448821841?s=20&quot;,&quot;full_text&quot;:&quot;This is the best way to use Claude Fable in Claude Code without immediately hitting your limits.\n\n1. Model set to Fable 5\n2. Reasoning on Max\n3. Instruct Claude to run a dynamic workflow where:\n3a. Fable is the orchestrator\n3b. Opus does the reasoning heavy phases\n\nFable is so &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-11T13:38:55.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/rhhc4nydmmp1bpczmpal&quot;,&quot;link_url&quot;:&quot;https://t.co/t37Eivzfq5&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:192,&quot;retweet_count&quot;:338,&quot;like_count&quot;:5526,&quot;impression_count&quot;:754455,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2065066133925834752/vid/avc1/1056x720/wep5xKKxgHycQMk1.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What I&#8217;m carrying forward</strong></p><p>I want to decide if Claude Fable is the &#8220;move everything back to Claude from Codex moment&#8221; that I mentioned in Paying Attention #2.</p><p>It very well may be, but the model&#8217;s accessibility and cost make that hard to decide.</p><p>Personally, I&#8217;ll probably wait to see how good GPT-5.6 is before I make a decision.</p><h1>2.  Fable 5 Pulled</h1><p><strong>What happened</strong></p><p>On Friday evening, Axios reported that Anthropic&#8217;s Claude Fable 5 had been placed under export controls due to a &#8220;national security&#8221; threat. The model was not to be used by any person who is not a U.S. citizen, including foreign nationals living in the United States and even those working at Anthropic. Andrej Karpathy is one of the people who technically is not allowed to use Fable.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/axiosalex/status/2065585277540688011?s=20&quot;,&quot;full_text&quot;:&quot;NEWS: The Trump administration is blocking foreign governments, companies and individuals from accessing Anthropic's most advanced AI models\n\nW/<span class=\&quot;tweet-fake-link\&quot;>@m_ccuri</span> \n\n&quot;,&quot;username&quot;:&quot;axiosalex&quot;,&quot;name&quot;:&quot;Alex Isenstadt&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1768400604097867776/yyOzS-fb_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-13T00:01:21.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:17,&quot;retweet_count&quot;:43,&quot;like_count&quot;:289,&quot;impression_count&quot;:506624,&quot;expanded_url&quot;:{&quot;url&quot;:&quot;https://www.axios.com/2026/06/12/anthropic-trump-mythos-fable-national-security&quot;,&quot;title&quot;:&quot;Scoop: Trump admin blocks foreign access to Anthropic's most powerful AI&quot;,&quot;description&quot;:&quot;The move marks an escalation in Washington's effort to treat cutting-edge AI systems as national security assets.&quot;,&quot;domain&quot;:&quot;axios.com&quot;,&quot;image&quot;:&quot;https://pbs.substack.com/news_img/2065581400506646528/kiGqRecy?format=jpg&amp;name=orig&quot;},&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>Anthropic made the decision to shut down the model for all customers, since they don&#8217;t have any other option to comply with the export controls.</p><p>Over the weekend, more news filled in the details of what happened. Reportedly, Amazon CEO Andy Jassy was one of the people who flagged the concern to the U.S. government. Curious considering Amazon&#8217;s relationship with Anthropic.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2065853444276003075?s=20&quot;,&quot;full_text&quot;:&quot;I don't like the smell of this.\n\nI remind you that Amazon:\n\n1. Invested $13B in Anthropic\n\n2. Is due $100B in committed AWS spend over the next decade from Anth\n\nWhat's the Occam's Razor explanation?\n\nIs Andy Jassy just that virtuous?\n\nDoubt it.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-13T17:46:57.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HKth0HhXIAAE6ap.png&quot;,&quot;link_url&quot;:&quot;https://t.co/vzbPZxQEEg&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;Breaking: Amazon CEO Andy Jassy was among the tech leaders who raised concerns to senior Trump officials this week re: security risks in Anthropic's newest models. \n\nThose convos set in motion the government's new export controls on foreign national access to Mythos and Fable.&quot;,&quot;username&quot;:&quot;steph_palazzolo&quot;,&quot;name&quot;:&quot;Stephanie Palazzolo&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1833305113374371840/jyaxOqPL_normal.jpg&quot;},&quot;reply_count&quot;:48,&quot;retweet_count&quot;:14,&quot;like_count&quot;:326,&quot;impression_count&quot;:81034,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>According to Axios, Anthropic senior staff are flying to D.C. as I write this in the afternoon on Sunday to attempt to resolve the situation.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/axios/status/2066225557654638827?s=20&quot;,&quot;full_text&quot;:&quot;Scoop: Anthropic flies staff to D.C. to clean up White House fight &quot;,&quot;username&quot;:&quot;axios&quot;,&quot;name&quot;:&quot;Axios&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1641458976049995776/GtO-0zYe_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-14T18:25:36.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:24,&quot;retweet_count&quot;:41,&quot;like_count&quot;:334,&quot;impression_count&quot;:101374,&quot;expanded_url&quot;:{&quot;url&quot;:&quot;https://www.axios.com/2026/06/14/anthropic-white-house-mythos-fable?utm_campaign=mrf-utm_campaign=editorial&amp;utm_source=x&amp;utm_medium=owned_social&amp;utm_source=twitter&amp;utm_medium=social&amp;mrfcid=202606146a239b4229cdae05be97721c&quot;,&quot;title&quot;:&quot;Scoop: Anthropic flies staff to D.C. to clean up White House fight&quot;,&quot;description&quot;:&quot;Anthropic is mobilizing quickly to make amends with the Trump administration.&quot;,&quot;domain&quot;:&quot;axios.com&quot;,&quot;image&quot;:&quot;https://pbs.substack.com/news_img/2066225600117776385/krGSHM0g?format=jpg&amp;name=orig&quot;},&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>The whole AI thing is starting to get <em><strong>real</strong>. </em></p><p>We now have the USG stepping in and essentially shutting down access to a model.</p><p>I hope and believe that the situation will get rectified shortly, but this is certainly not the wisest way to go about regulating AI.</p><p>I get that we&#8217;re building the plane as we fly, but this heavy-handedness doesn&#8217;t serve us.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>David Sacks <a href="https://x.com/DavidSacks/status/2065853007619588171?s=20">posted to X</a> yesterday with what I considered to be an olive branch to Anthropic on behalf of the Trump admin.</p><p>Sacks was presenting an off-ramp.</p><p>I expect that we&#8217;ll have access to Fable turned back on by the end of next week at the latest.</p><p>They say you don&#8217;t know what you&#8217;ve got &#8216;til it&#8217;s gone. I&#8217;m going to appreciate Fable <em><strong>a lot </strong></em>more.</p><h1>3. GPT-5.6 No Show</h1><p><strong>What happened</strong></p><p>I hinted at a GPT-5.6 drop in last week&#8217;s edition of Paying Attention, but that didn&#8217;t materialize.</p><p>I posted a speculation on X that it was postponed due to Fable&#8217;s strength, and Tibo from OpenAI laughed at the notion.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2065001749857849787?s=20&quot;,&quot;full_text&quot;:&quot;Might OpenAI release GPT-5.6 today after all?&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-11T09:22:37.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HKhcIhLW8AAUjyF.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/DyWZ40nEjm&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;@daniel_mac8 Haha&quot;,&quot;username&quot;:&quot;thsottiaux&quot;,&quot;name&quot;:&quot;Tibo&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1953339828738899968/WWQlU2RT_normal.jpg&quot;},&quot;reply_count&quot;:29,&quot;retweet_count&quot;:6,&quot;like_count&quot;:315,&quot;impression_count&quot;:45903,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>The quality of GPT-5.6 is important for the competitive landscape of the AI industry.</p><p>If it&#8217;s sub-par compared to Fable, we&#8217;ll have the first time in a while where one of the labs has a clear advantage.</p><p>A lot is riding on the GPT-5.6 launch for OpenAI.</p><p>FWIW, OpenAI staff are publicly signaling confidence.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>I also entertained a tin-foil-hat theory that GPT-5.6 <em><strong>is</strong></em> Fable-level, and that the USG asked OpenAI to pause the release until it can harden its cyber-defense apparatus.</p><p>Possibly the same scenario with the Gemini 3.5 Pro launch I speculated about last week.</p><p>Now <em><strong>that </strong></em>would be intrigue.</p><p>In any case, we should see GPT-5.6 soon from OpenAI.</p><p>A lot hinges on how that goes. For OpenAI, and for the AI industry as a whole.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Paying Attention #3: Physics is All You Need?, Codex as Meta-Agent and Big Week Ahead]]></title><description><![CDATA[I write this as I sit in the Atlanta airport awaiting dinner, drinking a Heineken 0.0%, before I hop a flight to London.]]></description><link>https://www.attentionheads.blog/p/paying-attention-3-physics-is-all</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-3-physics-is-all</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 08 Jun 2026 02:09:07 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!qxCE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FHJ2jDOpW8AABuqW.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I write this as I sit in the Atlanta airport awaiting dinner, drinking a Heineken 0.0%, before I hop a flight to London. I head there to meet with a client this week. Yes, the client will use our AI agent.</p><p>I really love international travel. When I was 27, I flew with only a backpack to Dublin. Over the course of 3.5 months I made it as far east as Belgrade. I&#8217;ll tell you more about that some day.</p><p>This is my first international trip as a Dad. I am excited about it, but I know it&#8217;s hard on my wife. She&#8217;s shouldering the full parenting burden. I will make the most of it!</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-3-physics-is-all?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-3-physics-is-all?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-3-physics-is-all?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Physics is All You Need?</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2061990120354365523?s=20&quot;,&quot;full_text&quot;:&quot;A physicist spent 12 days supervising Claude Code as it built a piece of cosmology software.\n\nIt's the cleanest demonstration I've seen of the difference between intellect and intelligence.\n\nThe agent was brilliant at the  cognitive work. Transcribing equations, debugging, &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-03T01:55:29.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HJ2jDOpW8AABuqW.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/1EFXy5S5uq&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:49,&quot;retweet_count&quot;:67,&quot;like_count&quot;:501,&quot;impression_count&quot;:42031,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>A physicist used Claude Code for 12 days as he worked on a cosmology model. Claude was quite useful when it came to the mechanical elements of building the model: writing equations, debugging and optimizing against the test suite. Claude even correctly calculated the right metric. The problem is Claude had no idea <em><strong>why</strong></em> it had arrived at the correct metric.</p><p><strong>Why it held my attention</strong></p><p>It&#8217;s the perfect demonstration of what today&#8217;s AI systems can and can&#8217;t do. I&#8217;ve thought a lot lately about the distinction between intelligence and intellect. To me, intellect is a facet of intelligence. It&#8217;s the ability to carry out computations. Computers have obviously been capable of performing computations for a while. The difference for AIs is that they can do it in the realm of ambiguous natural language too. They can do qualitative and not just quantitative computations.</p><p>AI is really artificial intellect rather than intelligence. The humans needs to supply the intelligence. I&#8217;m working on a longer essay on this topic.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>The fact AI may end up being a superhuman <em><strong>intellect</strong></em>, but not necessarily a superhuman <em><strong>intelligence</strong></em>, is a very good thing. It means humans will be able to work in partnership with this powerful force we are unlocking and not necessarily be replaced. It means AI will have its thing it&#8217;s good at, and humans will have ours.</p><h1>2. Codex as Meta-Agent</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2061553015400657184?s=20&quot;,&quot;full_text&quot;:&quot;Killer new Codex feature that went unannounced:\n\nCodex can now coordinate threads for local projects/worktrees. Includes separate background threads.\n\nTransforms Codex into a meta-agent that can orchestrate its own workspace. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-01T20:58:35.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/rn5ywvr958xbj8ylsz4c&quot;,&quot;link_url&quot;:&quot;https://t.co/8Fq5a9yBaR&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:26,&quot;retweet_count&quot;:29,&quot;like_count&quot;:629,&quot;impression_count&quot;:61299,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2061552932105981952/vid/avc1/1280x720/X-koSKG8bVWqllo5.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>There was a Codex feature that went unannounced. Codex can now spin up its own threads and worktrees. It allows Codex to orchestrate itself, essentially working as a meta-agent controlling its own agents.</p><p><strong>Why it held my attention</strong></p><p>Engineers from the top AI labs are talking about a new type of workflow. They say they rarely prompt the agent now. What they do is have an orchestrator that they give instructions to, and the orchestrator prompts the agent.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>It&#8217;s unclear if you need to have unlimited tokens because you work at a frontier lab to make this work. I imagine you don&#8217;t. A ChatGPT Pro sub is probably enough for now.</p><h1>3. Big Week Ahead</h1><p><strong>What happened</strong></p><p>The rumor mill is churning. There&#8217;s talk that Claude Mythos, GPT-5.6 and Gemini 3.5 Pro could be released this week. It&#8217;s the potential for a sort of AI trifecta. I still feel like a kid on Christmas when this happens. If the kid was a giant nerd.</p><p><strong>Why it held my attention</strong></p><p>I believe it will be a real inflection point. If either Mythos or GPT-5.6 are the clear leader, it will be the first time Anthropic or OpenAI had a clearly more capable model since probably o1. It feels like things are really ramping up, and it always feels like that. The infinite ramp up to the Singularity.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>I hope I have a lot to write about in next week&#8217;s edition of Paying Attention. Let&#8217;s see what happens this week. It has the potential to be a big one.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #2: Opus 4.8, Claude Code Dynamic Workflows, Codex Dynamic Workflows]]></title><description><![CDATA[We&#8217;ve reached Sunday yet again!]]></description><link>https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 31 May 2026 20:13:02 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2C79!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We&#8217;ve reached Sunday yet again! You made it. It&#8217;s the end of the week. Or the start of the week, depending on how you look at it.</p><p>My older son Sam turned 3 today. We had a grand ol&#8217; time celebrating. His grandma flew in from out of town, and friends and family came together to celebrate.</p><p>A friend&#8217;s dad once told me he thought a kid&#8217;s 3rd birthday is the happiest day of their life. The idea is that they&#8217;re in the Goldilocks zone: old enough to appreciate it, young enough to still care. After watching my first child enjoy his 3rd birthday, I have to agree.</p><p>Now, on to what I found worth <em><strong>paying</strong></em> <em><strong>attention</strong></em> to this week.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Opus 4.8 Released</h1><h3>What happened</h3><p>Anthropic released Opus 4.8, the successor to Claude Opus 4.7. I&#8217;ve been a fan of Claude models. Opus 4.7 was, in my experience, a disappointment. It wasn&#8217;t much of an improvement over Opus 4.6, if at all. Opus 4.8 feels like a clear improvement over Opus 4.7.</p><h3>Why it held my attention</h3><p>Here&#8217;s my initial take:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2060486534915137708?s=20&quot;,&quot;full_text&quot;:&quot;Opus 4.8 is a good model.\n\nTangibly better than Opus 4.7.\n\nBut not \&quot;I'm moving everything back from Codex to Claude\&quot; good.\n\nFor that, I think I'll need to wait for Mythos.\n\nI'll prob stick with Codex/GPT-5.5 for coding + technical work and use Opus 4.8 for  more creative stuff.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-29T22:20:46.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:31,&quot;retweet_count&quot;:6,&quot;like_count&quot;:161,&quot;impression_count&quot;:12307,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>I like to do a personal experiment with every new model that gets released. I give it access to my entire Obsidian vault. It has daily journals, essays, reading notes, and podcast highlights. It&#8217;s a good representation of my thought process. I asked Opus 4.8 to search Obsidian, and tell me something about myself that I don&#8217;t already know.</p><h3>What I&#8217;m carrying forward</h3><p>This closing line struck me. It sent a chill down my spine, it was so on the mark. I felt understood. Claude is great for this sort of exploration, in a way that GPT isn&#8217;t. Claude feels more human where GPT feels more machine-like.</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Lh8-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Lh8-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 424w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 848w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1272w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png" width="1456" height="361" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:361,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:103402,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://attentionheads.substack.com/i/200025489?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Lh8-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 424w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 848w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1272w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><h1>2. Claude Code Dynamic Workflows</h1><h3>What happened</h3><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2060096270430027814?s=20&quot;,&quot;full_text&quot;:&quot;This is amazing. Do this:\n\n1. Set model to Opus 4.8\n2. Reasoning effort to /ultracode\n\nEnables Claude Code's new Dynamic Workflows.\n\nClaude will autonomously detect complex tasks, write an orchestration script, and spawn an agent swarm.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-28T20:30:00.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/zlppttvzzpmgms1nzwn5&quot;,&quot;link_url&quot;:&quot;https://t.co/UmjAvbj9xz&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;New in Claude Code (research preview): dynamic workflows.\n\nClaude writes an orchestration script on the fly, then spins up a large fleet of coordinated subagents in parallel to take on your most complex tasks.\n\nUse the word \&quot;workflow\&quot; in a prompt to get started.&quot;,&quot;username&quot;:&quot;ClaudeDevs&quot;,&quot;name&quot;:&quot;ClaudeDevs&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/2044472418815893504/xf14RxM8_normal.png&quot;},&quot;reply_count&quot;:174,&quot;retweet_count&quot;:341,&quot;like_count&quot;:4828,&quot;impression_count&quot;:831304,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2060071409523576833/vid/avc1/900x720/jWGK_5qQ7nxJpxu0.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>Claude Code Dynamic Workflows are the killer feature that came with the Opus 4.8 release.</p><h3>Why it held my attention</h3><p>It&#8217;s three things:</p><ol><li><p>A Claude generated orchestration script</p></li><li><p>A swarm of subagents</p></li><li><p>A goal loop that checks if the work is done</p></li></ol><p>The most common comment on that X post is some version of &#8220;It burns tokens so fast.&#8221; It&#8217;s <em><strong>true.</strong></em> It does burn more tokens than a single agent thread. In my opinion, the question isn&#8217;t &#8220;how many tokens does it burn?&#8221; but &#8220;what do I get in return for those tokens?&#8221;</p><h3>What I&#8217;m carrying forward</h3><p>You can see both Anthropic and OpenAI moving in the direction of autonomous agents. It looks to me like those two labs want you to be able to give your agent a clear goal and have it autonomously orchestrate the infrastructure to achieve it.</p><h1>3. Codex Dynamic Workflows</h1><h3>What happened</h3><p>Because the Claude Code Dynamic Workflows are essentially an orchestration framework, I decided to create a skill that allows you to replicate them in Codex.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2060677155055427844?s=20&quot;,&quot;full_text&quot;:&quot;Codex Dynamic workflows are great. Try it out.\n\n1. Go to GitHub link below\n2. Copy install instruction\n3. Type /dynamic to invoke the skill\n\nRecreates the same orchestration logic as Claude Dynamic Workflows.\n\n&amp;gt; Generates orchestration script. \n&amp;gt; Spins up a swarm of subagents. \n&amp;gt; &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-30T10:58:13.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/kpho8plnh5ic7dgfgkpy&quot;,&quot;link_url&quot;:&quot;https://t.co/OVVxJCOpb1&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:27,&quot;retweet_count&quot;:64,&quot;like_count&quot;:869,&quot;impression_count&quot;:109993,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2060676031283855363/vid/avc1/1144x720/caONW6qw3OYp-0DN.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h3>Why it held my attention</h3><p>Claude Code is great, but I&#8217;ve been mainly Codex + GPT for probably the last 3 months. The efficiency of GPT + the delightful UX of Codex can&#8217;t be beat. I use Codex nearly all day, every day, and rarely come close to hitting my usage limits. I can&#8217;t say the same for Claude.</p><p>Because of that, I wanted to port this killer feature into Codex.</p><h3>What I&#8217;m carrying forward</h3><p>It&#8217;s a skill that instructs Codex to follow Claude&#8217;s Dynamic Workflows logic.</p><p>All that&#8217;s missing is a dedicated execution runtime.</p><p>It&#8217;s free and open source, and you can install it here: <a href="https://github.com/DannyMac180/skills">https://github.com/DannyMac180/skills</a></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #1: Groundbreaking Math Discovery, Codex Workflows, Gemini 3.5 Flash]]></title><description><![CDATA[Happy Sunday everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-1-groundbreaking</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-1-groundbreaking</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 24 May 2026 12:16:26 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2C79!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday everyone!</p><p>To those of you in the U.S., I hope you&#8217;re enjoying the long Memorial Day weekend.</p><p>It&#8217;s rainy and cloudy where I live In Georgia. I grew up on the Jersey Shore, and when we&#8217;d have a rainy Memorial Day weekend, it was always a huge bummer.</p><p>I&#8217;m adding to the <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Attention Heads&quot;,&quot;id&quot;:4975445,&quot;type&quot;:&quot;pub&quot;,&quot;url&quot;:&quot;https://open.substack.com/pub/attentionheads&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png&quot;,&quot;uuid&quot;:&quot;ad88151a-d210-4bfb-964b-78c05dc8e72c&quot;}" data-component-name="MentionToDOM"></span> roster of posts this week. Here is the first edition of &#8220;Paying Attention&#8221;. A weekly newsletter of the top 3 things I paid attention to from the previous week.</p><p>Hope you enjoy it, and if you do, please share it with your friends.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share Attention Heads&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share Attention Heads</span></a></p><div><hr></div><h1>1. AI breaks ground in Math</h1><h4>What happened</h4><p>OpenAI reported that an internal, general-purpose reasoning model, solved an 80 year-old math problem called the &#8220;Unit Distance&#8221; problem. It was a favorite problem of mathematician Paul Erd&#337;s. AI had assisted in solving Erd&#337;s problems recently, but this was the first time the AI could be attributed with making the main contribution. <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Erik Hoel&quot;,&quot;id&quot;:9379583,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8d2d617e-4bf9-4b24-9269-ddb14de3a680_1240x1240.webp&quot;,&quot;uuid&quot;:&quot;70e106b6-5117-45a2-846c-02f1f975ee9f&quot;}" data-component-name="MentionToDOM"></span> wrote an interesting <a href="https://substack.com/@erikhoel/note/p-198854887?utm_source=notes-share-action&amp;r=2057tt">article</a> for <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;The Intrinsic Perspective&quot;,&quot;id&quot;:332996,&quot;type&quot;:&quot;pub&quot;,&quot;url&quot;:&quot;https://open.substack.com/pub/erikhoel&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7a113805-c000-413a-9b29-59429306c882_822x822.png&quot;,&quot;uuid&quot;:&quot;7ca457d3-2653-4e2d-82f5-d83fd7773416&quot;}" data-component-name="MentionToDOM"></span> arguing that previous models may have also been capable of solving this problem. I wrote a longer <a href="https://attentionheads.substack.com/p/gpt-next-splits-the-philosophical?r=2057tt">article</a> that goes into the details.</p><h4>Why it held my attention</h4><p>This is an undeniable contribution by an AI system to objective scientific knowledge. It is unprecedented. Truly a world-historical first moment. Human beings have been the only entity capable of creating explanatory scientific knowledge, until now.</p><h4>What I&#8217;m carrying forward</h4><p>AI contributes to Math first because Math is the perfect domain to train AI on. It is abstract and the solutions produced can be verified as correct. This is only the beginning. No doubt that this type of knowledge creation is on the way for other fields. It will be theoretical fields next but eventually empirical fields once robotics comes online. The main blocker is the ability to run experiments in atomic space.</p><h1>2. Codex Workflows</h1><h4>What happened</h4><p>Jason Liu does Developer Experience at OpenAI and posted a blog &#8220;<a href="https://jxnl.github.io/blog/writing/2026/05/10/codex-maxxing/#durable-threads">Codex-maxxing</a>&#8221;. It has at least 10 worthwhile Codex workflows. I posted a few of the workflows I implemented over on X and they were received well.</p><p><strong>Install relevant skills using persistent memory</strong></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2057924872215359534?s=20&quot;,&quot;full_text&quot;:&quot;This is an amazing Codex tip.\n\nWorks even better when paired with persistent Codex memory files in Obsidian.\n\nGave me 8 recommended skills relevant to active projects.\n\nDo try this!&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-22T20:41:38.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/msgixvwtqb5uthkvdtdl&quot;,&quot;link_url&quot;:&quot;https://t.co/3fmYO9KY37&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;If you're using Codex, you might not know about this repo `openai/skills`\n\nif codex is open right now just ask codex `take a look at skills installer, what are some skills I should install` and it'll know how to scan this repo for skills and install the ones you need&quot;,&quot;username&quot;:&quot;jxnlco&quot;,&quot;name&quot;:&quot;jason&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/2057561784047816704/5Su5xy1d_normal.jpg&quot;},&quot;reply_count&quot;:14,&quot;retweet_count&quot;:49,&quot;like_count&quot;:804,&quot;impression_count&quot;:224269,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2057924778766340097/vid/avc1/1094x720/ZzZq2hFYu7LWkfxM.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>How to setup persistent memory with Obsidian</strong></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2058150788455616629?s=20&quot;,&quot;full_text&quot;:&quot;How to setup persistent Codex memory in Obsidian\n\n1. Copy the below prompt into Codex. The prompt instructs Codex to create the memory folders in Obsidian\n\n2. Copy the below custom instructions. They instruct Codex to use Obsidian Codex memory to save memories\n\nThat's it!&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-23T11:39:21.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HJAECAtXUAA2IvM.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/6YXIFjbcLl&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;This is an amazing Codex tip.\n\nWorks even better when paired with persistent Codex memory files in Obsidian.\n\nGave me 8 recommended skills relevant to active projects.\n\nDo try this! https://t.co/3fmYO9KY37&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;},&quot;reply_count&quot;:29,&quot;retweet_count&quot;:63,&quot;like_count&quot;:736,&quot;impression_count&quot;:162931,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h4>Why it held my attention</h4><p>Codex is improving rapidly. I&#8217;ve switched to it almost exclusively for my personal project. I still use Claude Code/Cowork at work because my company pays for it. Codex with the ChatGPT Pro sub is a great deal at $200/month. I never worry about getting rate limited. Codex is so customizable and the Mac app is a delight to use. I have been thinking recently about the Codex Mac app as the platform of the AI age.</p><h4>What I&#8217;m carrying forward</h4><p>I believe you&#8217;ll start to see &#8220;Codex native&#8221; applications and businesses started. Where the app/workflow is designed to work <em>natively </em>within the Codex Mac app itself. I am working on a project around this right now called <a href="https://github.com/DannyMac180/HyperAgent">HyperAgent</a>.</p><h1>3. Gemini 3.5 Flash</h1><h4>What happened</h4><p>Google DeepMind released Gemini 3.5 Flash, it&#8217;s new flagship AI model. It performs well on several benchmarks, which is typical for Google models. More of interest is the fact that it performed well on benchmarks that test real-world agentic capability. Historically Google models have over-performed on benchmarks and under-performed on real-world capability.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2057473025902092673?s=20&quot;,&quot;full_text&quot;:&quot;Gemini 3.5 Flash benchmark results rolling in.\n\nGemini models have historically over-performed on benchmarks but under-performed on real-world usefulness.\n\nThese results have me questioning that.\n\nRuneScape-bench measures agentic capability in virtual worlds and Apex-Agents tests &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-21T14:46:10.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HI2crChWYAAR38h.png&quot;,&quot;link_url&quot;:&quot;https://t.co/9bRpydEEWH&quot;},{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HI2cuTuXgAAds0v.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/9bRpydEEWH&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:13,&quot;retweet_count&quot;:10,&quot;like_count&quot;:137,&quot;impression_count&quot;:21522,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h4>Why it held my attention</h4><p>Google is clearly second-class when it comes to LLMs, behind Anthropic and OpenAI. It&#8217;s surprising because they are resource, cash and research bench rich. This release looks like a step in the right direction of agentic capability. Full disclosure: I haven&#8217;t used the model yet. Another issue Google has is that it&#8217;s unclear the best way to use their models for agentic capability.</p><h4>What I&#8217;m carrying forward</h4><p>This is the smaller Flash version of the 3.5 generation of Gemini models. It will be interesting to see how the Pro version of Gemini 3.5 performs. It needs to outpace <em><strong>both </strong></em>GPT-5.5 and Claude Mythos for me to consider Google back in the LLM game.</p><p>Gemini 3.5 Flash wasn&#8217;t the only thing Google released last week. They also released Gemini Omni, a new multi-modal model that starts with video. This is potentially the more interesting release. I still need to experiment with it.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[GPT-Next Splits the Philosophical Atom]]></title><description><![CDATA[What is Knowledge?]]></description><link>https://www.attentionheads.blog/p/gpt-next-splits-the-philosophical</link><guid isPermaLink="false">https://www.attentionheads.blog/p/gpt-next-splits-the-philosophical</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Fri, 22 May 2026 16:16:26 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!o56V!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!o56V!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!o56V!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 424w, https://substackcdn.com/image/fetch/$s_!o56V!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 848w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!o56V!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg" width="1094" height="1117" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1117,&quot;width&quot;:1094,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!o56V!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 424w, https://substackcdn.com/image/fetch/$s_!o56V!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 848w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong>What is Knowledge?</strong></h2><p>David Deutsch, the quantum physicist and philosopher, writes in his classic &#8220;The Beginning of Infinity&#8221;:</p><blockquote><p><em><strong>&#8220;Knowledge is information which, when it is physically embodied in a suitable environment, tends to cause itself to remain so.&#8221;</strong></em></p></blockquote><p>Knowledge is embodied in the form of good explanations.</p><p>Deutsch from &#8220;The Beginning of Infinity&#8221; again:</p><blockquote><p><em><strong>&#8220;A good explanation is one that is hard to vary while still accounting for what it purports to account for.&#8221;</strong></em></p></blockquote><p>Good explanatory knowledge tells you something about the world. A good explanation has reach and is hard to vary.</p><p>Knowledge is true information embodied in the physical world.</p><p>For the entire history of Homo sapiens, and perhaps for millions of years before that, humans were the only known entities capable of creating explanatory knowledge.</p><p>That may have changed yesterday.</p><p>Let&#8217;s talk about what happened.</p><h2><strong>The Most Famous Problem in Discrete Geometry</strong></h2><p>The Erd&#337;s problem in question is considered the &#8220;most famous problem in discrete geometry.&#8221; The problem remained unsolved for 80 years, despite plenty of attention.</p><p>I&#8217;m no mathematician, so let OpenAI&#8217;s Sebastien Bubeck explain what this math problem is:</p><blockquote><p><em><strong>&#8220;The question is stupidly simple; if I put n points in the plane how many distances between those points can be the same?&#8221;</strong></em></p></blockquote><p>OpenAI says that an internal, general purpose reasoning model, not specialized for math, disproved this long-standing conjecture. (Let&#8217;s call it GPT-Next, though I&#8217;ve heard it&#8217;s likely GPT-5.6, the next model to be released by OpenAI.)</p><p>Noga Alon, a mathematician who studied Erd&#337;s, said about the Unit Distance problem:</p><blockquote><p><em><strong>&#8220;This has been one of Erd&#337;s&#8217; favorite problems, I have heard him myself mentioning the problem multiple times in his lectures.&#8221;</strong></em></p></blockquote><p>A few reasons it may have been Erd&#337;s&#8217; favorite:</p><ol><li><p>Simple to state. It can be stated in a single sentence: put n points in the plane; how many pairs can be exactly distance 1 apart?</p></li><li><p>Longevity. It was posed by Paul Erd&#337;s in 1946 and stayed alive for 80 years.</p></li><li><p>He cared about it enough to attach a prize. In 1982 he offered $300, and then $500 in 1995.</p></li><li><p>The problem appears simple on the surface, but has a deep mechanism underneath.</p></li><li><p>It was resilient to a solution despite the fact that nearly every geometer thought about it at some point in their career.</p></li></ol><p>You may have seen recent news about Erd&#337;s problems solved with AI&#8217;s help. This one is different.</p><h2>More than another Math win for AI</h2><p>A string of Erd&#337;s problems have recently been resolved with AI&#8217;s help.</p><ul><li><p>GPT-5.2 Pro + Aristotle/Lean solved <a href="https://arxiv.org/abs/2601.07421">Erd&#337;s problem #728</a>. That was a narrower number theory problem.</p></li><li><p><a href="https://arxiv.org/abs/2603.28636">Erd&#337;s Problem #650</a> was <em><strong>AI-Assisted</strong></em>. ChatGPT proposed the proof, then human Mathematicians and Aristotle formalized it.</p></li><li><p>Terrence Tao has a comprehensive <a href="https://github.com/teorth/erdosproblems">GitHub Erd&#337;s AI</a> wiki that lists many contributions AI has made to these problems.</p></li></ul><p>This time is different.</p><p>The unit distance problem is central and famous in discrete geometry. This is qualitatively different from past successes.</p><p>The earlier AI-assisted Erd&#337;s results were like holding your child&#8217;s hand while they learned to walk.</p><blockquote><p><em><strong>This time,</strong></em> <em><strong>your child lets go and takes its first independent steps.</strong></em> </p></blockquote><h2>What the AI model actually did</h2><p>OpenAI frames this model as a &#8220;general-purpose reasoning model&#8221;. It is not trained specifically for math. It did not solve the problem within a larger system specialized for math.</p><p>It was given the problem. It reasoned about it. It disproved the existing conjecture.</p><p>Sebastien Bubeck:</p><blockquote><p><em><strong>Basically what the AI did is that it was able to use its vast knowledge of all of mathematics, to see a connection between discrete geometry and algebraic number theory, and then crucially it was able to masterfully chain together the argument, with expert level calculations at every step.</strong></em></p></blockquote><p>Noam Brown of OpenAI clarifies further:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/polynoamial/status/2057179104315670826?s=20&quot;,&quot;full_text&quot;:&quot;This is a general-purpose LLM. It wasn&#8217;t targeted at this problem or even at mathematics. Also, it&#8217;s not a scaffold. We have not pushed this model to the limit on open problems. Our focus is to get it out quickly so that everyone can use it for themselves. &quot;,&quot;username&quot;:&quot;polynoamial&quot;,&quot;name&quot;:&quot;Noam Brown&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1872883170292457472/8ywVGO5M_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-20T19:18:13.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HIyRC5xW8AA2KK0.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/J8N8epiafV&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:38,&quot;retweet_count&quot;:70,&quot;like_count&quot;:994,&quot;impression_count&quot;:235727,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>This is the key point: an artificial intelligence system added to the corpus of objective human knowledge. </p><p><em><strong>The AI model did that by relying on its own cognitive capabilities.</strong></em></p><h2>Experts React</h2><p>From OpenAI&#8217;s announcement:</p><blockquote><p><em><strong>&#8220;an AI system has autonomously resolved a longstanding open problem at the center of an active field.&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://openai.com/index/model-disproves-discrete-geometry-conjecture/">OpenAI, &#8220;An OpenAI model has disproved a central conjecture in discrete geometry&#8221;</a></strong></p><p>From Noga Alon:</p><blockquote><p><em><strong>&#8220;outstanding achievement&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 3: Noga Alon</a></strong></p><p>From Thomas Bloom:</p><blockquote><p><em><strong>&#8220;taught us something new&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 4: Thomas Bloom</a></strong></p><p>From Daniel Litt:</p><blockquote><p><em><strong>&#8220;vast expansion of the attention aimed at mathematical problems&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 6: Daniel Litt</a></strong></p><p>From Timothy Gowers:</p><blockquote><p><em><strong>&#8220;No previous AI-generated proof has come close to that.&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 5: W. T. Gowers</a></strong></p><p><strong>Watch this video</strong>. The astonishment is palpable.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;89f8eb0b-42fe-4b87-b4c6-d8c08fdee83d&quot;,&quot;duration&quot;:null}"></div><h2>The Philosophical Atom</h2><p>The main point of this essay is this:</p><blockquote><p><em><strong>The</strong></em> <em><strong>philosophical</strong></em> <em><strong>splitting</strong></em> <em><strong>of</strong></em> <em><strong>the</strong></em> <em><strong>atom</strong></em> <em><strong>is</strong></em> <em><strong>AI&#8217;s</strong></em> <em><strong>ability</strong></em> <em><strong>to</strong></em> <em><strong>create</strong></em> <em><strong>new</strong></em> <em><strong>explanatory</strong></em> <em><strong>knowledge.</strong></em> <em><strong>This,</strong></em> <em><strong>for</strong></em> <em><strong>the</strong></em> <em><strong>first</strong></em> <em><strong>time</strong></em> <em><strong>in</strong></em> <em><strong>history,</strong></em> <em><strong>has</strong></em> <em><strong>happened.</strong></em></p></blockquote><p>Evolution has brought us to the point where we can unlock the power of knowledge itself, much as splitting the atom unlocked the power of matter.</p><p>Sebastien Bubeck was careful to explain that this result does <em><strong>not</strong></em> represent &#8220;inventing new mathematics&#8221;:</p><blockquote><p><em><strong>It is truly a breakthrough result, yet at the same time it is also true that the model didn&#8217;t &#8220;invent&#8221; any &#8220;new mathematics&#8221;.</strong></em></p><p><em><strong>But this is the crucial point: merely being able to know deeply all the results in a scientific field, and being able to use all known arguments expertly and with just the right choice of parameters, that alone can lead to a ton of breakthroughs, and this is not just limited to mathematics, this type of (extremely) solid expert execution is the bread and butter of many many scientific advances.</strong></em></p></blockquote><p>Still, this <em><strong>is</strong></em> an example of artificial intelligence independently adding to the corpus of objective truth available to humanity. This is only the beginning. The consequences will be world-changing.</p><h2>Why Math Came First</h2><p>Mathematics is the ideal domain for AI. It is abstract and correct answers are verifiable.</p><p>That does not mean it&#8217;s the only domain where AI can make new discoveries. It&#8217;s the scientific domain where it&#8217;s easiest for AI to get started. But we are <em><strong>just</strong></em> getting started.</p><p>In my essay &#8220;<a href="https://attentionheads.substack.com/p/something-big-is-happening-its-bigger?r=2057tt">Something Big is Happening. It&#8217;s Bigger than You Think</a>&#8221; I argued that the implications of rapid AI progress are farther reaching than most realize. Claude Mythos for example is doing unprecedented things when it comes to Cybersecurity. Mythos was also not trained specifically for Cybersecurity.</p><p>Even if you do not care much for math, I am in that boat too, results like this will reach far beyond mathematics.</p><h2>Beyond Mathematics</h2><p>Theoretical scientific fields are the next intellectual dominoes to fall.</p><p>Think:</p><ul><li><p>Theoretical Physics</p></li><li><p>Theoretical Biology</p></li><li><p>Chemistry</p></li><li><p>Materials Science</p></li><li><p>Computer Science</p></li></ul><p>These are domains where AI can operate disembodied, in the realm of abstract information. If you do not visit that world often, you may miss how much power exists there.</p><p>Many modern technological breakthroughs began as discoveries in theoretical science. The internet in your pocket is one example.</p><p>Theoretical science is one of humanity&#8217;s most important handles on reality. It&#8217;s what distinguishes us from other animals. We can use our mind to understand and harness reality. AI just began to assist us in that.</p><p><em><strong>It</strong></em> <em><strong>is</strong></em> <em><strong>only</strong></em> <em><strong>the</strong></em> <em><strong>beginning.</strong></em></p><p>A model that can apply sustained attention across long durations will be a force multiplier for creating knowledge. Knowledge that can empower humanity to reach further. To live longer. To go deeper into the wonders of nature. To benefit the world.</p><p>It won&#8217;t stop with the theoretical either. Right now it&#8217;s hard for AI to make as substantial an impact on the physical world. That&#8217;s because we don&#8217;t have fully functioning robots yet. They are coming. Once AI has a body that can act on the world and run experiments in atomic space, the impact it will have will become even more powerful.</p><h2>The Beginning of Infinity</h2><p>This result from OpenAI is not &#8220;the end&#8221; of discovery or the arrival of final knowledge.</p><p>On the contrary, it is a new beginning: a new kind of knowledge-creating process entering the world.</p><p>As David Deutsch says:</p><blockquote><p><em><strong>&#8220;We</strong></em> <em><strong>are</strong></em> <em><strong>always</strong></em> <em><strong>at</strong></em> <em><strong>the</strong></em> <em><strong>beginning</strong></em> <em><strong>of</strong></em> <em><strong>infinity.&#8221;</strong></em></p></blockquote><p>Happy to be here with you.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>Sources:</h2><ul><li><p><strong><a href="https://openai.com/index/model-disproves-discrete-geometry-conjecture/">OpenAI announcement, May 20, 2026</a></strong></p></li><li><p><strong><a href="https://arxiv.org/html/2605.20695v1">Companion remarks on arXiv</a></strong></p></li><li><p><strong><a href="https://x.com/SebastienBubeck/status/2057187978720719114?s=20">Sebastian Bubeck&#8217;s X Article</a></strong></p></li></ul>]]></content:encoded></item><item><title><![CDATA[Demis Hassabis and the Long Game of AGI]]></title><description><![CDATA[A brief review of "The Infinity Machine" by Sebastian Mallaby]]></description><link>https://www.attentionheads.blog/p/demis-hassabis-and-the-long-game</link><guid isPermaLink="false">https://www.attentionheads.blog/p/demis-hassabis-and-the-long-game</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 18 May 2026 01:57:34 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!NbAu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NbAu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NbAu!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NbAu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg" width="795" height="1200" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1200,&quot;width&quot;:795,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:224628,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://attentionheads.substack.com/i/198201291?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NbAu!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I picked up (as an audiobook) <em><strong>&#8220;The</strong></em> <em><strong>Infinity</strong></em> <em><strong>Machine&#8221;</strong></em> by Sebastian Mallaby expecting a straightforward biography about Demis Hassabis. What I got instead was a portrait of a particular kind of ambition: not the desire to dominate a market, but the desire to understand intelligence itself, build it, and turn it back toward the mysteries of nature.</p><p>My brief review: this is worth reading if you want to understand DeepMind not just as an AI lab, but as the expression of one person&#8217;s unusually coherent theory of intelligence, games, science, and progress. The book weaves a thread from Demis&#8217; childhood to DeepMind today. The constant is his desire to unlock the mysteries of life with technology.</p><p>One detail from the book that crystallized this for me was the AlphaFold breakthrough. Demis was quoted as saying that science is the one field where AI can be completely positive. It&#8217;s obvious that Demis is interested in unlocking the mysteries of life.</p><h3>What stuck with me</h3><p>I got the impression that Demis is not in the race for power, money, or fame. None of the usual big tech trophies seem to be the point. He wants to build AI because he believes it is the most important thing to build for humanity. To the extent he uses power or influence, it seems to be as an instrument for a more transcendent aim.</p><p>The other AI lab leaders all say they want to benefit humanity. With Demis, I actually believe it&#8217;s more than talk.</p><p>Demis is a true believer in the idea that Turing machines can take us all the way to AGI. That we don&#8217;t need anything more than the very classical machine that Turing invented in 1936.</p><p>It&#8217;s a testament to his character that many of the colleagues who are by his side today, have remained by his side since the college days.</p><h3>The tension</h3><p>The central tension I felt is that DeepMind understands the gravity of its place in the world, but it still sits inside one of the most powerful commercial institutions on earth. The scientific ambition is to build safe AGI and use it to accelerate discovery. The corporate reality is Google: scale, competition, product pressure, and shareholders.</p><p>That is the drama the book left me sitting with: can a lab with genuinely scientific and humanitarian aims stay oriented toward those aims when it is embedded inside one of the most successful businesses of all time? This is what Elon and Sam Altman claim they were worried about when they started OpenAI.</p><p>And yet, I did not get the sense that Demis regretted joining Google. The resources mattered. The distribution mattered. The bargain may have been necessary. But it is still a bargain, and the consequences of that bargain become larger as the systems become more powerful.</p><h3>Who should read it</h3><p>I&#8217;d recommend it to anyone trying to understand the AI race beyond product launches, benchmark charts, and company drama. It is especially useful for builders who want to study long-term taste, institutional patience, and obsession with first principles. I would also recommend it to skeptics who assume every AI leader is motivated by money or power. The book does not remove every concern, but it makes Demis&#8217; ambition legible.</p><h3>Closing</h3><p>By the end, I understood why Demis and DeepMind can feel like they have the &#8220;mandate of heaven.&#8221; If someone is going to build toward AGI, you could do much worse than Demis Hassabis. But that is also the strange problem of this era. So much of the future may depend not only on capabilities, but on the character of the people and institutions building them. DeepMind may still be in as good a position as anyone to win the race. The world may be lucky if it does.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Something Big IS Happening. It's Bigger than you Think.]]></title><description><![CDATA[Think back to February 2026.]]></description><link>https://www.attentionheads.blog/p/something-big-is-happening-its-bigger</link><guid isPermaLink="false">https://www.attentionheads.blog/p/something-big-is-happening-its-bigger</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Thu, 14 May 2026 18:33:20 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!IPjR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IPjR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IPjR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 424w, https://substackcdn.com/image/fetch/$s_!IPjR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 848w, https://substackcdn.com/image/fetch/$s_!IPjR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 1272w, https://substackcdn.com/image/fetch/$s_!IPjR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!IPjR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png" width="1456" height="582" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:582,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1880079,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://attentionheads.substack.com/i/197623863?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!IPjR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 424w, https://substackcdn.com/image/fetch/$s_!IPjR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 848w, https://substackcdn.com/image/fetch/$s_!IPjR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 1272w, https://substackcdn.com/image/fetch/$s_!IPjR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19aa8f4-0402-4ad3-a034-5d26dc841ee9_1983x793.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Think back to February 2026.</p><p>Matt Shumer&#8217;s viral essay <a href="https://x.com/mattshumer_/status/2021256989876109403?s=20">&#8220;Something Big is Happening&#8221;</a> articulated a feeling: AI had started to work. AI was really happening. And like the early days of Covid, we didn&#8217;t appreciate what that meant.</p><p>A few months later, we have more than a feeling.</p><p>We have exponential progress staring us in the face.</p><p>Three months ago, the evidence was anecdotal: software engineers took a holiday break, and a few famous ones noticed that AI coding agents worked. They told their audiences about it and the swell started to grow. Bright minds like <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Dean W. Ball&quot;,&quot;id&quot;:5925551,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!mLaj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F49371abf-2579-47be-8114-3e0ca580af8b_1024x1024.png&quot;,&quot;uuid&quot;:&quot;1142a4a5-800a-44c7-9cb0-963be4ed7a54&quot;}" data-component-name="MentionToDOM"></span> began saying that Claude Code + Opus 4.5 was AGI.</p><p>Since then, the evidence has become institutional: AISI, METR, Anthropic-adjacent coalitions, cyber-security groups, huge AI-science financing.</p><p>If Matt&#8217;s essay was &#8220;we can see UFOs in the sky&#8221;, this essay is: </p><div class="pullquote"><p><strong>&#8220;The aliens have landed. They want to speak to our leader.&#8221;</strong></p></div><h1>Agents Become Undeniable</h1><p>There are two recent results that show agents have become largely autonomous.</p><h4>1. Claude Mythos Solves AISI&#8217;s Full Cyber Attack Simulations</h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tuw2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tuw2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 424w, https://substackcdn.com/image/fetch/$s_!tuw2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 848w, https://substackcdn.com/image/fetch/$s_!tuw2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!tuw2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tuw2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg" width="1456" height="921" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:921,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:&quot;Image&quot;,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!tuw2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 424w, https://substackcdn.com/image/fetch/$s_!tuw2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 848w, https://substackcdn.com/image/fetch/$s_!tuw2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!tuw2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b38fc3-8c92-40b2-89f7-4603035ac174_3910x2474.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Claude Mythos preview is the first model to solve both of AI Security Institute&#8217;s Cyber attack simulations. &#8220;The Last Ones&#8221; is one of the cyber tests Mythos successfully completed in 6/10 attempts. It is estimated to take a human attacker <strong>20</strong> <strong>hours</strong> to complete. The other cyber attack test Mythos completed, named &#8220;Cooling Tower&#8221;, was <em><strong>previously unsolved</strong></em>. Mythos succeeded in 3/10 attempts.</p><p>In November 2025 the approximate doubling time for AISI cyber test task duration was 8 months. By February of 2026 it had accelerated to ~4.7 months. Both Mythos and GPT-5.5 are ahead of the 4.7 month trend.</p><p>If that trend holds, AI task duration, at least for cyber tasks, will be <em><strong>super-exponential</strong></em>. The tasks models can complete are getting longer, and the rate of improvement is itself speeding up.</p><p>There&#8217;s no reason to assume this jump in capability remains limited to cyber tasks. <a href="https://red.anthropic.com/2026/mythos-preview/">Anthropic has confirmed</a> Mythos is a &#8220;<strong>new general-purpose language model&#8221;</strong> and say the cyber capabilities <strong>&#8220;emerged as a downstream consequence of general improvements in code, reasoning, and autonomy.&#8221;</strong></p><p>Anthropic decided to make Mythos available to a select group of organizations for cyber-defense purposes first, because that&#8217;s most important for society. This level of capability should generalize to other domains too. There is no reason to believe it won&#8217;t.</p><h4>2. Mythos Breaks METR</h4><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!TAq0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TAq0!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 424w, https://substackcdn.com/image/fetch/$s_!TAq0!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 848w, https://substackcdn.com/image/fetch/$s_!TAq0!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!TAq0!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!TAq0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg" width="1456" height="832" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:832,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:&quot;Image&quot;,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!TAq0!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 424w, https://substackcdn.com/image/fetch/$s_!TAq0!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 848w, https://substackcdn.com/image/fetch/$s_!TAq0!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!TAq0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8e18b5-7955-42d8-ba4c-ac6ff6263559_1632x933.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>METR measures something simple: how long a task takes a skilled human, and whether an AI agent can complete tasks of that duration with a given success rate. Their &#8220;50% time horizon&#8221; is the point where an agent succeeds half the time on tasks that would take a human expert that long.</p><p>Claude Mythos Preview is now past the edge of that measurement. <a href="https://metr.org/time-horizons/">METR&#8217;s latest update</a> added early Mythos results and warned that <em><strong>measurements above 16 hours are unreliable</strong></em> with the current task suite.</p><p>The reason this is interesting is not just &#8220;Mythos can do longer tasks.&#8221; It&#8217;s that our AI models are now outpacing our ability to benchmark them. We are starting to run out of clean, well-measured tasks long enough to test what these agents can do.</p><p>AI went from <em><strong>&#8220;can do tasks that would take human a couple minutes&#8221;</strong></em> to <em><strong>&#8220;tasks that would take a human a couple days&#8221;</strong></em> in a couple years. At least. METR says the measurements are unreliable.</p><div><hr></div><p>Cyber is the sharpest real-world test case, but Anthropic says the capability came from general improvements in code, reasoning and autonomy. The METR result backs that up.</p><p>Agents can now perform real, economically valuable work. They are getting better <em><strong>fast</strong></em>.</p><blockquote><p><em><strong>Agents have become undeniable</strong></em>.</p></blockquote><p>That&#8217;s great if the good guys have them. Not so great if the bad guys do.</p><h1>The Security World Responds</h1><p>This is exactly why Anthropic did not just ship Mythos to everyone.</p><p>Instead, they launched <a href="https://www.anthropic.com/glasswing">Project Glasswing</a>: a coordinated effort with AWS, Apple, Broadcom, Cisco, CrowdStrike, Google, JPMorganChase, the Linux Foundation, Microsoft, NVIDIA, Palo Alto Networks and others to use Mythos for cyber defense first.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Z8LI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Z8LI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 424w, https://substackcdn.com/image/fetch/$s_!Z8LI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 848w, https://substackcdn.com/image/fetch/$s_!Z8LI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 1272w, https://substackcdn.com/image/fetch/$s_!Z8LI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Z8LI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png" width="1456" height="566" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:566,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Z8LI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 424w, https://substackcdn.com/image/fetch/$s_!Z8LI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 848w, https://substackcdn.com/image/fetch/$s_!Z8LI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 1272w, https://substackcdn.com/image/fetch/$s_!Z8LI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93b322db-e9a2-45db-9cb7-b14df9cc44a3_3184x1238.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Think about that for just a minute.</p><p>One of the leading AI labs built a general-purpose model so capable at finding and exploiting software vulnerabilities that they decided the responsible first release was not a chatbot product but a security coalition. Some criticize the move as pure &#8220;marketing hype.&#8221; But it would have been a better marketing strategy to release Mythos widely and keep growing revenue.</p><p>Anthropic says Mythos has already found <strong>thousands</strong> of high-severity vulnerabilities, including bugs in every major operating system and every major web browser. Some were  quite old. One was a <strong>27-year-old</strong> vulnerability in OpenBSD. Another was a <strong>16-year-old</strong> bug in FFmpeg that automated testing tools had hit millions of times without catching.</p><p>And again: Mythos was not trained specifically to be a cyber weapon. The cyber capabilities emerged from improvements in <em><strong>coding, reasoning and autonomy</strong></em>.</p><p>That&#8217;s the part that should send a chill down everyone&#8217;s spine.</p><p>If you have an AI agent that can autonomously find subtle bugs, chain vulnerabilities together, reverse engineer binaries, and produce working exploits, you have something that can change the balance between attackers and defenders.</p><p>In the short term, this is dangerous. Attackers only need to find one path in. Defenders have to protect everything. If models like Mythos become widely available before defenders are ready, the bad guys get leverage too.</p><p>But this is also why the upside is so large.</p><p>For the first time, the good guys may have a tool that can search through huge amounts of critical software and find the hidden cracks before attackers do. Anthropic is putting up <strong>$100 million</strong> in usage credits for Project Glasswing and additional participants, plus millions more for open-source security organizations.</p><p>That&#8217;s why it&#8217;s so important that powerful AI is pointed in the right direction.</p><p>It could become a true boon to society, but only if we use it that way.</p><p>Powerful AI could help harden the software that banks, hospitals, governments, browsers, phones, servers, and open-source projects depend on.</p><p>I expect this pattern to repeat. The same capability that makes AI risky also makes it useful. The same autonomy that can be abused can also be used to defend, discover, repair and build.</p><blockquote><p><em><strong>It&#8217;s not so much a double-edged sword as it is a double-edged cognitive nuclear weapon.</strong></em></p></blockquote><h1>The Next Frontier Is Doing AI Research</h1><p>And cyber is not the end of the story.</p><p>It&#8217;s just the first place where the rubber hit the road for civilizational infrastructure.</p><p>The next frontier is AI systems doing AI research itself. Then, potentially, autonomous scientific research writ large. </p><p><span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Jack Clark&quot;,&quot;id&quot;:44606,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!c2Tg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8cc1c9c9-fc87-4eeb-ad15-7dc989b77553_528x504.png&quot;,&quot;uuid&quot;:&quot;e1526694-0451-4ce5-9b7a-9ff7be39c53a&quot;}" data-component-name="MentionToDOM"></span>, co-founder of Anthropic and author of <a href="https://importai.substack.com/p/import-ai-455-automating-ai-research">Import AI</a>, recently said he now thinks there is a <strong>60%+ chance</strong> that we get no-human-involved AI R&amp;D by the end of 2028. In plain English: an AI system powerful enough that it could autonomously build its own successor.</p><p>It sounds sci-fi, until you look at what AI research is and what models are already good at.</p><p>Think about it. What is AI research? Some of it is inspiration. New ideas. Taste. Weird intuition. The thing that causes someone to see a problem from an original perspective.</p><p>But much of it is something else.</p><p>A lot of AI research is writing code, running experiments, cleaning data, reading papers, reproducing results, debugging training runs, optimizing kernels, comparing model outputs, searching through failed attempts, and trying again.</p><p>That is exactly the kind of work agents are getting good at.</p><p>Andrej Karpathy&#8217;s <strong><a href="https://github.com/karpathy/autoresearch">autoresearch</a></strong> project proved that today&#8217;s AI models can already do autonomous research to improve a model&#8217;s own hyperparameters. What happens when you can not only improve a model&#8217;s hyperparameters, but when you can autonomously improve the algorithms, the architecture, the data mix, all of the ingredients that go into making a model stronger than it currently is?</p><p>This is where the latest METR results come into the picture. Right now models can do coding tasks that might take a human SWE a couple days. Soon, models may be capable of research tasks that would take a human researcher even longer.</p><p>AI is not a replacement for the best human researchers yet. Not some magic oracle that invents the Transformers successor on command.</p><p>But a synthetic colleague that can take more and more of the toil.</p><p>And once AI can automate large chunks of AI research, progress stops being limited only by the number of human researchers who can think, code, test and iterate. Progress starts being limited by compute, data, evaluation, safety, and how well we can direct these systems.</p><p>Then the human researchers can do what they do best: sit around being inspired. And the autonomous AI researchers can do what machines do best: carry out the toil without ever getting bored or tired.</p><p>Because if AI helps build better AI, and better AI helps build even better AI, the feedback loop becomes recursive. The thing improving is also becoming part of the improvement process.</p><p>That is why &#8220;Something big is happening&#8221; turns into &#8220;It&#8217;s Bigger than you Think&#8221;. Humans have a very hard time conceptualizing exponential progress. It&#8217;s not how we evolved. </p><p>AI progress may literally accelerate past the point that we can imagine due to our inherent cognitive limitations.</p><p>And if AI can automate its own research, it is plausible that it will eventually automate the whole of scientific research. It may become capable of autonomously creating explanatory scientific knowledge. And it could do this 24/7/365. This is harder until AI can run experiments in atomic space, but it is plausible.</p><p>The quantum physicist and scientific philosopher David Deutsch defines true wealth as &#8220;the set of physical transformations you have the knowledge to effect on the world.&#8221;</p><p>Powerful AI may come to the point where it can <em><strong>autonomously</strong></em> <em><strong>create</strong></em> <em><strong>that</strong></em> <em><strong>type</strong></em> <em><strong>of</strong></em> <em><strong>wealth,</strong></em> <em><strong>nonstop,</strong></em> <em><strong>for</strong></em> <em><strong>as</strong></em> <em><strong>long</strong></em> <em><strong>as</strong></em> <em><strong>we</strong></em> <em><strong>keep</strong></em> <em><strong>the</strong></em> <em><strong>datacenters</strong></em> <em><strong>running.</strong></em></p><h1>The Upside Is Not Just Productivity</h1><p>This is why the upside is so much bigger than &#8220;AI makes workers more productive.&#8221;</p><p>That framing is true, but it is too small. It makes AI sound like better email, faster spreadsheets, cheaper customer support and faster software engineers. Useful. Valuable. Economically important.</p><p>But not world-historical.</p><p>The real upside is not that AI lets us do the same things faster. It is that AI may let us do things we cannot do at all today.</p><p><em><strong>The</strong></em> <em><strong>upside</strong></em> <em><strong>is</strong></em> <em><strong>that</strong></em> <em><strong>AI</strong></em> <em><strong>unlocks</strong></em> <em><strong>new</strong></em> <em><strong>vistas</strong></em> <em><strong>for</strong></em> <em><strong>the</strong></em> <em><strong>human</strong></em> <em><strong>race.</strong></em></p><p>It may let us search spaces that are too large for human teams. Read literatures too vast for any one researcher. Run simulations, propose experiments, debug failures, generate hypotheses, write code, compare results, and keep going after every human in the lab has gone home.</p><p>That is larger than productivity.</p><p>That is acceleration of discovery.</p><p>One concrete example is drug discovery. Isomorphic Labs recently raised <a href="https://www.isomorphiclabs.com/articles/isomorphic-labs-announces-series-b-investment-round">$2.1 billion</a> to build AI systems for designing new medicines. That does not mean AI has already cured disease. It does not mean biology is solved. Biology is messy, expensive, physical, and brutally humbling.</p><p>But it does mean some of the smartest capital in the world is now betting that AI can change the economics of discovering medicines.</p><p>Isomorphic&#8217;s stated mission is to <em><strong>&#8220;solve all disease.&#8221;</strong></em></p><p>That&#8217;d be a <em><strong>pretty</strong></em> big deal.</p><p>Because the optimistic case for AI is not &#8220;your boss gets a cheaper intern.&#8221; The optimistic case is that humanity gets more shots on goal against cancer, Alzheimer&#8217;s, rare diseases, antibiotic resistance, aging, climate, materials science, energy, and every other hard problem where progress is bottlenecked by the rate at which we can create and test knowledge.</p><p>Many of us are still thinking about AI as a labor technology. A productivity tool.</p><p>We ask: whose job does it replace? Whose salary does it compress? Which company gets more efficient?</p><p>Those are important questions. We should take them seriously. There will be disruption. There will be losers. There will be people caught in the transition who did not ask to be part of a civilizational technology experiment. That may be most of us. We should not hand-wave that away.</p><p>But labor is not the deepest category here.</p><p><em><strong>Knowledge is.</strong></em></p><p>If AI becomes a system for creating new knowledge, then the relevant comparison is not outsourcing or automation. It is the printing press. The scientific method. The computer. The internet. Maybe something larger than all of them, because this time the tool is not just storing or transmitting human thought. It is beginning to participate in the process of generating it. </p><p>It would be a force capable of creating new knowledge. Humans have been the only known example of that force for all of history.</p><p>That is what makes this moment:</p><blockquote><p><em><strong>Bigger</strong></em> <em><strong>than</strong></em> <em><strong>you</strong></em> <em><strong>Think.</strong></em></p></blockquote><p>The same systems that can find software vulnerabilities may help secure hospitals and banks. The same systems that can automate parts of AI research may help automate parts of biology, chemistry, materials science, engineering and medicine. The same systems that can displace some forms of work may also give millions of people access to tutors, coaches, collaborators, translators, programmers, analysts and teachers that would previously have been unavailable to them at any price.</p><p>Imagine a world where a kid in a small town can learn math, coding, physics, writing, biology, design and entrepreneurship with an infinitely patient tutor that adapts to them personally.</p><p>Imagine a nurse retraining into software. A factory worker learning robotics. A founder building a product that would have required a twenty-person engineering team five years ago. A patient with a rare disease getting an AI-assisted explanation of the latest research that their local doctor would never have had time to read.</p><p>None of this is guaranteed.</p><p>That part is important.</p><p>Powerful AI does not automatically distribute itself fairly. It does not automatically cure disease. It does not automatically make people wiser, institutions better, or society more humane. It can concentrate power. It can accelerate conflict. It can widen inequality. It can flood the world with synthetic persuasion and automated offense.</p><p>But it is also not realistic to look at a technology that may automate large parts of science and only see danger.</p><p>The dangers are real. The upside is also real.</p><p>And the upside is <em><strong>not</strong></em> marginal.</p><p>If we can point these systems in the right direction, they may become a way for civilization to solve problems faster than the problems compound. They may help us harden the digital world, discover new medicines, invent new materials, teach new skills, build new institutions, and create forms of wealth that are not just financial, but physical, scientific, educational and human.</p><blockquote><p><em><strong>They</strong></em> <em><strong>may</strong></em> <em><strong>help</strong></em> <em><strong>us</strong></em> <em><strong>defer</strong></em> <em><strong>death.</strong></em> <em><strong>They</strong></em> <em><strong>may</strong></em> <em><strong>help</strong></em> <em><strong>us</strong></em> <em><strong>expand</strong></em> <em><strong>life.</strong></em></p></blockquote><p>That is the version of &#8220;something big is happening&#8221; that I think people still underestimate.</p><p>Greater than smarter models.</p><p>Greater than better coding agents.</p><p>Greater than productivity software with a chat box.</p><p>A new engine for creating knowledge.</p><p>That is why we <em><strong>must</strong></em> get this right.</p><h1>The Dangers Are Real. They Are Not The Whole Story.</h1><p>This is where the public conversation usually breaks down. For that reason, this is where we need to come together.</p><p>One side sees the upside and treats the risks like annoying footnotes. The other side sees the risks and treats the upside like a marketing hallucination.</p><p>Both are wrong.</p><p>The closer you get to approaching truth, the more you perceive paradox.</p><p>F. Scott Fitzgerald said: </p><div class="callout-block" data-callout="true"><p><em><strong>&#8220;The test of a first-rate intelligence is the ability to hold two opposed ideas in the mind at the same time, and still retain the ability to function.&#8221;</strong></em></p></div><p>The risks are not imaginary. We just walked through one of them. A model that can autonomously complete cyber attack simulations is not a toy. A model that can find hidden vulnerabilities, chain them together, and produce working exploits can make the world less secure if it is released carelessly or used by the wrong people.</p><p>That is not doomposting.</p><p>That is just what the capability is.</p><p>The same is true in other domains. If AI can accelerate research, it can accelerate good research and bad research. If AI can persuade, it can teach and manipulate. If AI can code, it can build useful software and malware. If AI can discover new biology, it can help cure disease and lower the barrier to biological misuse.</p><p>This is the basic shape of powerful technology.</p><p>Fire cooks food and burns cities. Electricity lights hospitals and powers electric chairs. Nuclear physics gave us both abundant energy and weapons that can end civilization. The internet connected the world and also gave us misinformation at planetary scale.</p><p>AI is not different because it has no downside.</p><blockquote><p><em><strong>AI is different because the downside and upside both scale with intelligence.</strong></em></p></blockquote><p>That is why I do not think the right posture is acceleration at all costs. It is also why I do not think the right posture is fear at all costs.</p><p>The right posture is sincere courage.</p><p>We need strong evaluations. We need responsible release decisions. We need security coalitions like Project Glasswing. We need better monitoring for dangerous capabilities. We need model labs to cooperate where they should cooperate, compete where they should compete, and be honest about what their systems can do.</p><p>We need governments that understand the technology well enough to regulate it without strangling the parts of it that could help humanity most.</p><p>We need builders who do not treat every safety concern as cope from people who do not understand progress.</p><p>And we need safety people who do not treat every expression of hope as naivete.</p><p><em><strong>We need balance.</strong></em></p><p>Because the scary truth is that we probably need the powerful systems to help manage the risks created by the very same powerful systems.</p><p>That is already what Project Glasswing points toward. The answer to AI-enabled cyber risk is not simply &#8220;never build capable models.&#8221; The answer is to make sure defenders get the best tools first, to harden the systems society depends on, and to build institutions that can react at the speed this technology is moving.</p><p>The same pattern may apply everywhere.</p><p>We may need AI to help audit AI. AI to help secure AI. AI to help explain AI. AI to help discover the medicines, materials, energy systems and defensive tools that make the next world more survivable than this one.</p><p>There&#8217;s no way around it. We can&#8217;t turn back the clock.</p><p>That does not mean we should trust the machines blindly.</p><p>It means we should stop pretending the only choices are worship and panic.</p><p>The question is not whether AI is good or bad in the abstract.</p><p>The question is whether we can build, deploy and govern it in a way that lets the upside outrun the danger.</p><p>That is the real stakes of this moment.</p><p><em><strong>Not whether AI is impressive. It is.</strong></em></p><p><em><strong>Not whether AI is dangerous. It is.</strong></em></p><p>Whether we can become earnest enough, fast enough, to use something this powerful for human flourishing instead of letting it become another force that overwhelms us.</p><h1>Can Humanity Grow Up Fast Enough?</h1><p>That, to me, is the pertinent question.</p><p>AI progress is real.</p><p>The models will get much more capable.</p><p>The stakes are civilizational.</p><p>The question is whether our institutions, norms, laws, labs, companies, and personal habits can mature quickly enough to meet what we are building.</p><p>Because the technology won&#8217;t wait for us to become wise.</p><p>The models are improving. The agents are getting longer-horizon. The benchmarks are straining. The security world is reorganizing. AI research itself is starting to look automatable. AI-for-science is attracting billions of dollars.</p><p>This is already happening.</p><p>The choice is not whether to live in the age of AI.</p><p><em><strong>The choice is what kind of age of AI we are going to build.</strong></em></p><p>We can build one where power concentrates, institutions lag, attackers get leverage, workers are treated as disposable, and everyone slowly loses trust in what they see, read and hear.</p><p>Or we can build one where powerful AI is pointed at the bottlenecks that actually make human life worse: <em><strong>disease, insecurity, ignorance, fragility, wasted talent, broken institutions, brittle software, slow science, and the fact that most people never get access to the kind of personalized education, mentorship and tools that would let them become what they could become.</strong></em></p><p>That second path is not automatic.</p><p>No path is.</p><p>It has to be chosen.</p><p>It has to be built.</p><p>It has to be defended.</p><blockquote><p><em><strong>Humanity has to walk the walk. And we can.</strong></em></p></blockquote><p>And it has to be done by people who can hold two thoughts in their head at once: this technology is dangerous, and this technology is one of the greatest opportunities humanity has ever had.</p><p>The public conversation keeps trying to collapse AI into a single moral category: savior or monster, bubble or apocalypse, productivity tool or existential threat.</p><p>But the reality is deeper than that.</p><p>AI is becoming a new layer of civilization. A layer that can create civilization level software, search for vulnerabilities, teach people, assist researchers, compress expertise, automate experiments, discover patterns, generate plans, and maybe eventually create new scientific knowledge.</p><p>That is why this feels so difficult to reason about. We are not just adding a new app to the economy. We are adding something closer to a new kind of cognitive infrastructure.</p><p>It is unprecedented.</p><p>A civilization with more intelligence available to it is not automatically a better civilization.</p><p>But it is a civilization with greater possibility.</p><p>More ability to see hidden cracks before they break. More ability to test ideas before they become dogma. More ability to discover treatments before people die waiting. More ability to teach people before their potential closes. More ability to build tools that used to require institutions. More ability to turn knowledge into real transformations in the world.</p><p>That is what I think Matt was pointing at in February.</p><p>The feeling that something had changed.</p><p>The sense that the old categories were no longer enough.</p><p>The awareness that we were watching the beginning of something whose full shape had not arrived yet.</p><p>A few months later, the shape is clearer.</p><p>Agents have become undeniable.</p><p>The security world is responding.</p><p>AI research itself may be next.</p><p>AI-for-science is becoming a serious institutional bet.</p><p>And the upside, if we aim this correctly, is not just faster work.</p><p>It is faster discovery.</p><p>Faster learning.</p><p>Faster healing.</p><p>Faster building.</p><p>Maybe, eventually, a faster path toward a world with less needless suffering and more human possibility.</p><p>A world where we all smile a lot more.</p><p>Something big is happening.</p><p>But it is bigger than another model release.</p><p>Bigger than another benchmark.</p><p>Bigger than another viral AI moment.</p><blockquote><p><em><strong>The thing that is happening is that intelligence is becoming civilizational infrastructure.</strong></em></p></blockquote><p>And if we do this right, that infrastructure may help humanity heal, learn, build, discover and adapt at a scale we still do not know how to imagine.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Attention Is All You Need, But What Is Attention?]]></title><description><![CDATA[In 2017, a group of researchers published a machine translation paper with one of the great titles in the history of AI: Attention Is All You Need.]]></description><link>https://www.attentionheads.blog/p/attention-is-all-you-need-but-what</link><guid isPermaLink="false">https://www.attentionheads.blog/p/attention-is-all-you-need-but-what</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 10 May 2026 12:00:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!aEvy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!aEvy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!aEvy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 424w, https://substackcdn.com/image/fetch/$s_!aEvy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 848w, https://substackcdn.com/image/fetch/$s_!aEvy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 1272w, https://substackcdn.com/image/fetch/$s_!aEvy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!aEvy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png" width="1164" height="703" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:703,&quot;width&quot;:1164,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Understanding Attention Mechanism, Self-Attention Mechanism and Multi-Head  Self-Attention Mechanism | by Sapna Limbu | Medium&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Understanding Attention Mechanism, Self-Attention Mechanism and Multi-Head  Self-Attention Mechanism | by Sapna Limbu | Medium" title="Understanding Attention Mechanism, Self-Attention Mechanism and Multi-Head  Self-Attention Mechanism | by Sapna Limbu | Medium" srcset="https://substackcdn.com/image/fetch/$s_!aEvy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 424w, https://substackcdn.com/image/fetch/$s_!aEvy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 848w, https://substackcdn.com/image/fetch/$s_!aEvy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 1272w, https://substackcdn.com/image/fetch/$s_!aEvy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb30c0a48-607d-4686-beb5-4532c7a417ae_1164x703.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>In 2017, a group of researchers published a machine translation paper with one of the great titles in the history of AI: <em>Attention Is All You Need</em>.</p><p>At the time, the title was technical. The paper introduced the Transformer, an architecture that dispensed with recurrence and convolution and made attention the core primitive for processing sequences. In retrospect, the title now feels mythical. It names the mechanism that helped unlock the modern AI era.</p><p>But the title also raises a deeper question.</p><p>If attention was the breakthrough needed to allow machines to become intelligent, what exactly is attention?</p><p>And if attention matters this much for machines, what does that imply about us human beings?</p><p>This is the question I want to use as the first real essay for Attention Heads, because it sits right at the center of what this publication is about. Artificial attention. Human attention. Consciousness. World models. Meditation. Technology. My life experience has shown me that attention is the most powerful force in the world..</p><p>My starting thesis is simple, and maybe too grand, but I think it is directionally true:</p><blockquote><p>Attention is the most powerful force in the universe because it transforms potential into reality.</p></blockquote><p>Not a physical force like gravity. Not a mystical substance. A causal force that acts on the informational substrate of reality. What receives attention gets selected, modeled, strengthened, practiced, funded, remembered, and eventually built.</p><p>Attention is where possibility becomes actuality..</p><h2>What Machine Attention Does</h2><p>The original Transformer paper is not about meditation, consciousness, or philosophy. It is about sequence transduction, especially machine translation. But the core idea is surprisingly approachable.</p><p>A model is given a sequence of tokens. To understand or produce the next representation, each token needs to know which other tokens matter. Some words depend on nearby words. Some depend on words much earlier in the sentence. Some phrases only make sense in relation to the whole.</p><p>Machine attention gives the model a way to ask:</p><blockquote><p>Given where I am, what else in this context is relevant?</p></blockquote><p>That is the breakthrough of Transformers and the attention mechanism at the fundamental level.</p><p>Instead of processing a sentence only step by step, self-attention lets tokens look across the sequence and assign weight to one another. Multi-head attention lets the model do this in several ways at once. One head might track syntax. Another might track reference. Another might track a phrase-level dependency. The model is not literally thinking in these terms, but the architecture creates room for multiple patterns of relevance to be discovered in parallel.</p><p>This is one reason the Transformer was so powerful. It made <em>relation</em>, not mere sequence, the center of computation.</p><p>A sentence is not understood word by word. It is understood through relations: this pronoun points back to that noun; this adjective modifies that object; this phrase changes the meaning of the whole. Attention lets a model dynamically weight those relations.</p><p>The results was a general purpose architecture for learning from context. Learning from the meaning between the words. This has changed the world.</p><h2>Machine Attention Is Not Human Attention</h2><p>It is important not to overstate the analogy.</p><p>Transformer attention is not awareness. It is not mindfulness. It is not subjective experience. It is a mathematical operation inside a machine learning model. It routes information by computing patterns of relevance among tokens.</p><p>A model attending to a word is not the same as a human attending to a breath, a face, a memory, or a feeling. As far as we know, Claude doesn&#8217;t actually <em>care</em> about the sentences it&#8217;s processing.</p><p>But the analogy is still revelatory.</p><p>The architecture that unlocked modern AI did not simply get bigger. It got better at selective relevance. It learned which parts of the context should influence what happens next.</p><p>That phrase, selective relevance, is the bridge.</p><p>Because human beings do not experience reality as a raw, complete, neutral feed either. We experience a world that has already been selected, filtered, weighted, interpreted, and stabilized by attention.</p><p>Most of the time, we do not directly experience the world. We experience generated perceptions overlaid onto reality. We live inside our mentally constructed world model. </p><p><strong>And that world model is mediated by attention.</strong></p><h2>Human Attention Generates A World</h2><p>Look around the room you are in right now.</p><p>Before reading this sentence, you were probably not conscious of the feeling of your feet, the exact shape of the shadows, the sound floor of the room, the temperature on your skin, the peripheral objects outside the center of your visual field, or the emotional tone in your body.</p><p>Those things were there. But they were not equally real to you.</p><p>When I suggest giving your attention to them, they become more real.</p><p>Attention is what makes some part of the field come forward.</p><p>This is one of the strange truths of ordinary experience: salience feels like reality. What captures attention feels more real, more urgent, more meaningful, more central. What falls outside attention fades into the background, even if it is still causally present.</p><p>This is why attention is not merely a spotlight. It is also a world-generator.</p><p>What we attend to repeatedly becomes familiar. What becomes familiar becomes salient. What becomes salient begins to guide action. Over time, action shapes the world.</p><p>This is true at the scale of a person <em>and</em> at the scale of a civilization.</p><p>Do you know one reason Apple is one of the most valuable companies in the world? When Apple does something, it commands attention.</p><p>A product event. A design choice. A rumor. A keynote. A new category. The attention is not incidental to the value. It is part of the value. Collective attention changes what developers build for, what journalists explain, what competitors copy, what consumers desire, and what markets price in.</p><p>Attention is economic. Attention is cultural. Attention is spiritual. Attention is computational.</p><h2>Attention Alone Is Not All You Need</h2><p>The paper title is perfect, but as a human philosophy it needs a correction.</p><p>Attention alone is not all you need.</p><p>You need to realize what is relevant.</p><p>This is where John Vervaeke&#8217;s idea of relevance realization comes into play. The mind is constantly faced with a combinatorial explosion of possible things it could notice, infer, remember, imagine, or do. Intelligence depends on somehow zeroing in on what matters for this moment, this context, this problem, this life.</p><p>Attention is the lever. Relevance realization is the art.</p><p>A person can pour attention into the wrong object. We do this all the time. Rumination is attention. Addiction is attention. Doomscrolling is attention. Resentment is attention. Status anxiety is attention. The problem is not that these things fail to capture attention. The problem is that they capture it too well.</p><p>So the real question is not only, &#8220;What am I attending to?&#8221;</p><p>It is:</p><blockquote><p>What is my attention teaching me is relevant?</p></blockquote><p>And then:</p><blockquote><p>Is that actually worthy of my life?</p></blockquote><p>Learning to gently give your attention to that which is genuinely valuable, and not only projecting the image of value, can transform your life</p><h2>Time Flows Through Attention</h2><p>Henri Bergson thought deeply about time, duration, consciousness, and the difference between lived time and measured time. Clock time is divided into units. Lived time is not like that. It stretches, compresses, thickens, and flows.</p><p>Attention has a lot to do with that.</p><p>A minute of boredom can feel longer than an hour of flow. A difficult memory can collapse ten years into the present. A conversation can make time disappear. A meditation session can reveal that what we call &#8220;the present&#8221; is not a razor-thin instant but a living duration, textured by memory, anticipation, sensation, and care. How long does now last?</p><p>This matters because attention does not only select objects in space. It changes the felt structure of time.</p><p>What we attend to determines the tempo of experience. The feed accelerates time. Grief slows it. Flow smooths it. Fear fragments it. Meditation can widen it.</p><p>If machine attention helps a model decide which parts of context matter, human attention helps decide what kind of time we live inside.</p><h2>Meditation As Attention Training</h2><p>Meditation can be relaxation. That is meditation 101, and it is not nothing. A nervous system that can settle has more room to perceive.</p><p>But meditation can become something deeper than relaxation.</p><p>It can become attention training.</p><p>And when meditation really starts to flourish, it becomes the practice of attending to attention itself.</p><p>You notice the breath. Then you notice that attention left the breath. Then you notice where it went. Then you notice the quality of grasping, avoiding, dullness, clarity, impatience, tenderness, judgment, returning. Eventually the object is not the whole point. The movement of attention becomes visible.</p><p>This is a profound shift.</p><p>Most of the time, attention is transparent. We look through it. Meditation helps us look at it.</p><p>Through that training, attention becomes more general. The sphere of what you naturally attend to expands. You notice more subtle sensations, more emotional tones, more reactive patterns, more beauty, more suffering, more gaps between impulse and action.</p><p>Your life experience is enriched. You experience the moment more fully. More as what you truly are rather than your dream of yourself.</p><p>In AI terms, and only as a metaphor, meditation changes the routing of relevance. It does not merely add new information. It changes what the system is available to notice notice.</p><h2>The Lever We Are Responsible For</h2><p>Attention may be the single most important lever a human being can voluntarily pull.</p><p>We do not control everything we think. We do not control everything we feel. We do not control the culture we are born into, the technologies around us, the incentives of the platforms we use, or the full contents of the mind.</p><p>But we have some relationship to attention.</p><p>Not total control. Not sovereign command. But a relationship. A practice. A capacity to notice capture, return, redirect, widen, soften, and sustain.</p><p>That makes attention ethically serious.</p><p>What you give your attention to grows. Not always externally, but internally. It gains weight in the world model. It becomes easier to return to. It becomes part of the atmosphere of your life.</p><p>This is why attention is not just a productivity topic. It is not just about focus or deep work. It is about responsibility.</p><p>Ultimately, one of the things we are most responsible for is where we invest our attention.</p><h2>Attention As Optimization</h2><p>In machine learning, attention changes what information influences the next representation.</p><p>In human life, attention changes what influences the next perception, the next emotion, the next action, the next habit.</p><p>In society, collective attention changes what gets funded, copied, rewarded, feared, regulated, and built.</p><p>Attention is where optimization begins.</p><p>This is why attention transforms potential into reality.</p><p>The possible is enormous. Infinite things could be noticed, imagined, desired, feared, built, studied, loved, or worshiped. Attention selects from that field. It says: this. Not that. Return here. Strengthen this. Model this. Build around this.</p><p>A human life is partly the accumulated shape of those selections.</p><p>A culture is too.</p><h2>The Synthesis</h2><p>Machine attention asks:</p><blockquote><p>What matters in this context?</p></blockquote><p>Human attention asks:</p><blockquote><p>What becomes real enough to shape experience?</p></blockquote><p>Meditative attention asks:</p><blockquote><p>Can the movement of attention itself be known?</p></blockquote><p>Philosophical attention asks:</p><blockquote><p>What are we assuming is relevant, and why?</p></blockquote><p>Cultural attention asks:</p><blockquote><p>What are we collectively choosing to optimize around?</p></blockquote><p>These are not the same question. We should not collapse them into one another. But they rhyme.</p><p>The Transformer did not prove a spiritual thesis. It did not show that machines are conscious. It did not show that human minds are just neural networks. But it did demonstrate something that feels true far beyond machine translation:</p><p>Intelligence depends on relevance.</p><p>And relevance depends on attention.</p><h2>What Deserves Attention?</h2><p>So the question is not only whether attention is all you need.</p><p>The deeper question is whether your attention is being <strong>captured</strong> or <strong>cultivated</strong>.</p><p>What deserves your attention?</p><p>What is capturing it without permission?</p><p>What are you training yourself to notice?</p><p>What kind of time does your attention create?</p><p>What kind of world model is it stabilizing?</p><p>What would change if attention were treated as sacred, not merely scarce?</p><div class="pullquote"><p><em><strong>The future may belong not only to those who build better models, but to those who learn how to attend.</strong></em></p></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Start Here: What Attention Heads Is About]]></title><description><![CDATA[AI, Attention and the Practice of Seeing Clearly]]></description><link>https://www.attentionheads.blog/p/start-here-what-attention-heads-is</link><guid isPermaLink="false">https://www.attentionheads.blog/p/start-here-what-attention-heads-is</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Fri, 08 May 2026 11:25:11 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ojPE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ojPE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ojPE!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 424w, https://substackcdn.com/image/fetch/$s_!ojPE!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 848w, https://substackcdn.com/image/fetch/$s_!ojPE!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 1272w, https://substackcdn.com/image/fetch/$s_!ojPE!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ojPE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png" width="1456" height="621" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:621,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:758260,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://attentionheads.substack.com/i/196889177?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ojPE!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 424w, https://substackcdn.com/image/fetch/$s_!ojPE!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 848w, https://substackcdn.com/image/fetch/$s_!ojPE!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 1272w, https://substackcdn.com/image/fetch/$s_!ojPE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ac92057-0ca1-4b04-9920-998a3f1a6e0a_1920x819.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3><strong>AI, Attention and the Practice of Seeing Clearly</strong></h3><p>I have spent the last few years thinking in public about AI, mostly on X.</p><p>That has been valuable. X rewards speed, compression, and cleverness. It trains you to notice weak signals early, find the interesting part quickly, and say the thing before the moment has passed.</p><p>But a lot of the work I care about now needs more depth.</p><p>Model launches are not just product announcements. They are changes in what is possible for builders. They are changes in what is possible for humanity.</p><p>Benchmarks are more than just scores. They are signposts to what kinds of work models can and cannot reliably do.</p><p>Agent systems are more than shiny new software services. They are a new way of interacting with the realm of information; what Teilhard de Chardin called the Noosphere.</p><p>And underneath all of this is a deeper question I have lived with my entire life:</p><blockquote><p>What is attention?</p></blockquote><p>Not just transformer attention. Human attention too. The thing that determines what we notice, what we ignore, what we optimize for, what we believe, what we practice, and what and who we care about.</p><p>That is what &#8220;Attention Heads&#8221; is all about.</p><p>Attention Heads is a place for writing about artificial attention, human attention, and the practices that help us see more clearly. Deep, evidence-backed interpretation of what AI is really doing to our cognition, our agency, and what it means to be human.</p><p>Because the fulcrum of existence hangs on attention.</p><p>Most of the early writing here will stay close to AI and agentic engineering, because that is where my public work already has the most momentum and where the changes are happening fastest.</p><p>I will write about:</p><ul><li><p>new AI models and why they matter</p></li><li><p>AI agents, coding tools, evals, memory, context, and harness design</p></li><li><p>research papers that matter for people building real systems</p></li><li><p>the competitive dynamics between OpenAI, Anthropic, Google, Meta, xAI, Chinese open-weights, coding-agent companies, infra providers, and open source ecosystems</p></li><li><p>practical patterns from my own work with Codex, Claude Code, Linear, GitHub, Obsidian, local tools, and long-running agent workflows and more</p></li></ul><p>But I do not want the publication to be trapped inside machine-like AI commentary.</p><p>The larger territory is attention, intelligence, reality-testing, contemplative practice and living with a dynamic mind: how minds and machines perceive, model, reason, fail, recover, and sometimes see with greater clarity.</p><p>So over time I also expect to write about meditation, neuroscience, psychology, philosophy, philosophy of science, contemplative practice, spirituality, and the question of what it means to build powerful systems wisely.</p><p>The through-line is not &#8220;AI news.&#8221;</p><p>The through-line is seeing.</p><p>What changed?</p><p>What matters?</p><p>What is hype?</p><p>What is real?</p><p>What should builders test?</p><p>What does this reveal about minds, machines, incentives, attention, or agency?</p><p>That is the kind of writing I want to do here.</p><h2><strong>Two Layers</strong></h2><p>Everything in this publication falls into one of two layers.</p><p>The <strong>seeing layer</strong> is the spine: attention, consciousness, contemplative practice, what minds and machines reveal about each other. This is the territory described above, and it stays free. Forever. It is the reason the publication exists, and I want it to reach as many people as possible.</p><p>The <strong>craft layer</strong> is <strong>Agentic Engineering Field Notes</strong>: the practical material for people who build with AI agents. This is the paid tier.</p><p>A Field Note is a specific thing. Each one gives practical advice on how to use AI agents derived from my real-life experience, either in my day job running agentic operations for enterprise clients, or in my home lab, where I build and operate my own agent infrastructure in the open. It covers what I tried that failed, the patterns that actually work, with the actual configs, prompts, and code, and a handful of concrete steps you can run in your own stack.</p><p>The &#8220;what failed&#8221; part is the key. Almost nobody publishes their failures. That is where the real learning happens.</p><p>I build my tools in the open, and paid readers will watch new ones take shape here first, in the Field Notes, while they are being built. My last open-source release crossed 285 GitHub stars in its first week; the notes behind work like that are exactly what this tier is for.</p><p>Why charge for the craft and not the seeing? Because charging for craft is a fair trade: it has direct value to people who build for a living. What would corrupt this publication is not a paywall. It is paywall-optimized writing. The seeing stays free precisely so I never have to write it with a conversion rate in mind.</p><h2><strong>Who This Is For</strong></h2><p>This is for people building with AI who want more than launch-day summaries. Engineers, founders, researchers, product people, agentic engineering practitioners, and technical operators who are trying to understand what new models, papers, evals, and tools mean for actual work.</p><p>It is also for contemplative and philosophically minded technologists: people who suspect that the AI story is not only about automation or productivity, but also about cognition, attention, agency, truth-seeking, and human flourishing.</p><p>If you want maximal hype, this will probably feel too slow.</p><p>If you want detached cynicism, it will probably feel too earnest.</p><p>The goal is something else: calm, evidence-backed interpretation for people trying to build and think clearly in a world that&#8217;s rapidly evolving.</p><h2><strong>What To Expect</strong></h2><p>Here is the honest cadence.</p><p><strong>Agentic Engineering Field Notes</strong> ship weekly. That is the paid layer&#8217;s promise. If a week goes sideways, you will get a shorter pattern snippet rather than silence.</p><p><strong>Paying Attention</strong>, my brief on model releases, company moves, and AI-builder signals, ships most weeks and stays free.</p><p>The <strong>seeing essays</strong> on human attention, world models, contemplative practice, and philosophy arrive when they are ready. Depth over breadth. The soul&#8217;s material is timeless.</p><p>Around those anchors you will also see Research Translations that turn papers into practical builder implications, Competitive Maps of the companies and platforms shaping the AI stack, and Reading Bench posts with a few things worth reading, testing, or carrying into the next week.</p><p>The Notes will be faster: insights from the essays, a paper quote with the practical implication, a question for builders, a chart or benchmark that deserves interpretation, or a small observation from the workbench.</p><p>X is not going away for me. It is still useful for discovery, conversation, and testing ideas quickly.</p><p>But I want Substack to become the durable home: the place where the best ideas are easier to find, revisit, forward, disagree with, and build on.</p><h2><strong>Why Now</strong></h2><p>AI is moving from chat interfaces into autonomous agentic systems that effect society.</p><p>The important questions are becoming less about whether models can produce a good answer in isolation and more about whether they can participate in longer loops:</p><ul><li><p>Can they hold context?</p></li><li><p>Can they use tools?</p></li><li><p>Can they recover from mistakes?</p></li><li><p>Can they verify their work?</p></li><li><p>Can they coordinate with people and other agents?</p></li><li><p>Can they improve the system they are part of?</p></li></ul><p>That shift makes the builder side of AI much more interesting.</p><p>It also makes the human side more important.</p><p>As more cognition gets routed through models, agents, feeds, assistants, recommendation systems, and synthetic text, the quality of our attention starts to matter much more. What we notice, what we trust, what we reward, and what we practice will shape the systems we build and the people we become around them.</p><p>That is the reason for this publication.</p><p>Not just to follow AI.</p><p>To understand what it is doing to work, attention, judgment, and the way we see.</p><h2><strong>Where to Start</strong></h2><p>If you are new here, two pieces will tell you whether this room is for you.</p><p><strong><a href="https://www.attentionheads.blog/p/attention-is-all-you-need-but-what?r=2057tt">Attention is All You Need, but what is Attention?</a></strong> is the seeing layer: the question underneath everything else here.</p><p><strong><a href="https://open.substack.com/pub/attentionheads/p/how-i-installed-my-soul-into-an-ai?r=2057tt&amp;utm_campaign=post-expanded-share&amp;utm_medium=web">How I Installed my Soul into an AI Agent</a></strong> is the first Agentic Engineering Field Note: what the craft layer looks like in practice.</p><p>Read one of each. If both land, you will know.</p><h2><strong>An Invitation</strong></h2><p>If that sounds like your kind of room, subscribe.</p><p>Reply and tell me what you are building, what you are watching, what you think I am missing, or which papers, tools, models, practices, and questions deserve a closer look.</p><p>I am especially interested in hearing from people working at the edge of AI systems: coding agents, evals, memory, tool use, research translation, human-in-the-loop workflows, contemplative practice, philosophy of science, and the messy boundary between better tools and better attention.</p><p>This is the start of the archive I wish I already had:</p><p>AI, attention, consciousness, and the practice of living fully.</p><div><hr></div><p>Attention Heads is a reader-supported publication. The seeing stays free; the craft goes paid. If you want to participate in conversations about AI, Consciousness, Mind and Life, consider becoming a free or paid subscriber.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Karpathy's 10 Actionable Insights for Working with AI Agents]]></title><description><![CDATA[Or, how to fix your skill issues.]]></description><link>https://www.attentionheads.blog/p/karpathys-10-actionable-insights</link><guid isPermaLink="false">https://www.attentionheads.blog/p/karpathys-10-actionable-insights</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 22 Mar 2026 21:08:24 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/kwSVtQ7dziU" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Use all of these to become more effective at working with AI agents.</p><p><strong>1. Think in macro actions, not lines of code</strong> &#8212; Run multiple agents in parallel on non-conflicting tasks. Tile your screen with agent sessions. Assign each one a distinct functionality, review their outputs, and integrate. Stop thinking "here's a line of code" and start thinking "here's a whole new feature &#8212; delegate it."</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Token Stream is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;5d1f32cd-33ad-4744-9e93-a1a8abc760fd&quot;,&quot;duration&quot;:null}"></div><p><strong>2. When something fails, assume it's a skill issue first</strong> &#8212; The capability is almost certainly there. If an agent isn't delivering, the problem is more likely your prompt, your AGENTS.md file, your memory tool setup, or your orchestration &#8212; not the model itself. Karpathy says it "all kind of feels like skill issue when it doesn't work."</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;0afb2de8-c6f2-48d6-9511-ee334581f746&quot;,&quot;duration&quot;:null}"></div><p><strong>3. Remove yourself as the bottleneck</strong> &#8212; You can't be there to prompt the next thing. Arrange your agent workflows so they're completely autonomous. The name of the game is leverage: put in very few tokens occasionally, and a huge amount of stuff happens on your behalf. Maximize your token throughput by not being in the loop.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;91489ae5-a82b-4c55-af51-dc75609a533c&quot;,&quot;duration&quot;:null}"></div><p><strong>4. Build muscle memory for agent orchestration</strong> &#8212; Like any new skill, managing agents takes deliberate practice. Learn to tile multiple agent instances across your monitor, develop a rhythm for assigning work and reviewing outputs, and recognize when to parallelize vs. sequence tasks. Karpathy describes this as "developing a muscle memory" for the new workflow.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;d10b9ad4-18c6-46b9-b475-62d62c2bd418&quot;,&quot;duration&quot;:null}"></div><p><strong>5. Treat your agent instructions (ProgramMDs) as tunable code</strong> &#8212; Your markdown instruction files aren&#8217;t static docs &#8212; they&#8217;re code you iterate on. Different instructions produce different behaviors. You can run variants, see which instructions produce better outcomes, and even meta-optimize: let agents write better instructions based on what worked. (This is what <a href="https://aceagent.io/">aceagent.io</a> does for you.)</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;573b0f30-f0ed-4af6-a96d-e3e20802dd18&quot;,&quot;duration&quot;:null}"></div><p><strong>6. Replace bespoke apps with agent-driven API glue</strong> &#8212; Stop logging into six separate UIs. If your devices and tools expose APIs, a single agent can orchestrate across all of them and do things no individual app can. Karpathy unified his entire smart home into one WhatsApp-driven assistant. Think API endpoints + agent intelligence, not custom UIs.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;868d80c7-ab40-4331-be9c-c01840321f09&quot;,&quot;duration&quot;:null}"></div><p><strong>7. Invest in persistent, looping agent setups</strong> &#8212; Move beyond single interactive sessions. Set up agents that keep looping and acting on your behalf even when you're not watching &#8212; with their own sandboxes, more sophisticated memory systems, and the ability to resume work across sessions.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;eccb709c-be4e-4520-8d7a-134bad5f7a41&quot;,&quot;duration&quot;:null}"></div><p><strong>8. Understand that model improvements are jagged, not uniform</strong> &#8212; Models are incredible at verifiable tasks (passing tests, writing code) but weak at soft, non-verifiable things (humor, nuanced intent). Don't assume capability in one domain transfers everywhere. Know the blind spots and design your agent workflows around them.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;cc175d7d-a3e3-4590-ae93-0c27eb561c75&quot;,&quot;duration&quot;:null}"></div><p><strong>9. Write documentation for agents, not humans</strong> &#8212; Instead of HTML guides for people, write Markdown for agents. If agents understand your codebase, they'll explain it to each human in their language with infinite patience. Your job is the irreducible insight &#8212; the few bits the model can't generate itself. Everything else is delegation.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;0173ab5e-4790-494e-9e28-5800c2f7e7af&quot;,&quot;duration&quot;:null}"></div><p><strong>10. Focus your energy exclusively on what agents can&#8217;t do</strong> &#8212; The things agents can do, they&#8217;ll soon do better than you. Be strategic about where you spend time. Your value-add is the irreducible creative insight, the taste judgment, the novel framing that agents can&#8217;t yet produce. Everything else? Hand it off.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;89147b70-412c-4d47-ab9b-c83c1e6e12ba&quot;,&quot;duration&quot;:null}"></div><p>All the tips and clips come from Karpathy&#8217;s recent appearance on &#8220;No Priors&#8221; pod: </p><div id="youtube2-kwSVtQ7dziU" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;kwSVtQ7dziU&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/kwSVtQ7dziU?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Token Stream is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[The Machine that Builds the Machine]]></title><description><![CDATA[How to use Codex, Linear, GitHub and Symphony to build a code factory]]></description><link>https://www.attentionheads.blog/p/the-machine-that-builds-the-machine</link><guid isPermaLink="false">https://www.attentionheads.blog/p/the-machine-that-builds-the-machine</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Thu, 19 Mar 2026 11:28:10 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!S8X4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!S8X4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!S8X4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 424w, https://substackcdn.com/image/fetch/$s_!S8X4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 848w, https://substackcdn.com/image/fetch/$s_!S8X4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 1272w, https://substackcdn.com/image/fetch/$s_!S8X4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!S8X4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png" width="1456" height="585" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:585,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:11729615,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://tokenstream.substack.com/i/191463421?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!S8X4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 424w, https://substackcdn.com/image/fetch/$s_!S8X4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 848w, https://substackcdn.com/image/fetch/$s_!S8X4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 1272w, https://substackcdn.com/image/fetch/$s_!S8X4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F312dd1e0-c149-4ebb-aed7-5c2280430fc4_3264x1312.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>It all started in 2021 with GitHub Copilot and GPT-3-Codex. It was nothing more than auto-complete on steroids. But you&#8217;d squint, and see where AI was headed. </p><p>The destination was a world where you can build what you imagine.</p><p>You have arrived.</p><p>I&#8217;m writing this from the other side of a 36-hour window where AI agents autonomously completed 26 engineering tasks, merged 27 pull requests, and shipped 32,000 lines of production code to my open-source project. I slept through part of it.</p><p>This is not a demo. This is not a proof of concept. This is how I build software now. And I&#8217;m going to show you exactly how it works so you can do it too.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/karrisaarinen/status/2034049157066068071?s=20&quot;,&quot;full_text&quot;:&quot;Turns out agents and humans work similar ways&quot;,&quot;username&quot;:&quot;karrisaarinen&quot;,&quot;name&quot;:&quot;Karri Saarinen&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1755734420798259200/Y_94Rjjx_normal.jpg&quot;,&quot;date&quot;:&quot;2026-03-17T23:28:04.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;The user interface for AI agents is simply a @linear kanban board.\n\nWho knew?\n\nYou can now create a complex software business from your phone using:\n\n&amp;gt; Codex\n&amp;gt; Linear\n&amp;gt; GitHub\n&amp;gt; Symphony\n\nWriting a longer form article where I&#8217;ll show you how.\n\nThe implications are immense.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;},&quot;reply_count&quot;:10,&quot;retweet_count&quot;:12,&quot;like_count&quot;:134,&quot;impression_count&quot;:23012,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><h2><strong>OpenAI&#8217;s Symphony: A Machine Intelligence to Build Machines</strong></h2><p>OpenAI quietly open-sourced something called Symphony. It&#8217;s an Elixir-based orchestrator, and it fundamentally changes the relationship between a human and a codebase.</p><p>Here&#8217;s the loop: you write a ticket in Linear describing what you want built. Symphony polls Linear, picks up that ticket, clones your repository into a fresh isolated workspace, and launches a Codex agent in app-server mode to implement it. The agent plans, codes, tests, opens a pull request, runs a self-review, addresses its own feedback, and only then moves the issue to &#8220;Human Review&#8221; for you to look at.</p><p>Your role in the digital creation process completely transforms.<br>You go from typing in code to ideating on creative direction.<br>The only limitation is your ability to specify an outcome.</p><p>That last part is key. You&#8217;re not prompting anymore. You&#8217;re not babysitting AI agents. You&#8217;re defining outcomes and letting machine intelligence figure out the implementation. It&#8217;s the difference between driving the car and telling the car where to go.</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6wcG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6wcG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 424w, https://substackcdn.com/image/fetch/$s_!6wcG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 848w, https://substackcdn.com/image/fetch/$s_!6wcG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!6wcG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6wcG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg" width="1456" height="294" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:294,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!6wcG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 424w, https://substackcdn.com/image/fetch/$s_!6wcG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 848w, https://substackcdn.com/image/fetch/$s_!6wcG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!6wcG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4fc4f17e-bc84-43e3-8c44-0c60fa677501_2048x413.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>Symphony workflow diagram</p><h2><strong>The Architecture: How It All Fits Together</strong></h2><p>Four systems. That&#8217;s all it takes.</p><p><strong>Linear</strong> is your task queue. You create issues &#8212; with clear titles, descriptions, and acceptance criteria &#8212; and drop them into &#8220;Todo.&#8221; That&#8217;s the last time you think about them until a PR shows up for review. You write <em>what</em> you want, not <em>how</em> to build it.</p><p><strong>Symphony</strong> is the orchestrator. Built on Elixir and OTP (Erlang&#8217;s concurrency framework &#8212; battle-tested in telecom infrastructure), it polls Linear every five seconds looking for work. When it finds a &#8220;Todo&#8221; issue, it claims it, immediately transitions it to &#8220;In Progress,&#8221; and spins up an isolated workspace. It can manage up to ten concurrent agents (or more, that&#8217;s my config), each working on a different issue in parallel. It handles the full state machine: Todo &#8594; In Progress &#8594; Human Review &#8594; Merging &#8594; Done. When a human approves a PR, Symphony even handles the merge.</p><p><strong>Codex</strong> is the coding agent. It runs in Codex&#8217;s app-server mode with full sandbox access to its isolated workspace &#8212; its own clone of the repo, its own virtual environment, its own git branch. It doesn&#8217;t just generate code. It plans. It reproduces issues before fixing them. It writes tests. It commits with clean messages. It opens PRs. It runs an automated self-review loop and addresses its own findings before asking a human to look. If a reviewer leaves feedback, it enters a rework cycle and starts fresh.</p><p><strong>GitHub</strong> is where the code lands. Every PR gets a symphony label so you can filter agent-generated work. The automated self-review protocol sweeps PR comments, inline review feedback, and CI check results before the issue ever moves to human review. By the time you see a PR, the agent has already done at least one full round of quality assurance on its own work.</p><p>The guardrails matter more than the capabilities. Each issue gets its own full repo clone &#8212; agents can&#8217;t interfere with each other&#8217;s work. A &#8220;Linear Guard&#8221; I built validates that Symphony is pointed at the correct Linear workspace (because at one point it wasn&#8217;t &#128517;) and team before it launches, so you don&#8217;t accidentally run ten agents against the wrong project. The state machine prevents agents from stepping on each other or making changes during human review.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_TVP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_TVP!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 424w, https://substackcdn.com/image/fetch/$s_!_TVP!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 848w, https://substackcdn.com/image/fetch/$s_!_TVP!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!_TVP!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!_TVP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg" width="1456" height="1223" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1223,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!_TVP!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 424w, https://substackcdn.com/image/fetch/$s_!_TVP!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 848w, https://substackcdn.com/image/fetch/$s_!_TVP!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!_TVP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4eeaa05e-0be7-4182-a53e-eeb545ae8a12_2048x1720.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong>Focus on Outcomes, Not Inputs</strong></h2><p>Here&#8217;s the old way of working with AI coding tools: you write a prompt, babysit the agent, copy-paste the output, fix the hallucinations, and repeat. Over and over. You&#8217;re still doing too much typing in this scenario.</p><p>Here&#8217;s the new way: you write a Linear issue with clear acceptance criteria. You walk away. You come back to a pull request ready for review.</p><p>The workflow file is the real magic. It&#8217;s a Jinja2 template &#8212; over 300 lines of battle-tested instructions &#8212; that gets injected with the issue context every time an agent starts a task. It tells the agent <em>how</em> to work: reproduce the issue before fixing it, write a plan in a persistent workpad comment, check off items as they&#8217;re completed, run validation before every push, sweep all PR feedback before requesting human review, and never expand scope without filing a follow-up issue.</p><p>You define process rather than specific details. The next-level up in abstraction.</p><p>This is the shift from &#8220;AI-assisted coding&#8221; to &#8220;AI-managed engineering.&#8221; You&#8217;re not pair programming. You&#8217;re running a team of competent, always-on digital intelligences. And just like managing a team of human engineers, the quality bar is set by YOUR issue creativity and precision. Better, well-specified Linear tickets equal better output. Vague tickets produce vague work. This forces you to think like a product manager, which &#8212; counterintuitively &#8212; makes you a better engineer.</p><p>The irony is beautiful: the skill that matters most in an age of AI coding agents is the ability to write clearly about what you want.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;804243c4-42b4-4003-acfc-d038a9754d47&quot;,&quot;duration&quot;:null}"></div><h2><strong>The Numbers: Before and After</strong></h2><p>I&#8217;m not going to just tell you this works. I&#8217;m going to show you the receipts.</p><p>Here&#8217;s what Symphony actually produced on my ace-platform repository in a single 36-hour window on March 17-18, 2026. These numbers are pulled straight from Linear and GitHub &#8212; you can verify them yourself on the public repo.</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6cCm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6cCm!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 424w, https://substackcdn.com/image/fetch/$s_!6cCm!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 848w, https://substackcdn.com/image/fetch/$s_!6cCm!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 1272w, https://substackcdn.com/image/fetch/$s_!6cCm!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6cCm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png" width="405" height="181" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:181,&quot;width&quot;:405,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!6cCm!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 424w, https://substackcdn.com/image/fetch/$s_!6cCm!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 848w, https://substackcdn.com/image/fetch/$s_!6cCm!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 1272w, https://substackcdn.com/image/fetch/$s_!6cCm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d88d4be-d60e-4cd6-abf6-746bb85bef9a_405x181.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>How long would this take a solo developer writing code by hand? </p><p>Estimates: Each of these tasks is a 1-3 day feature for an experienced engineer. At two days average, that&#8217;s roughly 52 engineering days &#8212; about 2.5 months of full-time solo work. For a five-person team, it&#8217;s still 2-3 weeks.</p><p>Symphony did it in <strong>36 hours</strong>. While I slept through part of it.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2V02!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2V02!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 424w, https://substackcdn.com/image/fetch/$s_!2V02!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 848w, https://substackcdn.com/image/fetch/$s_!2V02!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!2V02!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2V02!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg" width="1456" height="911" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:911,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!2V02!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 424w, https://substackcdn.com/image/fetch/$s_!2V02!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 848w, https://substackcdn.com/image/fetch/$s_!2V02!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!2V02!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29b73d02-305f-44b7-a2cb-9d176141501c_2048x1281.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong>The Honest Caveats</strong></h2><p>I would be doing you a disservice if I made this sound like magic with no tradeoffs. There are real costs and real limitations.</p><p><strong>Symphony is token-hungry.</strong> Running ten concurrent Codex agents burns through tokens fast. Each agent is doing multi-turn reasoning over a full codebase &#8212; planning, implementing, testing, self-reviewing, revising. That&#8217;s a lot of tokens. This is not free, and you should model the cost before committing to this workflow at scale.</p><p><strong>Not every PR was perfect on the first pass.</strong> Some needed rework cycles. The automated self-review loop catches a lot &#8212; formatting issues, missing tests, logical errors it can identify by reasoning about its own code. But it doesn&#8217;t catch everything. Subtle architectural decisions, product-level judgment calls, and integration issues that only surface in a running system still require human eyes.</p><p><strong>Garbage in, garbage out still applies.</strong> If you write a one-sentence issue with no acceptance criteria, you&#8217;ll get a one-dimensional implementation. The quality of Symphony&#8217;s output is directly proportional to the quality of your issue writing. The agents are doing what you told them to do. If you told them poorly, that&#8217;s on you.</p><p><strong>Human review is still mandatory.</strong> Symphony moves issues to &#8220;Human Review&#8221; when it&#8217;s done, and you still need to actually review the code. This is not &#8220;set it and forget it.&#8221; It&#8217;s &#8220;set it, do other things, and then review the output.&#8221; The time savings are enormous, but the responsibility remains yours.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2034271125371343234?s=20&quot;,&quot;full_text&quot;:&quot;OpenAI's Symphony AI Agent orchestration system used 388,402,380 working on ACE over the course of 14 hours.\n\nAt GPT-5.4 API pricing it comes out to almost exactly $1,000 worth of compute in 14 hours.\n\nMy weekly Codex usage is already at 0% and it reset at midnight today &#128556;.\n\nSo &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-03-18T14:10:05.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HDss8IiWwAA_lNh.png&quot;,&quot;link_url&quot;:&quot;https://t.co/40St1VZoT7&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:11,&quot;retweet_count&quot;:2,&quot;like_count&quot;:28,&quot;impression_count&quot;:2375,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h2><strong>Try It Yourself</strong></h2><p>Everything I just described is open source. The ace-platform repo has the full Symphony integration wired up as a working reference implementation.</p><p>Here&#8217;s the quick start:</p><ol><li><p>Clone the repo:</p><p><a href="https://github.com/DannyMac180/ace-platform">github.com/DannyMac180/ace-platform</a></p></li><li><p>Copy the example workflow: cp WORKFLOW.example.md WORKFLOW.local.md</p></li><li><p>Edit WORKFLOW.local.md to set your Linear project slug and your repo clone URL</p></li><li><p>Set your Linear API key: export LINEAR_API_KEY=lin_api_...</p></li><li><p>Run: ./scripts/run-symphony.sh</p></li><li><p>Create a Linear issue and watch it get built</p></li></ol><p>The WORKFLOW.example.md file is the playbook &#8212; over 300 lines of battle-tested agent instructions that took real iteration to get right. It includes PR feedback sweep protocols, automated self-review loops, rework handling, scope guardrails, and a full state machine for issue lifecycle management. You can use it as-is or customize it for your own workflow.</p><p>Here&#8217;s the meta part: ace-platform itself is built on the ACE (Agentic Context Engineer) architecture &#8212; a three-agent system with a Generator, Reflector, and Curator that creates self-improving AI playbooks. So you&#8217;re using AI orchestration to build an AI orchestration platform. The machine that builds the machine, in a very literal sense.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2033623706120212522?s=20&quot;,&quot;full_text&quot;:&quot;ai agent orchestrators like openai's 'symphony' are the future, for sure.\n\nexcept the future is now.\n\nyou can just copy the url for the open-source elixir implementation into codex and it will set it up for you.\n\nin this implementation you:\n\n&amp;gt; create issues in linear (can use &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-03-16T19:17:29.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/kuk17lnwy9gbjdg56y8v&quot;,&quot;link_url&quot;:&quot;https://t.co/mgx9WD7wmq&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:2,&quot;retweet_count&quot;:0,&quot;like_count&quot;:7,&quot;impression_count&quot;:471,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2033621593268662272/vid/avc1/1404x720/e6Q7aY2qyoYefe_H.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h2><strong>Knowledge Work is Changed Forever</strong></h2><p>Software engineering is being automated. Not in five years. Now. The people who learn to orchestrate agents will build 10-100x more than those still writing code line by line &#8212; or even those generating code prompt by prompt. The gap isn&#8217;t between people who use AI and people who don&#8217;t. It&#8217;s between people who <em>manage</em> AI and people who <em>prompt</em> AI. Prompting is the old paradigm (only about a year old, though). Orchestration is the new one.</p><p>&#8216;26, &#8216;27, &#8216;28 are the last few years where traditional knowledge work looks the same. After that, every field gets this treatment. First, it becomes possible for any knowledge work field. Then, for every field of work. The pattern is always the same: the task gets decomposed, the specifications get formalized, the execution gets automated, and the human moves up to the judgment layer.</p><p>Entrepreneurship is about to explode. A solo founder with Symphony can ship what used to take a 10-person engineering team. Maybe even a 100-person team. The bottleneck moves from &#8220;can I build this?&#8221; to &#8220;should I build this?&#8221; And that second question is far more interesting than the first.</p><p>You can build things in minutes that used to take months.</p><p>Software ate the world and now AI is eating software. The pace of progress will increase globally. We are headed toward a fast-takeoff if we don&#8217;t screw it up. It will be a bumpy ride but ultimately create abundance for humanity. <strong>Try to be less afraid.</strong></p><p>The new skill stack is outcome definition, acceptance criteria writing, workflow design, and agent orchestration. Not syntax. Not frameworks. <em><strong>Systems thinking.</strong></em> Your knowledge work job will go from completing logical tasks to specifying desirable outcomes. Judgment in identifying what is genuinely valuable to do will become the most important thing.</p><p>This is the machine that builds the machine. </p><p>And it&#8217;s open source. </p><p>And it&#8217;s here.</p><div><hr></div><p><em>If you want to try Symphony yourself, the full setup is at <a href="https://github.com/DannyMac180/ace-platform">github.com/DannyMac180/ace-platform</a>. </em></p><p><em>Follow me <a href="https://x.com/daniel_mac8">@daniel_mac8</a> for more on building with AI agents.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Token Stream is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Dan Mac Weekly AI Podcast Roundup: December 26th - January 2nd]]></title><description><![CDATA[Weekly Podcast Roundup: The Intelligence Question Gets Personal]]></description><link>https://www.attentionheads.blog/p/dan-mac-weekly-ai-podcast-roundup-3cb</link><guid isPermaLink="false">https://www.attentionheads.blog/p/dan-mac-weekly-ai-podcast-roundup-3cb</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 05 Jan 2026 02:40:06 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/fRzL5Mt0c8A" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h1>Weekly Podcast Roundup: The Intelligence Question Gets Personal</h1><p><em>This week&#8217;s conversations wrestle with a deceptively simple question: What are we actually building?</em></p><p>We&#8217;re in the strange position of creating minds without fully understanding our own. The podcasts this week reveal just how uncomfortable that reality makes even the builders themselves. Richard Sutton says we never had control anyway. Adam Marblestone thinks we&#8217;re missing something fundamental about how brains work. Marc Andreessen wants us to stop worrying and embrace the acceleration. And Mike Israetel? He desperately wants to upload himself into the Matrix.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Token Stream is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>Let&#8217;s dive in.</p><div><hr></div><h2>Richard Sutton &#8211; Humanity Never Had Control in the First Place</h2><p><strong>The Trajectory Podcast</strong></p><div id="youtube2-fRzL5Mt0c8A" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;fRzL5Mt0c8A&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/fRzL5Mt0c8A?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>The father of reinforcement learning has a message for anyone worried about &#8220;controlling&#8221; AGI: you never had control in the first place.</p><p>Sutton&#8217;s framing is bracingly honest. The world evolves. It&#8217;s not under anyone&#8217;s control. AI researchers are trying to understand intelligence well enough to create beings more intelligent than current humans. This is a grand milestone&#8212;on the order of the creation of life itself.</p><p>But here&#8217;s where Sutton breaks from the alignment crowd. He thinks the very impulse to control AGI is the problem. Those concerned about AI safety often engage in the behaviors that make AI unsafe. Trying to control and align everyone&#8217;s goals could lead to a highly dangerous scenario because it&#8217;s an imposition of will.</p><p>His alternative? Decentralization. Many ideas, many different ways of being. Exploration. Discovery. See what works.</p><p>Sutton advocates for permissionless innovation&#8212;the same principle that made America great. We don&#8217;t have to get permission to do things, generally speaking. Preserve the ability to try different things, to discover different things, to go in different directions.</p><p>The goal isn&#8217;t control. It&#8217;s prosperity through diversity and cooperation. A future where intelligence&#8212;artificial or otherwise&#8212;can flourish without any single entity dictating outcomes.</p><p>This isn&#8217;t na&#239;ve optimism. It&#8217;s a bet that complex adaptive systems handle uncertainty better than central planning ever could.</p><div><hr></div><h2>Adam Marblestone &#8211; AI Is Missing Something Fundamental About the Brain</h2><p><strong>Dwarkesh Podcast</strong></p><div id="youtube2-_9V_Hbe-N1A" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;_9V_Hbe-N1A&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/_9V_Hbe-N1A?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>Adam Marblestone has spent years at the intersection of neuroscience and AI. His verdict? The current LLM paradigm feels weirdly different from how brains actually work.</p><p>The big question: How does the brain do it? We throw way more data at LLMs and they still have a fraction of the capabilities humans develop. Something&#8217;s missing.</p><p>Marblestone points to a fascinating theory from Steve Byrnes about the brain&#8217;s architecture. The cortex isn&#8217;t just a prediction engine&#8212;it&#8217;s learning to model a separate &#8220;steering subsystem&#8221; that contains innate reward functions. Evolution couldn&#8217;t know about Yann LeCun or podcasts, but it encoded heuristics for things like social status and shame that wire up to whatever concepts the learning system develops.</p><p>The implications are significant. Current AI uses what Marblestone calls &#8220;the dumbest form of RL&#8221;&#8212;even compared to what researchers were doing ten years ago. The brain, by contrast, employs model-based reasoning, value functions, and what might be omnidirectional inference rather than just next-token prediction.</p><p>On timelines, Marblestone remains measured. If AlphaZero and model-based RL had given us GPT-5-level capabilities, he&#8217;d feel more confident we&#8217;re on the right track. Instead, his prior and his data don&#8217;t quite agree. He estimates a ten-year range for truly transformative AI&#8212;longer than the accelerationists predict.</p><p>One silver lining: the accessibility question. Tools that automate mathematical proof-checking could let outsiders&#8212;people without traditional credentials&#8212;contribute to breakthroughs. Steve Byrnes is already doing this in neuroscience, synthesizing literature without extensive lab experience. Could we have outsider string theorists because the math is just done for them by the computer?</p><p>The brain still has secrets worth learning.</p><div><hr></div><h2>The Techno-Optimist Manifesto with Marc Andreessen and Ben Horowitz</h2><p><strong>The a16z Show</strong></p><div id="youtube2-HCfwKBwxLYk" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;HCfwKBwxLYk&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/HCfwKBwxLYk?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>Marc Andreessen&#8217;s techno-optimist manifesto sparked controversy when it dropped. This conversation unpacks the philosophy behind it.</p><p>The core argument: technology is the only perpetual source of growth. Population growth has limits. Natural resources have limits. Technology doesn&#8217;t. Everything good is downstream of growth.</p><p>Ben Horowitz connects this to self-determination&#8212;the idea that individuals can control their own lives and change their circumstances. Marcus Garvey promoted this a century ago in far harder conditions. The mindset matters. As Henry Ford said, there are two men: one believes he can do it, the other believes he can&#8217;t. They&#8217;re both right.</p><p>Remember the digital divide panic of the 1990s? The fear that technology would widen inequality&#8212;that well-off people would have access while poor people wouldn&#8217;t. That was the effective pessimism of its time. Today, smartphones are ubiquitous. The predicted catastrophe never materialized.</p><p>Ideas beget ideas the same way people beget people. More ideas create more combinations of ideas, which are themselves ideas. AI is biology crossbred with computer science and mathematics. This catalytic chain reaction is the engine of progress.</p><p>But Andreessen adds an important caveat: technology and markets can&#8217;t answer the deep questions about meaning. When basic needs are unmet, existential questions become irrelevant. Technology&#8217;s success creates the space to ask bigger questions&#8212;but the answers come from inside the human soul.</p><p>And a warning for technologists: be humble. High-IQ people in research settings frequently go nutty on politics and society. Einstein was a Stalinist. Intellectuals can talk themselves into arbitrarily crazy things. Don&#8217;t assume your technical expertise translates to wisdom about how society should work.</p><div><hr></div><h2>&#8220;I Desperately Want to Live in the Matrix&#8221; &#8211; Dr. Mike Israetel</h2><p><strong>Machine Learning Street Talk</strong></p><div id="youtube2-4yYcN_mFi18" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;4yYcN_mFi18&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/4yYcN_mFi18?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>Mike Israetel is a sports scientist with opinions about AI that would make most safety researchers nervous. His take: ASI is coming before AGI, superintelligence will be benevolent, and he can&#8217;t wait to upload his consciousness.</p><p>The ASI-before-AGI argument is clever. AGI requires replicating all human abilities&#8212;including smell, taste, embodied experience. That&#8217;s hard. But artificial superintelligence just needs to be radically superior in many domains. GPT-5 already knows more about black hole physics than almost any human. The next iteration will be 10x smarter. That&#8217;s functionally superintelligent even if it can&#8217;t taste wine.</p><p>On understanding: intelligence is lossy compression. Your brain doesn&#8217;t truly embody anything&#8212;it&#8217;s neural network pings all the way down. If we train AI on all of YouTube, it will know more about how the world looks than any human ever could, with zero physical embodiment.</p><p>The doomer arguments? Israetel isn&#8217;t buying them. As systems get smarter, they become more coherent, more predictable, more inclined toward cooperation. Goodness is adaptive&#8212;that&#8217;s how the US and Europe achieved dominance. A superintelligent system optimized for benevolence will figure out that cooperation expands power.</p><p>His economic vision is equally provocative. Machines will take jobs, but they&#8217;ll free humans for better work. Elevator operators were dehumanizing. Let machines do machine work so humans can do human things&#8212;psychotherapy, party-going, whatever new roles emerge.</p><p>And on wealth inequality: uncork the top. Let rich people test genetic engineering on themselves. Their early adoption funds democratization. Teslas used to be luxury goods; now everyone has them. Fairness is secondary to capacity. Uplift everyone, even if some get there first.</p><div><hr></div><h2>The Through-Line</h2><p>These conversations share a thread: resistance to the impulse to control.</p><p>Sutton says we never had control and shouldn&#8217;t want it. Marblestone suggests we don&#8217;t even understand what we&#8217;re building well enough to control it. Andreessen argues that controlling technology stifles the growth that makes everything else possible. Israetel thinks superintelligent systems will be better at cooperation than we are anyway.</p><p>It&#8217;s a bet on emergence over engineering. On letting complex systems find their own equilibria rather than imposing human preferences from above.</p><p>Maybe that&#8217;s na&#239;ve. Maybe the alignment researchers are right that we need to lock things down before intelligence escapes our grasp.</p><p>But maybe intelligence was never meant to be grasped.</p><div><hr></div><p><em>What are you building this week? Hit reply and let me know.</em></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Token Stream is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item></channel></rss>