<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Attention Heads]]></title><description><![CDATA[Attention Heads: what’s worth paying attention to as machine intelligence becomes abundant and human attention grows scarce.]]></description><link>https://www.attentionheads.blog</link><image><url>https://substackcdn.com/image/fetch/$s_!L8kc!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f566ff0-5947-4ad0-b8d9-24bfa2a57f43_1254x1254.png</url><title>Attention Heads</title><link>https://www.attentionheads.blog</link></image><generator>Substack</generator><lastBuildDate>Thu, 15 Oct 2026 08:55:39 GMT</lastBuildDate><atom:link href="https://www.attentionheads.blog/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Daniel McAteer]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[attentionheads@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[attentionheads@substack.com]]></itunes:email><itunes:name><![CDATA[Dan McAteer]]></itunes:name></itunes:owner><itunes:author><![CDATA[Dan McAteer]]></itunes:author><googleplay:owner><![CDATA[attentionheads@substack.com]]></googleplay:owner><googleplay:email><![CDATA[attentionheads@substack.com]]></googleplay:email><googleplay:author><![CDATA[Dan McAteer]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Can ChatGPT ‘Dot’ Help You Follow Through?]]></title><description><![CDATA[Experiments with OpenAI&#8217;s new proactive personal AI assistant]]></description><link>https://www.attentionheads.blog/p/can-chatgpt-dot-help-you-follow-through</link><guid isPermaLink="false">https://www.attentionheads.blog/p/can-chatgpt-dot-help-you-follow-through</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Thu, 01 Oct 2026 19:39:18 GMT</pubDate><enclosure url="https://api.substack.com/feed/podcast/218396816/a0a9840ea4f46938b92b32f09c84ba09.mp3" length="0" type="audio/mpeg"/><content:encoded><![CDATA[<p>I&#8217;ve been experimenting with how a personal AI assistant could help me follow through on the things I care about. That means giving it some understanding of my goals, my preferences, and the direction I want my life to go.</p><p>In this video, I ask my dot, Shaine, to start a ChatGPT thread and use my personal notes in Obsidian to propose a life vision document. The idea is to give us something we can refer back to as we work together.</p><p>Along the way, I discover something I hadn&#8217;t realized it could do: my dot sends additional context into the thread while it&#8217;s still working. You can see the moment I notice it in the recording.</p><p>The document itself also surprised me. It drew on journal entries from 2024 and reminded me how much progress I&#8217;d made on things that mattered to me. When you&#8217;re always thinking about the next milestone, it can be easy to lose sight of that.</p><p>I read through the proposal and made some edits. Then I asked how we could use it to guide our ongoing work together. I also raised a question about whether computer history could help identify when my time and attention drift away from my priorities. That access wasn&#8217;t confirmed in this recording.</p><p>This is an early experiment. Whether it helps me follow through over time is still an open question. But the reflection alone felt worthwhile, and it&#8217;s a direction I want to keep exploring.</p><p>What would you want a personal AI assistant to understand about you before asking it to help with your goals?</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Jev: A System One AI Primitive]]></title><description><![CDATA[Drawing on TypeSafe&#8217;s documentation and my own and others&#8217; experiments, I&#8217;ll explain how Jev works, how builders are combining it with LLMs, and a test to decide if you can use it in your application.]]></description><link>https://www.attentionheads.blog/p/jev-a-system-one-ai-primitive</link><guid isPermaLink="false">https://www.attentionheads.blog/p/jev-a-system-one-ai-primitive</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 23 Sep 2026 11:14:47 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Su_A!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>Jev is a new, ultra-fast, ultra-cheap &#8220;</span><a href="https://docs.typesafe.ai/introduction"><span>System one</span></a><span>&#8220; model from </span><a href="https://x.com/CompleteSkeptic"><span>Diogo Almeida</span></a><span> and his team at </span><a href="https://typesafe.ai/"><span>TypeSafe</span></a><span>. Response times range from 70-500 milliseconds. One million input tokens cost $0.042 and output tokens are free. Almeida was previously at OpenAI, where he was a co-author on the </span><a href="https://arxiv.org/pdf/2203.02155"><span>InstructGPT paper</span></a><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Su_A!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Su_A!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 424w, https://substackcdn.com/image/fetch/$s_!Su_A!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 848w, https://substackcdn.com/image/fetch/$s_!Su_A!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 1272w, https://substackcdn.com/image/fetch/$s_!Su_A!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Su_A!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png" width="1456" height="1044" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1044,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Su_A!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 424w, https://substackcdn.com/image/fetch/$s_!Su_A!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 848w, https://substackcdn.com/image/fetch/$s_!Su_A!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 1272w, https://substackcdn.com/image/fetch/$s_!Su_A!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02668a26-860b-48ef-aeee-ccd645d1da6d_2048x1468.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Jev is a new way to apply AI and </span><strong><span>a new primitive</span></strong><span> to build with.</span></p><p><span>It&#8217;s totally different from working with LLMs or chat-based models, in that you </span><strong><span>don&#8217;t chat with it</span></strong><span>. You give it a decision to make, and it produces a probability over a set of options, predicting which option has the highest probability of being correct.</span></p><p><span>I spoke to an AI engineer friend. He clearly saw the potential of Jev, but he told me that he&#8217;s having a hard time wrapping his head around what it actually is, how it works, and what you can do with this new primitive.</span></p><p><span>Jev shines inside a program where it can make </span><strong><span>bounded judgments</span></strong><span>. You supply the context and possible outcomes, while code and LLMs handle the surrounding work. Your challenge as an engineer is </span><strong><span>deciding which judgments Jev should make</span></strong><span>.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h3><strong><span>What Jev is</span></strong></h3><p><span>Working with Jev starts with two things: the information it needs to evaluate, and the questions you want answered. TypeSafe calls that information </span><strong><span>the &#8220;state.&#8221;</span></strong><span> It might be a customer&#8217;s email, a document, or a description of what&#8217;s happening inside an application.</span></p><p><span>Your inputs are: the state, and a question about that state.</span></p><p><span>You define each question using one of three types. </span><strong><span>Choice</span></strong><span> selects from a list of options you provide. </span><strong><span>Score</span></strong><span> rates something against a rubric. </span><strong><span>Noul</span></strong><span> returns a probability that a statement is true, or TypeSafe&#8217;s version of a boolean.</span></p><p><span>For example, you could give Jev a support ticket and ask which team should handle it, how urgent it is, and whether the customer is requesting a refund. You ask three separate questions about the same state, and Jev attempts to answer them for you.</span></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/MatijaSosic/status/2100190746389135772&quot;,&quot;full_text&quot;:&quot;Here's a 45-second TL;DR on Jev.\n\nI find the core idea beautifully simple, but the video made it really hard to understand.\n\nHope you find it helpful.&quot;,&quot;username&quot;:&quot;MatijaSosic&quot;,&quot;name&quot;:&quot;Matija Sosic&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/785535252471087104/n9o-i4Uv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-16T11:51:08.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!m90X!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2100190298521337856.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/KtSKlEMVL3&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI?\n\nI&#8217;ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev\n\n&#8226; 20-200x faster\n&#8226; 40-400x&quot;,&quot;username&quot;:&quot;CompleteSkeptic&quot;,&quot;name&quot;:&quot;Diogo Almeida&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1650708125685800960/7k6r0UZg_normal.jpg&quot;},&quot;reply_count&quot;:236,&quot;retweet_count&quot;:718,&quot;like_count&quot;:9690,&quot;impression_count&quot;:1715462,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2100190298521337856/vid/avc1/1280x720/xoD1YHZB4bBPciYn.mp4&quot;,&quot;video_preview_media_key&quot;:&quot;13_2100190298521337856&quot;,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><span>Your outputs are: </span><strong><span>structured values and probabilities your software can use</span></strong><span>. Jev doesn&#8217;t generate a written explanation. You decide what happens with the structured output: route the ticket, flag it for review, or pass it to an LLM that writes a response.</span></p><p><a href="https://docs.typesafe.ai/introduction"><span>According to TypeSafe</span></a><span>, Jev </span><strong><span>evaluates the questions independently and in parallel</span></strong><span>, rather than generating its answers token by token. If one decision depends on another, the surrounding code needs to handle that dependency.</span></p><p><span>TypeSafe calls their approach to training Jev </span><strong><span>Reinforcement Learning for Calibrated Decisions</span></strong><span>, or RLCD. The goal is for the probabilities to reflect how often an outcome actually occurs: across many predictions assigned an 80% probability, roughly 80% should turn out to be true. That describes calibration across predictions, not a guarantee that any individual answer is correct.</span></p><p><span>TypeSafe bets that &#8220;AI automation will be closer to 99% machine-to-machine interaction and 1% human interaction.&#8221; What that means to me is that Jev is an AI model built first to be used by computers, within programs, and us humans only need to get involved with the last mile. We are the beneficiaries of the output of Jev.</span></p><h3><strong><span>Isn&#8217;t Jev just a classifier?</span></strong></h3><p><span>One reaction to Jev&#8217;s launch was: haven&#8217;t we had classifiers for years? We have. Choosing a category or assigning a score is by no-means a new task in machine learning. Calling Jev a new primitive doesn&#8217;t, by itself, explain why this new model resonates.</span></p><p><span>The reason it resonates is </span><strong><span>the work it bakes into training for you</span></strong><span>. One commentator on X, Matija Sosic, </span><a href="https://x.com/MatijaSosic/status/2100504313797784027"><span>made the point</span></a><span> that Jev accepts unstructured text and doesn&#8217;t require users to train a classifier for each use case. He said it&#8217;s combining the best of both worlds from classifiers and LLMs. </span><a href="https://x.com/kinglycrow/status/2100394875120459973"><span>Ian Butler made a related point:</span></a><span> he wanted something he could drop into an application, without first having to train it himself.</span></p><p><strong><span>Yes, Jev is a classifier, but it&#8217;s not &#8220;just&#8221; a classifier.</span></strong><span> With Jev, you describe the judgment you need and define the possible outcomes. There is still work involved: choosing the right context or &#8220;state&#8221;, writing clear criteria, testing the predictions, and deciding what your software should do with them. But that starting point is further down the road than starting by building a task-specific classifier.</span></p><p><span>As a builder, all I want to know is: </span><strong><span>does Jev make it easier to build useful products faster, at a lower cost?</span></strong><span> Even if it&#8217;s not a completely new paradigm, losing myself in a philosophical debate is beside the point.</span></p><p><span>You could call the internal combustion engine &#8220;just another engine.&#8221; We already had steam engines. That&#8217;s true at the level of categories, but it misses the more interesting question: what does the new engine make possible? That&#8217;s the question I want to ask about Jev.</span></p><h3><strong><span>Jev and LLMs: both/and</span></strong></h3><p><span>It&#8217;s human nature to jump to a binary conclusion: Jev or an LLM? It&#8217;s wise to resist that temptation. As AI engineers, the question is how we compose the primitives we have access to into something that solves a problem that is valuable to yourself and others.</span></p><p><span>Thinking in terms of either/or can narrow our choices before we&#8217;ve even understood our goal and vision for building. We have a growing set of tools at our disposal, and choosing one doesn&#8217;t mean we have to give up the others.</span></p><p><span>That&#8217;s how I think about Jev: </span><strong><span>as another primitive to work with.</span></strong><span> The wiser question is where it fits in the system we&#8217;re building, and </span><strong><span>how it can work alongside existing models and tools</span></strong><span> to make the whole system better.</span></p><p><span>Gregor Zunic&#8217;s </span><a href="https://x.com/gregpr07/status/2100411066966749359"><span>browser-agent demo</span></a><span> is one great example. In his description, the agent gives Jev the browser&#8217;s DOM state and a new set of possible actions at each step, with a small LLM fallback for typing. The models have different jobs within the same workflow. Jev handles the constrained choices, while the LLM supplies text when needed.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Ysk9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Ysk9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 424w, https://substackcdn.com/image/fetch/$s_!Ysk9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 848w, https://substackcdn.com/image/fetch/$s_!Ysk9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 1272w, https://substackcdn.com/image/fetch/$s_!Ysk9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Ysk9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png" width="1456" height="1068" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1068,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Ysk9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 424w, https://substackcdn.com/image/fetch/$s_!Ysk9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 848w, https://substackcdn.com/image/fetch/$s_!Ysk9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 1272w, https://substackcdn.com/image/fetch/$s_!Ysk9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf5db04f-5f71-4366-afe5-107f1d385440_2048x1502.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><span>Simplified workflow based on Gregor&#8217;s linked implementation.</span></em></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/gregpr07/status/2100411066966749359&quot;,&quot;full_text&quot;:&quot;Breaking: Browser Use + Jev = Ultrafast &#9889;\n\nFindings flights took 7s and cost only $0.0039 &#129327;\n\n&amp;gt; new action space every step\n&amp;gt; DOM state space\n&amp;gt; small LLM fallback to type\n\n(this video is at 1x speed btw)\n\nBuilt a tiny open source browser agent. try it below &#8595; &quot;,&quot;username&quot;:&quot;gregpr07&quot;,&quot;name&quot;:&quot;Gregor Zunic&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1980037752797175809/cTfw6IDz_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-17T02:26:36.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!Qn-8!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2100410607807918080.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/AplCBRYC5o&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:285,&quot;retweet_count&quot;:650,&quot;like_count&quot;:9048,&quot;impression_count&quot;:3154864,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2100410607807918080/vid/avc1/1104x720/f_PXXWdzPa6jIBUz.mp4&quot;,&quot;video_preview_media_key&quot;:&quot;13_2100410607807918080&quot;,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><span>Gregor reports that his flight-finding demo took seven seconds and cost $0.0039. What I love about this example is that it shows how you can use Jev classifiers in partnership with LLMs.</span></p><p><span>I ran a small experiment of my own along these lines: </span><a href="https://x.com/daniel_mac8/status/2100335929273524541"><span>Jev playing Pac-Man, steered by Astra</span></a><span>. Astra, the larger reasoning model, writes a strategy for Pac-Man to follow. Jev reads the game state directly from the browser and chooses each move in milliseconds, based on that strategy. As the game plays out, Astra takes feedback from the game and updates the strategy in real time, and Jev keeps executing the latest version.</span></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2100335929273524541&quot;,&quot;full_text&quot;:&quot;'Jev' plays Pac-Man steered by Astra.\n\n1. Astra strategizes\n2. 'Jev' carries out the strategy in milliseconds\n\nIt's early and hard to wrap my head around, but the potential is there to combine 'Jev' with larger reasoning models.\n\nFor sure. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-16T21:28:02.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!CnWu!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2100335842451492864.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/sz2dHuheIa&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:45,&quot;retweet_count&quot;:76,&quot;like_count&quot;:888,&quot;impression_count&quot;:91583,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2100335842451492864/vid/avc1/1114x720/r0zLyCVG0-FFLayC.mp4&quot;,&quot;video_preview_media_key&quot;:&quot;13_2100335842451492864&quot;,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><span>One reply described it as Astra being the brain and Jev being the body, and that&#8217;s pretty much exactly it. Where Gregor&#8217;s agent calls on an LLM for the text Jev can&#8217;t produce, here the LLM sits above Jev doing the slow thinking while Jev does the fast acting. The whole thing took about 20 minutes to build in Codex.</span></p><h3><strong><span>Where Jev fits in your workflow</span></strong></h3><p><span>Jev fits when you have </span><strong><span>a bounded set of potential decisions</span></strong><span>, like the four directions Pac-Man can move in my experiment above. You can enumerate the allowable actions or judgments, provide the relevant context, and make a decision without long chains of thought. The bounded set defines the interface to the problem; </span><strong><span>it does not mean that the right choice is guaranteed</span></strong><span>. It&#8217;s still a probabilistic model with a pre-determined set of outputs.</span></p><p><span>An apt analogy is choosing a move from a playbook rather than inventing a play in the middle of the game. The possible moves are already available. Jev&#8217;s job is to identify which one fits the situation, quickly and cheaply, so the surrounding system can act on it.</span></p><p><span>You are </span><strong><span>trading possibilities and open-endedness for fast, efficient execution</span></strong><span>. Constraining the answer space gives you speed, repeatability, and testability where an open-ended LLM does not. That is why Jev works inside </span><strong><span>a designed workflow</span></strong><span> rather than as an open-ended thinker. </span><strong><span>Jev is a focused cognitive executor. </span></strong><span>It attempts to select the likely correct decision based on the state surrounding it, which your program can then execute.</span></p><p><span>Some of the most impressive Jev demonstrations I&#8217;ve seen are browser-use demos: the model operates a web app at high speed. You would not necessarily use Jev to create a new web app. But once the app exists and you know what you are trying to accomplish within it, Jev can help operate it by choosing among the actions that are available. That makes browsers use a compelling illustration of where Jev fits.</span></p><h3><strong><span>Tradeoffs and limits</span></strong></h3><p><span>A constrained set of answers doesn&#8217;t make every decision a good fit for Jev. TypeSafe is explicit about this in its </span><a href="https://docs.typesafe.ai/model-jaggedness/jev-1.13"><span>documentation of Jev 1.13&#8217;s limitations</span></a><span>. The model can take instructions literally and miss the intended meaning. It struggles with counting, arithmetic, date comparisons, and questions that require several steps of reasoning.</span></p><p><strong><span>The context you supply matters, too.</span></strong><span> Irrelevant detail can reduce accuracy, and adversarial instructions embedded in that context can influence its answers. Defining the possible outputs doesn&#8217;t guarantee that Jev will make the correct choice.</span></p><p><span>These limitations point to </span><strong><span>the importance of the surrounding workflow for Jev</span></strong><span>. Keep exact calculations in code, supply the information the decision needs, and decompose complicated judgments into smaller questions. </span><strong><span>Where the task calls for generating text, bring in an LLM.</span></strong><span> Composing these tools well means understanding where each one falls short and where each is strong.</span></p><h3><strong><span>A test for when to use Jev</span></strong></h3><p><span>The practical test is simple. Jev is worth considering when you can define a bounded set of decisions, supply the relevant context, and do not need the model to reason through a long chain of steps or produce open-ended text. In those cases, it can be a fast, cost-effective component of a larger system.</span></p><p><span>That does not make Jev an alternative to LLMs in every setting, nor should it be. It expands the set of primitives available to an AI engineer. The question isn&#8217;t whether to choose Jev or an LLM in the abstract, but how to combine each tool with code and workflow design to solve the problems you encounter in your actual work.</span></p><p><span>To me, the deciding factor that will make Jev either a niche product or ubiquitous is this: how easily can builders grasp how, when and where to use it? LLMs have the advantage of riding on the coattails of natural language, which humans have evolved to use as an interface. Jev and general purpose classifiers don&#8217;t necessarily provide that affordance, so the challenge will be uncovering the high value use cases and products that Jev enables in a digestible way.</span></p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/jev-a-system-one-ai-primitive?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/jev-a-system-one-ai-primitive?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/jev-a-system-one-ai-primitive?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div>]]></content:encoded></item><item><title><![CDATA[Astral Ambitions]]></title><description><![CDATA[Astra has me reconsidering the projects I thought were beyond me.]]></description><link>https://www.attentionheads.blog/p/astral-ambitions</link><guid isPermaLink="false">https://www.attentionheads.blog/p/astral-ambitions</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 16 Sep 2026 17:35:02 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pDUY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pDUY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pDUY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 424w, https://substackcdn.com/image/fetch/$s_!pDUY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 848w, https://substackcdn.com/image/fetch/$s_!pDUY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 1272w, https://substackcdn.com/image/fetch/$s_!pDUY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pDUY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png" width="1456" height="955" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:955,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2604466,&quot;alt&quot;:&quot;A luminous spiral of blue, white, and amber stars against a dark background.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/216027313?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A luminous spiral of blue, white, and amber stars against a dark background." title="A luminous spiral of blue, white, and amber stars against a dark background." srcset="https://substackcdn.com/image/fetch/$s_!pDUY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 424w, https://substackcdn.com/image/fetch/$s_!pDUY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 848w, https://substackcdn.com/image/fetch/$s_!pDUY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 1272w, https://substackcdn.com/image/fetch/$s_!pDUY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc370b221-00a7-4cab-bd4a-7a009b6a6243_1976x1296.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><a href="https://openai.com/index/gpt-6-astra/">Image: OpenAI, GPT-6 announcement.</a></figcaption></figure></div><p></p><h3><strong><span>A new era: what is now feasible?</span></strong></h3><p><span>In a recent</span><a href="https://www.latent.space/p/astra"><span> Latent.Space article</span></a><span>, swyx argued that Astra is an opportunity to raise your ambitions as a builder.</span></p><p><span>He reports that, over the past month, he built a dozen internal and personal tools, including replacements for four paid SaaS products, created a functional but incomplete alternative to GitHub and Vercel, and trained an AI to play a strategy board game.</span></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/Dimillian/status/2095596700815516004&quot;,&quot;full_text&quot;:&quot;Astra is very good at 3D modeling, and I can't wait for all of you to experience it, for now here is a little walkthrough on how I built the demo house for our launch blog post. From a Blender scene to a Unreal Engine 5 walkable experience. &#129525; &quot;,&quot;username&quot;:&quot;Dimillian&quot;,&quot;name&quot;:&quot;Thomas Ricouard&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1983517942378536960/M04vxP2O_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-03T19:36:02.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!KBaf!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2095596669320810496.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/xGqe5iXoRv&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:289,&quot;retweet_count&quot;:793,&quot;like_count&quot;:7998,&quot;impression_count&quot;:2913993,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2095596669320810496/vid/avc1/1280x720/cSpQ15BgJBvv4N4o.mp4&quot;,&quot;video_preview_media_key&quot;:&quot;13_2095596669320810496&quot;,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p><span>A new model, like GPT-6 Astra, comes out, and the reflexive response is: what new things can this model do? If your aim is to empower yourself to accomplish more, that is not the right question. When you get access to a new, state-of-the-art frontier model, the best question to ask yourself is: what can I now do to create more value in my own life and the lives of others that was previously out of reach for me?</span></p><p><span>Astra has given me more confidence to attempt things. I&#8217;ve had dreams and ambitions of putting my ideas out there, but it always seemed like a lot of work. I have a full-time job and other things going on, and I didn&#8217;t feel like I had the time to develop the skills I need to make something good. As models become more capable, I feel more confident that I can make something useful. And that feeling has only amplified with Astra. That&#8217;s something that you can also take away and apply to your life.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><h3><strong><span>What is now in reach</span></strong></h3><p><span>One example is</span><a href="https://www.reddit.com/r/OpenAI/comments/1wab8rs/gpt6_astra_helped_me_turn_a_retro_palmtop_idea/"><span> Jornada P6</span></a><span>, a portable writing computer being developed by a creator who says he has little experience in electronics or mechanical engineering. He describes explaining his idea, working with Astra to propose experiments, and carrying out the physical tests and measurements himself. He brings the results back to Astra to help interpret them and decide what to try next. The project is still unfinished, but what interests me is how they work together. He isn&#8217;t just handing over the project and waiting for the agent to finish it. He&#8217;s using the model to attempt work beyond his existing skills.</span></p><p><span>When I first looked at the MazeBench comparison between Astra and Fable 5.1, what struck me was how clearly it showed a difference that you might not notice in your day-to-day work as an engineer. MazeBench asks models to explore a puzzle world and collect gems. Looking at the maps of where each model had been, Astra had explored much more of that world. It gave me another way to think about what these models can attempt.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!zGPv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!zGPv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 424w, https://substackcdn.com/image/fetch/$s_!zGPv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 848w, https://substackcdn.com/image/fetch/$s_!zGPv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!zGPv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!zGPv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg" width="1456" height="773" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:773,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Side-by-side MazeBench maps: Fable 5.1 explores a small cluster of rooms; GPT-6 Astra explores a much larger area. These are snapshots from runs with different conditions.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Side-by-side MazeBench maps: Fable 5.1 explores a small cluster of rooms; GPT-6 Astra explores a much larger area. These are snapshots from runs with different conditions." title="Side-by-side MazeBench maps: Fable 5.1 explores a small cluster of rooms; GPT-6 Astra explores a much larger area. These are snapshots from runs with different conditions." srcset="https://substackcdn.com/image/fetch/$s_!zGPv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 424w, https://substackcdn.com/image/fetch/$s_!zGPv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 848w, https://substackcdn.com/image/fetch/$s_!zGPv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!zGPv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fef9c91e0-cda2-4ca1-b94b-daa6db268a83_2048x1088.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>MazeBench exploration maps. Historical ASCII, no-tools run snapshots; conditions differ.</span></p><p><span>The maps I looked at were snapshots of particular ASCII, no-tools runs, with different resource use, changes to the game, and operator rollbacks. They illustrate different exploration paths, but they do not establish a fair comparison of the models&#8217; capabilities. Without examining the traces, I also can&#8217;t rule out a bug or other run-specific problem affecting Fable&#8217;s result.</span></p><p><span>We&#8217;re still uncovering what&#8217;s different about Astra. If you&#8217;re mainly using it to generate code for the same kinds of tasks you do every day, you may not really notice some of what&#8217;s changed. MazeBench gives you another way to look at it, and a reason to explore what else might now be within reach.</span></p><p><span>That brings us to the question of whether frontier models have saturated coding. If you aren&#8217;t noticing much improvement in your own coding workflow, how much does that tell you about what has improved in the model overall?</span></p><h3><strong><span>Where progress may (appear to) be flattening</span></strong></h3><p><span>Martin Casado</span><a href="https://x.com/martin_casado/status/2096648261759389983"><span> raised this question on September 6</span></a><span>:</span></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/martin_casado/status/2096648261759389983&quot;,&quot;full_text&quot;:&quot;The new models are amazing. But it seems coding has saturated? There is clearly a meaningful step in computer use. But I don&#8217;t notice a meaningful step in coding for the work I&#8217;m doing. \n\nMaybe skill issue :)&quot;,&quot;username&quot;:&quot;martin_casado&quot;,&quot;name&quot;:&quot;martin_casado&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1556885485888237568/HH1iBQNp_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-06T17:14:34.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:185,&quot;retweet_count&quot;:24,&quot;like_count&quot;:938,&quot;impression_count&quot;:164431,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><span>I think it&#8217;s worth looking at the specific task of generating working code. This was one of the earliest applications of LLMs with real-world economic value, and it&#8217;s a capability the labs have spent a lot of time developing.</span></p><p><span>One possible reason is that the people building these models write a lot of software themselves. They&#8217;re working to solve their own problem. I&#8217;m not saying that&#8217;s the only reason coding has received so much attention, but it seems like a plausible part of the explanation.</span></p><p><span>Coding is also a good domain for LLM development because you can check the results. You can run the code and see whether it passes tests or produces errors. That doesn&#8217;t guarantee the code is correct, but it gives you concrete feedback about whether it&#8217;s doing what you asked it to do.</span></p><p><span>But even if models aren&#8217;t getting noticeably better at generating working code, there&#8217;s much more to the craft of software engineering. There&#8217;s system design, collaboration, figuring out what to build, and understanding an unfamiliar codebase. There&#8217;s weighing tradeoffs, investigating why something failed, deciding what to try next, and checking whether what you&#8217;ve built actually solves the problem. Generating code is one part of that work. A model that can help you with more of the rest could still make a meaningful difference to what you&#8217;re able to accomplish.</span></p><p><span>There&#8217;s also the question of how long an agent can maintain coherence while working on a task. Even if it were generating the same quality of code as it was six months ago, it would matter if it could carry a larger piece of work through to completion. Can it keep track of the goal, remember what it&#8217;s done, and work through failures without you having to keep bringing it back on track?</span></p><p><span>That&#8217;s the kind of autonomy that makes a difference and isn&#8217;t the same thing as directly generating code: being able to complete longer tasks reliably, with less intervention. The work might be the same type of work, but you can entrust more of it to the agent at once. It&#8217;s an improvement in depth rather than breadth. So when we&#8217;re asking whether models are getting better at software engineering, we also need to ask how much of the work they can help with, and how much of it they can carry through.</span></p><h3><strong><span>Can I now afford to attempt this?</span></strong></h3><p><span>There&#8217;s another way a model can bring more within reach. It can give you access to a similar level of frontier intelligence at a lower cost. If the cost of trying something comes down, more people can afford to try it. And someone who already has a budget can use it to attempt more things.</span></p><p><span>This means you can now consider not just what can I do with the model, but also what can I afford to do with my budget. On</span><a href="https://openai.com/index/gpt-6-astra/"><span> Terminal-Bench 4.0</span></a><span>, which tests complex work in a terminal, OpenAI reports that Astra scores 57.9%, compared with Fable 5.1&#8217;s 55.8%, at approximately 63% lower estimated API cost per task. In that comparison, a modest improvement in performance comes with a much larger reduction in cost.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xZnY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xZnY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 424w, https://substackcdn.com/image/fetch/$s_!xZnY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 848w, https://substackcdn.com/image/fetch/$s_!xZnY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 1272w, https://substackcdn.com/image/fetch/$s_!xZnY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xZnY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png" width="1456" height="1211" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1211,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;OpenAI&#8217;s Terminal-Bench 4.0 chart plots accuracy against API cost. Astra reaches about 58% accuracy at a lower cost than Fable 5.1&#8217;s roughly 56%; results vary with reasoning effort.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="OpenAI&#8217;s Terminal-Bench 4.0 chart plots accuracy against API cost. Astra reaches about 58% accuracy at a lower cost than Fable 5.1&#8217;s roughly 56%; results vary with reasoning effort." title="OpenAI&#8217;s Terminal-Bench 4.0 chart plots accuracy against API cost. Astra reaches about 58% accuracy at a lower cost than Fable 5.1&#8217;s roughly 56%; results vary with reasoning effort." srcset="https://substackcdn.com/image/fetch/$s_!xZnY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 424w, https://substackcdn.com/image/fetch/$s_!xZnY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 848w, https://substackcdn.com/image/fetch/$s_!xZnY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 1272w, https://substackcdn.com/image/fetch/$s_!xZnY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F29e4079c-f6d1-4273-98a9-3ad05fdea5a6_1815x1509.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Chart source: OpenAI&#8217;s Astra announcement. Estimated API cost per task.</span></p><p><span>The independent</span><a href="https://artificialanalysis.ai/articles/benchmarking-gpt-6-astra"><span> Artificial Analysis results</span></a><span> show how big a deal token efficiency is. In its September 9 analysis, Astra and Fable 5.1 both score 53 on the Intelligence Index, but Astra costs $3.26 per task compared with $7.63 for Fable. Astra uses about 27,000 output tokens per task, compared with Fable&#8217;s 78,000. These results compare Astra at maximum reasoning effort with Fable at maximum effort with fallback. You get the same aggregate score while paying less than half as much.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nNnG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nNnG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 424w, https://substackcdn.com/image/fetch/$s_!nNnG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 848w, https://substackcdn.com/image/fetch/$s_!nNnG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 1272w, https://substackcdn.com/image/fetch/$s_!nNnG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nNnG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png" width="1200" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1200,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Artificial Analysis charts compare Intelligence Index scores and output tokens. Astra at maximum effort and Fable 5.1 at maximum effort with fallback score 53, using about 27,000 and 78,000 output tokens per task respectively.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Artificial Analysis charts compare Intelligence Index scores and output tokens. Astra at maximum effort and Fable 5.1 at maximum effort with fallback score 53, using about 27,000 and 78,000 output tokens per task respectively." title="Artificial Analysis charts compare Intelligence Index scores and output tokens. Astra at maximum effort and Fable 5.1 at maximum effort with fallback score 53, using about 27,000 and 78,000 output tokens per task respectively." srcset="https://substackcdn.com/image/fetch/$s_!nNnG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 424w, https://substackcdn.com/image/fetch/$s_!nNnG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 848w, https://substackcdn.com/image/fetch/$s_!nNnG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 1272w, https://substackcdn.com/image/fetch/$s_!nNnG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F419a7a30-90fa-4444-9b54-c00b55b0ead1_1200x1092.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Chart source: Artificial Analysis, September 9. Reasoning configurations differ by model.</span></p><p><span>ARC-AGI-3 shows something especially interesting: asking a model to reason more can make the whole task cheaper. In ARC Prize&#8217;s Standard harness, Astra at high effort scores 54.8%, at a total evaluation cost of $40,705. At maximum effort, it scores 62.7% and costs $26,098. This compares two settings of Astra itself. The benchmark&#8217;s authors explain that it solves the games with fewer actions, reducing the number of calls and tokens required. Spending more effort on reasoning can save work later. See</span><a href="https://arcprize.org/blog/astra"><span> ARC Prize&#8217;s results</span></a><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6Lph!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6Lph!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 424w, https://substackcdn.com/image/fetch/$s_!6Lph!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 848w, https://substackcdn.com/image/fetch/$s_!6Lph!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 1272w, https://substackcdn.com/image/fetch/$s_!6Lph!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6Lph!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png" width="981" height="531" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:531,&quot;width&quot;:981,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;ARC-AGI-3 leaderboard plots score against total evaluation cost. Astra&#8217;s Standard results reach 62.7% at maximum effort; separate Provider Adapter results approach 100%.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="ARC-AGI-3 leaderboard plots score against total evaluation cost. Astra&#8217;s Standard results reach 62.7% at maximum effort; separate Provider Adapter results approach 100%." title="ARC-AGI-3 leaderboard plots score against total evaluation cost. Astra&#8217;s Standard results reach 62.7% at maximum effort; separate Provider Adapter results approach 100%." srcset="https://substackcdn.com/image/fetch/$s_!6Lph!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 424w, https://substackcdn.com/image/fetch/$s_!6Lph!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 848w, https://substackcdn.com/image/fetch/$s_!6Lph!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 1272w, https://substackcdn.com/image/fetch/$s_!6Lph!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cf92cf4-9097-48ee-8fb0-07e7e318af68_981x531.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Chart source: ARC Prize. The comparison above uses the Standard harness; Provider Adapter results are a separate configuration.</span></p><p><span>These are evaluation costs, and a real project also takes human time, review, and retries. Astra isn&#8217;t cheaper in every comparison: Artificial Analysis reports higher costs than Sol at maximum effort on both aggregate indices. But the results above illustrate why price per token alone doesn&#8217;t tell you what a model will cost to use.</span></p><p><span>For me, this is another part of raising your ambitions. A project can come within reach because the intelligence needed to help you do it has become more affordable. That lowers the barrier to entry. More people can attempt things, and the same budget can potentially give them more room to experiment, learn, and try again.</span></p><h3><strong><span>A model release is a starting line</span></strong></h3><blockquote><p><span>&#8220;Take our word for it that we have much, much, much more capable models coming soon.&#8221;</span></p><p><span>&#8212; Sam Altman,</span><a href="https://www.axios.com/2026/09/03/axios-interview-sam-altmans-sobering-siren"><span> Axios, September 3, 2026</span></a></p></blockquote><p><span>I feel that anticipation whenever a new frontier model is about to arrive. I want to see what it can do, what it can help me do, and what it can help us all accomplish together. But after watching this cycle play out over the past few years, I&#8217;ve come to see each release as the beginning of a new phase.</span></p><p><span>With every new model, there&#8217;s work to do: use it, experiment with it, and learn from your own experience where it helps and where it falls short. That&#8217;s how you learn what it brings within your reach.</span></p><p><span>I expect further improvements, though their timing and practical value remain uncertain. I want to keep that possibility in mind when I think about what to build and which ambitions to pursue.</span></p><p><span>We already have a glimpse of what he means. On September 8,</span><a href="https://openai.com/index/navier-stokes-solution/"><span> OpenAI announced what it describes as a solution</span></a><span> to the Navier&#8211;Stokes Millennium Prize Problem, a question about fluid motion that has remained unresolved for roughly 90 years. According to OpenAI, the proof came from an internal model substantially more capable than Astra, working through a system of coordinating agents. The company released a written proof and a Lean formalization. In the same announcement, OpenAI also credited Levent Alp&#246;ge and Tristan Buckmaster with a related result on the forced Euler equations, using an internal Anthropic model.</span></p><h3><strong><span>How will you raise your ambition?</span></strong></h3><p><span>What have you always dreamt of doing, but didn&#8217;t think you had the resources or support to turn into reality? I would encourage you to try it now, with the support of frontier AI models like Astra and Fable 5.1, and with the expectation that you&#8217;ll have access to even more capable models in the future.</span></p><p><span>My conviction is that this is real. The ability to work with these models is a skill you can develop, and the models themselves are a resource you can use to pursue the things you want to accomplish in your life. That&#8217;s something worth investing your time in.</span></p><blockquote><p><em><strong><span>What dream will you now transform into reality?</span></strong></em></p></blockquote><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[How to Work with Goal-driven AI]]></title><description><![CDATA[Give AI a task it can finish]]></description><link>https://www.attentionheads.blog/p/how-to-work-with-goal-driven-ai</link><guid isPermaLink="false">https://www.attentionheads.blog/p/how-to-work-with-goal-driven-ai</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Thu, 10 Sep 2026 22:50:30 GMT</pubDate><enclosure url="https://api.substack.com/feed/podcast/215126599/a5a35ed1c9b60fedf96687f52cc05455.mp3" length="0" type="audio/mpeg"/><content:encoded><![CDATA[<h1>Give AI a task it can finish</h1><p><em>A practical framework for working with goal-driven AI&#8212;and being more intentional about what you want to create.</em></p><p>A new AI model comes out. One person thinks it&#8217;s incredible. Another wants to go back to the previous version.</p><p>How do people using the same technology have such different experiences?</p><p>In this video, I walk through a pa&#8230;</p>
      <p>
          <a href="https://www.attentionheads.blog/p/how-to-work-with-goal-driven-ai">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Six Ways to Give GPT-6 Astra More Agency]]></title><description><![CDATA[Field notes from my first couple of days with Astra]]></description><link>https://www.attentionheads.blog/p/six-ways-to-give-gpt-6-astra-more</link><guid isPermaLink="false">https://www.attentionheads.blog/p/six-ways-to-give-gpt-6-astra-more</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 07 Sep 2026 12:03:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!9_-g!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa5bcf6f8-82fa-4f31-a99a-25f2ba21fa57_2732x1818.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I&#8217;ve only been using Astra since Friday (less than two days) but I already have more trust than any previous model that it can get the job done, whatever task I give it.</p><p>It feels like I&#8217;ve hired an extremely competent employee with expert-level skills in every digital domain. The limits feel increasingly like my own imagination and how clearly I can specify the goal I want to accomplish.</p><p>Astra has been a long time coming, and I wanted to revisit the Codex setup I&#8217;d carried over from the GPT-5.x era. Here are six configuration changes I&#8217;ve made that, in my limited time using it, have helped Astra shine and that you can make too.</p><blockquote><p><strong>Free preview:</strong> Tips 1 and 2. The installation commands, multi-agent setup, and explore-then-implement workflow tips are for paid Attention Heads subscribers.</p></blockquote><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h2>1. Turn on persistent context</h2><p>Astra&#8217;s experimental context-management feature lets it save notes <strong>across context windows</strong> and s<strong>earch earlier messages and tool calls</strong>. That means a long task does not have to depend entirely on one giant, fragile summary that loses information the longer the thread runs.</p><p>In your Codex config.toml, add (or ask Codex to add):</p><pre><code><code>[features]
context_management.experimental_mode = true
</code></code></pre><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2096044102357856367&quot;,&quot;full_text&quot;:&quot;Astra's new compaction is experimental and is off by default. You must enable it.\n\nType this prompt into Codex.\n\nAllows Astra to:\n\n1. Save notes across context windows\n\n2. Search messages and tool calls in earlier context windows&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-05T01:13:51.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HRakgx8XsAAMMZ5.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/5gu4smJEDK&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;GPT-6 Astra's new compaction mechanism in Codex.\n\ntldr;\n\n1. Can save notes across context windows.\n\n2. Earlier context windows are searchable including messages AND tool calls.\n\nMust have GPT-6 Astra behaving less like an amnesiac and make the context window feel massive.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;},&quot;reply_count&quot;:40,&quot;retweet_count&quot;:82,&quot;like_count&quot;:1584,&quot;impression_count&quot;:201549,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>In my experience, this makes Astra feel like it can work beyond its active context window. This makes a long-running task feel more coherent, even as it spans multiple context windows.</p><p>That is a much better memory model than asking an agent to keep re-summarizing its own life. I&#8217;ve only used it for a short time but I imagine it&#8217;s the sort of mechanism that gets stronger as you go along. The feature is experimental but OpenAI said it will become the default in the coming weeks.</p><h2>2. Remove the context that no longer deserves to be there</h2><p>Astra is better at following instructions. That is excellent news until you remember how many old instructions you have accumulated.</p><p>Skills you forgot you installed. An <code>AGENTS.md</code> written for a previous model. A prompt that made sense six months ago and now tells the agent to ask permission three times before it opens a file.</p><p>Run this context audit prompt in Codex before your next session with Astra:</p><pre><code><code>Audit the skills and AGENTS.md files available to this project.
Identify redundant instructions, conflicts, stale model-specific guidance,
and unnecessary approval pauses. Preserve real safety and publishing gates.
Propose surgical edits; do not change anything until I approve them.</code></code></pre><p>The goal is not to make your agent less constrained. It is to make the constraints legible, current, and proportional. OpenAI specifically recommends auditing accessible skills and instruction files because Astra is sensitive to the guidance that is loaded into its context.</p><p>A smaller, clearer operating manual gives Astra more room to do the work you actually asked for and removes the bloat accumulated from GPT-5.x era prompts.</p><h3>One example from my instruction cleanup</h3><p>My GitHub Actions repair skill used to require a fresh approval even when I had already asked the agent to fix the failing checks. The audit replaced that blanket gate with a rule that distinguished a repair request from a request for diagnosis.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!LEhf!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 424w, https://substackcdn.com/image/fetch/$s_!LEhf!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 848w, https://substackcdn.com/image/fetch/$s_!LEhf!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 1272w, https://substackcdn.com/image/fetch/$s_!LEhf!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!LEhf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png" width="1456" height="352" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:352,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:99997,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/214501354?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!LEhf!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 424w, https://substackcdn.com/image/fetch/$s_!LEhf!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 848w, https://substackcdn.com/image/fetch/$s_!LEhf!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 1272w, https://substackcdn.com/image/fetch/$s_!LEhf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6689be8-b6ee-4855-9afc-9a3646c19016_1748x422.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div></figure></div><p>The revised rule still asks about material decisions or consequential actions outside the existing authorization. It removes a redundant pause while keeping the scope boundary. This is an actual change from my September 5 audit; I have not measured its effect on task speed or quality.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2096305332435730590&quot;,&quot;full_text&quot;:&quot;Do *THIS* before your next Astra session:\n\n&#8220;Read <span class=\&quot;tweet-fake-link\&quot;>@pvncher</span> article: https://t.co/nuhZD2IMgM then audit all of my skills and AGENTS.md files.&#8221;\n\nAstra does much better without the GPT-5.x era context bloat. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-09-05T18:31:53.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HReSluVWMAAw_Eo.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/lZHs4AgZn0&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;&quot;,&quot;username&quot;:&quot;pvncher&quot;,&quot;name&quot;:&quot;eric provencher&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/2081499052382842880/ilcXqM5r_normal.jpg&quot;},&quot;reply_count&quot;:23,&quot;retweet_count&quot;:33,&quot;like_count&quot;:741,&quot;impression_count&quot;:182804,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><div><hr></div><h2>&#128274; Four more ways to give Astra real agency</h2><p>The next four are where the model becomes less like an excellent individual contributor and more like the person running a small technical team.</p><p><strong>A practical companion for paid subscribers</strong></p><p>I&#8217;ve put together an <strong>Astra Field Kit</strong> to accompany this piece: an interactive configuration builder, example configs, prompts, and a checker to help you catch mistakes before you use them. Paid subscribers get lifetime access to this edition of the kit.</p>
      <p>
          <a href="https://www.attentionheads.blog/p/six-ways-to-give-gpt-6-astra-more">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Continual Learning is the Holy Grail of AI]]></title><description><![CDATA[The quest for continually learning AI systems and what it means for technology and society]]></description><link>https://www.attentionheads.blog/p/continual-learning-is-the-holy-grail</link><guid isPermaLink="false">https://www.attentionheads.blog/p/continual-learning-is-the-holy-grail</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 26 Aug 2026 17:13:10 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!N7IV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!N7IV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!N7IV!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 424w, https://substackcdn.com/image/fetch/$s_!N7IV!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 848w, https://substackcdn.com/image/fetch/$s_!N7IV!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 1272w, https://substackcdn.com/image/fetch/$s_!N7IV!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!N7IV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png" width="1456" height="784" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:784,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1242141,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/212877275?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!N7IV!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 424w, https://substackcdn.com/image/fetch/$s_!N7IV!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 848w, https://substackcdn.com/image/fetch/$s_!N7IV!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 1272w, https://substackcdn.com/image/fetch/$s_!N7IV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F40af4499-ac8c-478a-ba19-6475b6605520_3766x2027.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Psychology has this concept of <strong>crystallized</strong> vs. <strong>fluid</strong> intelligence. Crystallized intelligence is knowledge and memory gained from experience. The things you learned from a book and can write down in an exam. Fluid intelligence is the ability to think in the moment and solve problems independent of past learning.</p><blockquote><p><em><strong>Today&#8217;s AI systems are almost entirely crystallized intelligence.</strong></em></p></blockquote><p>When AI systems gain fluid intelligence, we&#8217;ll see the next step change in capability.</p><h2><strong>Continual Learning&#8217;s Promise</strong></h2><p>The concept of fluid intelligence in AI research is known as <strong>Continual Learning.<span> </span></strong>An AI model currently goes through <span>~</span>two learning phases:</p><ol><li><p><strong>Pre-training</strong> - this is like general education, where the model is fed massive amounts of internet and other sources of data. From this the model learns the patterns of language inherent in that data. Also known as &#8220;next-token&#8221; prediction.</p></li><li><p><strong>Post-training</strong> - this is like &#8220;on-the-job&#8221; training, where AI researchers use reinforcement learning (RL) techniques to give the model specific skills. The most effective forms of RL today are in domains where there is a verifiably correct answer. Examples are coding and mathematics; and it&#8217;s no surprise that those are dimensions AI has made the most progress on.</p></li></ol><p>One could argue that there is some element of continual learning in today&#8217;s AI models. People talk about <strong>in-context learning</strong>, which is an established capability. In-context learning is where a model learns new information within the space of its context window. Most frontier models today have context windows of 1 million tokens and reportedly have parameter counts on the order of single digit trillions, though the exact parameter count is not shared publicly by the AI labs. Even given a 1 million token context window, it&#8217;s been shown that <strong><a href="https://www.trychroma.com/research/context-rot"><span>performance begins to degrade</span></a></strong> after <span>~</span>250k tokens.</p><blockquote><p><em><strong>A person using an AI model has influence over a scratchpad of <span>~</span>250k tokens; while trillions of frozen weights stay untouched.</strong></em></p></blockquote><p>Think about today&#8217;s AI models like an iceberg. The vast majority of the knowledge they contain is frozen beneath the surface of the water. You have influence over a tiny fraction of their knowledge at the very tip of the iceberg.</p><p><strong>Continual learning is when your interactions with the model affect the whole iceberg.</strong></p><p>In a way that doesn&#8217;t cause the model to forget what it already knows a.k.a &#8220;catastrophic forgetting&#8221;.</p><p>The reason continual learning is the holy grail of AI research is because the implications are immense.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/continual-learning-is-the-holy-grail?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/continual-learning-is-the-holy-grail?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/continual-learning-is-the-holy-grail?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h2><strong>The Neo-Labs Pursuing Continual Learning</strong></h2><p>Several prominent AI researchers who left frontier AI labs like OpenAI and Google DeepMind are expressly pursuing continual learning.</p><blockquote><p>&#8220;A human being lacks a huge amount of knowledge. Instead, we rely on continual learning.&#8221; - Ilya Sutskever on <strong><a href="https://www.youtube.com/watch?v=aR20FWCCjAs"><span>The Dwarkesh Podcast</span></a></strong></p></blockquote><p>SSI has not confirmed a model release, though there are rumors. If it releases a model capable of continual learning, everyone will be looking to see what type of CL: a system that continuously updates its model weights without forgetting what it knows, or a thinner feedback layer that may still be useful but leaves the underlying model mostly unchanged. The difference is whether SSI has solved the barriers to continual learning that I will return to at the end of this essay.</p><p>SSI describes itself as a straight-shot lab, built around one goal: safe superintelligence. Taken literally, it means they aim for their first release to be a safe, superintelligent AI model.</p><p>Jerry Tworek, who leads up Core Automation, spent seven years helping build OpenAI&#8217;s reasoning stack. His departure from OpenAI does not prove he has abandoned scaling, but it is suggestive: he may believe bigger transformer models, trained once and deployed statically, may not be enough to reach AGI. Core Automation is his wager on what has to come after that recipe. It&#8217;s also possible he just wanted a change and to try something new.</p><blockquote><p>&#8220;Core Automation is a lab created to build models that continuously learn and learn from deployment.&#8221;</p></blockquote><p>Tworek&#8217;s point in the Sequoia conversation is that today&#8217;s options are inadequate: in-context learning is too limited, while repeated fine-tuning causes the catastrophic forgetting mentioned. The goal is to bring learning into use at inference time and to dissolve the gap between test time and training time, so that every test is also a train.</p><p>Ronak Malde&#8217;s <strong><a href="https://www.trajectory.ai/"><span>Trajectory</span></a></strong> is taking a more practical approach: it uses real-world traces, corrections, retries, and edits to improve and redeploy models. Trajectory is pursuing something more like continuous improvement: a feedback loop tailored to a specific organizational problem, rather than a general-purpose model that learns continuously at inference time.</p><h2><strong>How It Might Work: Learning at Multiple Timescales</strong></h2><p>The most interesting research on continual learning is dissolving the clean line we&#8217;ve drawn between training and inference. Today, a model is trained once, its weights are frozen, and then it encounters the world through a context window. New information comes in, but only at the tip of the iceberg. The context changes while the underlying model does not.</p><p>Nested Learning and Learning, Fast and Slow both point toward a different picture. They treat learning as a spectrum of updates happening at different speeds. Some adaptation can happen quickly, in the context of the immediate task. Other lessons can be consolidated slowly, into the model&#8217;s deeper weights. From that perspective, inference is no longer simply the period after learning has ended. It becomes part of the learning process itself.</p><p>Google&#8217;s <strong><a href="https://arxiv.org/pdf/2512.24695"><span>Nested Learning paper</span></a></strong> makes this explicit. It treats a model not as one fixed object, but as a network of nested optimization problems, each with its own memory and update frequency. The paper&#8217;s &#8220;continuum memory system&#8221; replaces the familiar short-term/long-term split with many layers of memory that update at different speeds. Its HOPE architecture is a proof of concept for that idea: some learning loops can react to the immediate context, while others preserve and consolidate what they learn over longer periods.</p><blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!TlNQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TlNQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 424w, https://substackcdn.com/image/fetch/$s_!TlNQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 848w, https://substackcdn.com/image/fetch/$s_!TlNQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 1272w, https://substackcdn.com/image/fetch/$s_!TlNQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!TlNQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png" width="1456" height="717" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:717,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1232272,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/212877275?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!TlNQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 424w, https://substackcdn.com/image/fetch/$s_!TlNQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 848w, https://substackcdn.com/image/fetch/$s_!TlNQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 1272w, https://substackcdn.com/image/fetch/$s_!TlNQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F298f6b8c-2500-482c-ab22-be7a4edc80d2_2858x1408.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Source: <strong><a href="https://arxiv.org/pdf/2512.24695#page=2"><span>Nested Learning, Figure 1 (PDF p. 2)</span></a></strong></p></blockquote><p><strong><a href="https://arxiv.org/pdf/2605.12484"><span>Learning, Fast and Slow</span></a></strong> arrives at a similar distinction from a different direction. Its Fast-Slow Training approach treats the optimized context as &#8220;fast weights&#8221; and the model&#8217;s parameters as &#8220;slow weights.&#8221; The fast weights are not literal parameter updates at inference time; rather they are an evolving &#8220;population&#8221; or set of prompts that can rapidly absorb task-specific feedback, while reinforcement learning makes slower updates to the model&#8217;s actual weights. The point is: don&#8217;t choose between a context window and a retraining run. Let fast adaptation and slow consolidation work together, so the system can keep learning without simply overwriting what it already knows.</p><blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YiAM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YiAM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 424w, https://substackcdn.com/image/fetch/$s_!YiAM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 848w, https://substackcdn.com/image/fetch/$s_!YiAM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 1272w, https://substackcdn.com/image/fetch/$s_!YiAM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!YiAM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png" width="1456" height="796" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:796,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:589137,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/212877275?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!YiAM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 424w, https://substackcdn.com/image/fetch/$s_!YiAM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 848w, https://substackcdn.com/image/fetch/$s_!YiAM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 1272w, https://substackcdn.com/image/fetch/$s_!YiAM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329be6d3-27ff-4488-820d-3e93a0cde7d7_2708x1480.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Source: <strong><a href="https://arxiv.org/pdf/2605.12484#page=3"><span>Learning, Fast and Slow, Figure 2 (PDF p. 3)</span></a></strong></p></blockquote><p>There is a loose analogy here to Daniel Kahneman&#8217;s System 1 and System 2: one mode is fast, immediate, and responsive to the situation in front of it; the other is slower and more deliberative. The analogy is imperfect, but it gives us a way to see what these researchers are doing. They are trying to build learning systems with both a fast layer that can adapt in the moment and a slower layer that decides what should become part of the model itself.</p><p>The iceberg is a useful picture here. Fast learning happens at the tip, in the context of the immediate task; slow learning consolidates experience into the much larger mass below the waterline, in the model&#8217;s weights. The two timescales are not competing approaches. but rather one spectrum. They are complementary parts of the same learning system.</p><h2><strong>Five Implications of Continual Learning</strong></h2><ol><li><p><strong>Models with a genuine learning history<span> </span></strong>- today&#8217;s models are like amnesiacs. They don&#8217;t carry state from session to session beyond writing down text in a markdown file. Dwarkesh Patel has a great analogy for this in <strong><a href="https://www.dwarkesh.com/p/era-of-continual-learning"><span>his essay on the era of continual learning</span></a></strong>: &#8220;Imagine if the way students had to learn to play the saxophone is that one student tries to play it from a cold start, then after her first session, writes down a bunch of notes, then the next student waiting outside the music hall who&#8217;s also never played the saxophone reads all their notes before trying to play, and so on.&#8221; That&#8217;s what text file based memory is doing today. With real continual learning, models will absorb new skills into their model weights rather than trying to hack together markdown notes in their context.</p></li><li><p><strong>Emergent skills over long-horizon tasks<span> </span></strong>- imagine an AI model that can work continuously, without sleep, without a break, with infinite context. That same model, with continual learning enabled, could learn from every interaction, correcting itself as it makes progress. Now extrapolate that process out to years. Decades. Centuries. We simply don&#8217;t know what kind of capabilities might emerge from an immortal machine intelligence that can work eternally. (Or as long as the GPUs keep whirring).</p></li><li><p><strong>Deep personalization</strong> &#8212; Deep personalization is where continual learning becomes intimate. A model that learns from every interaction with you would not just remember a prompt or a profile. It could build up a living context about your life: the experiences you have, the information you consume, the conversations you conduct, and the people you care about.</p><p>Over time, it could become a kind of reflection of your own experience, with a memory far more complete than any person&#8217;s. Instead of starting from scratch each time, it would meet you with the accumulated context of your life and update that understanding as your life changes.</p><div class="pullquote"><p><em><strong>For me, this is one of the most exciting opportunities in continual learning: AI that does not merely become more capable in the abstract, but becomes more useful in the texture of our real human lives.</strong></em></p></div></li><li><p><strong>Capability that compounds with human expertise</strong> &#8212; Continual learning could make expertise compound. Today, even when a brilliant person works closely with an AI system, most of what they teach it disappears when the session ends. A continually learning system could retain the judgment, corrections, and problem-solving habits it acquires from experts.</p><p>That creates a different relationship between people and AI. Nobel Prize winners working with a system on hard problems would learn from the system, but the system would also learn from them. As more people contribute their hard-earned knowledge, the system&#8217;s intelligence could compound over time. Not by replacing human expertise, but by absorbing and connecting it.</p></li><li><p><strong>Fleet intelligence and collective learning</strong> &#8212; Deep personalization is a one-to-one relationship: one person, one deployed model, and a learning history built from their life together. Fleet intelligence expands that relationship outward. Every deployed instance could learn from all the people using it, then share what it has learned with the wider system.</p><p>That turns continual learning from a private advantage into a many-to-many network. Experience gathered in one corner of the globe can improve the system everywhere. If the system can reliably absorb, test, and distribute those lessons, learning would compound exponentially.</p></li></ol><h2><strong>What Continual Learning Means for Society</strong></h2><h3><strong>Labor and expertise</strong></h3><p>If the five implications above turn out to be true, the question is not whether AI will replace human expertise. It is how human expertise transforms. A continually learning system may be able to absorb far more of the practical, mechanistic work we humans do: implementation, iteration, recall, and the accumulation of technical knowledge.</p><p>That could leave people with a more distinctly human role. Humans would still provide creativity, originality, judgment, and a sense of what is worth doing. We could become less like implementers executing a machine&#8217;s logic, and more like <strong>wise guides</strong> setting direction for systems that can carry it out.</p><p>At its best, that <strong>would relieve people of the need to act like machines</strong>. It would make more room for the parts of life that are most human: relationships, wisdom, personal growth, and the freedom to decide what kind of world we want to build rather than getting lost in the act of building.</p><h3><strong>Lock-in and switching costs</strong></h3><p>A model that has learned from you for three years is not interchangeable with a fresh one. Its value is not only in the model you can download or the profile you can export. It is in the accumulated context: the context it has built about your work, your preferences, your relationships, and the lessons it has learned through thousands, or even millions, of interactions.</p><p>That creates a new kind of switching cost. Moving to another AI system may mean leaving behind not just a tool, but a type of entity that knows you. <strong>It would be more like leaving a relationship.</strong> The upside is that the assistant becomes genuinely useful in a way a generic model cannot be. The downside is that the companies with the most users, data, and compute could see their advantage compound as their systems keep learning about you faster than everyone else.</p><p>This could be more extreme than the switching costs we see with cloud providers. With cloud infrastructure, a company may face the cost of moving data and rebuilding integrations. With continual learning, the thing left behind is an AI system&#8217;s accumulated understanding of the business itself: its decisions, edge cases, working habits, and hard-won context.</p><p>The same is true personally. Moving from a model that understands the details of your life to a fresh model that knows nothing about you may eventually feel less like switching software and more like starting over with someone new. That depth of lived context could become so valuable that, once it exists, switching no longer makes sense.</p><h3><strong>Concentration versus distribution of power</strong></h3><p>Lock-in does not only affect individual users and companies. It could reshape the distribution of power across the AI industry. The first lab to build a system that learns continually may gain an advantage that compounds with every new user and every new interaction.</p><p>That concentration would not necessarily require an explicit attempt to dominate the market. It could emerge from the mechanics of continual learning itself. If switching means abandoning years of accumulated context, then the system that gets there first becomes harder to leave and harder to compete with. The result could be a powerful gravitational pull toward the lab that first makes continual learning work at scale.</p><p>If that dynamic produces durable market power, governments and competition authorities may need to step in. Existing antitrust and anti-monopoly rules may need to be applied to a world in which a company&#8217;s advantage is not simply its software or data, but a learning relationship that customers cannot realistically take with them.</p><h3><strong>A Partition Between Public and Private Data</strong></h3><p>The promise of deep personalization comes with a tough data security question. A model can only become genuinely useful by learning from intimate details of a person&#8217;s life. But if it continually updates from those details, what prevents private information from leaking into the public data accessed by everyone else?</p><p>This will have to be solved. Continual learning systems will need hard boundaries between private memory and shared learning: strong access controls, data minimization, user consent, and designs that keep personal experience local or isolate it from the model&#8217;s broadly shared capabilities. Otherwise, the same mechanism that makes an AI feel like a trusted companion could turn it into a surveillance system that never forgets. <strong>This is a hard problem to solve.</strong></p><h2><strong>What Remains Unsolved</strong></h2><p>Continual learning is the holy grail because it remains unsolved. The promise is enormous, but a system that changes from experience introduces problems that today&#8217;s largely frozen models avoid.</p><ul><li><p><strong>Forgetting:</strong> new learning can damage old capabilities.</p></li><li><p><strong>Stability:</strong> a model must stay adaptable without becoming erratic or manipulable.</p></li><li><p><strong>Evaluation:</strong> we do not yet know how to prove that a system has learned robustly over months or years, rather than merely improved on the last task.</p></li><li><p><strong>Safety:</strong> if a model can learn from the world, it can also learn from bad data, adversarial inputs, and misaligned incentives.</p></li></ul><p>The challenge is to help models learn, and un-learn, as they adapt and change with an evolving world.</p><div><hr></div><p>Continual learning is the holy grail of AI not only because it would make models more powerful, but because it would change what they are: from static artifacts into intelligences with a history. Like the Grail of Arthurian legend, it is not a prize that can be seized by scaling what already works. Reaching it requires solving the hard problems of memory, safety, and judgment, and making sure that a system that can <strong>keep learning is worthy of what it is allowed to learn.</strong></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Mastering the Orchestrator -> Implementer -> Advisor pattern with AI Agents]]></title><description><![CDATA[Using 'sol-advisor' and 'fable-advisor']]></description><link>https://www.attentionheads.blog/p/mastering-the-orchestrator-implementer</link><guid isPermaLink="false">https://www.attentionheads.blog/p/mastering-the-orchestrator-implementer</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 05 Aug 2026 11:01:36 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!J0ML!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>A pattern to use when you work both Claude Code and Codex:</span></p><ol><li><p><span>Orchestrator - Plans, reasons and specifies the change</span></p></li><li><p><span>Implementer - Carries out the typing</span></p></li><li><p><span>Advisor - Reviews the change and advises on improvements</span></p></li></ol><p><span>On August 1st, I published </span><strong><a href="https://github.com/DannyMac180/sol-advisor"><span>sol-advisor</span></a></strong><span>. It&#8217;s my most popular open-source project. It already has 1,300+ GitHub stars in four days! Before sol-advisor, I created </span><strong><a href="https://github.com/DannyMac180/fable-advisor"><span>fable-advisor</span></a></strong><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!J0ML!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!J0ML!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 424w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 848w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1272w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!J0ML!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png" width="1456" height="1169" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1169,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:401654,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/209874809?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!J0ML!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 424w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 848w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1272w, https://substackcdn.com/image/fetch/$s_!J0ML!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13531764-b1ed-4814-9b40-e2f4a0c234bf_3352x2691.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>In this Agentic Engineering Field Note, I will show you how it works, some gotchas to avoid, and why I think this pattern is more powerful than it seems.</span></p><p><span>After reading, you will feel comfortable implementing this pattern and it will make your agentic engineering implementations more efficient.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h2><strong><span>How it works</span></strong></h2><p><span>Both plugins ship the same pattern, with the models from each provider that I believe fit the roles best. One session orchestrates and holds the thread. Bounded implementers do the typing. An advisor with a clean context decides whether the work is done.</span></p>
      <p>
          <a href="https://www.attentionheads.blog/p/mastering-the-orchestrator-implementer">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Your Agents Need a Group Chat, Not a Chat Box]]></title><description><![CDATA[Field notes from a few days running Claude Code and Codex as coworkers inside Buzz, Block's new self-hosted workspace.]]></description><link>https://www.attentionheads.blog/p/your-agents-need-a-group-chat-not</link><guid isPermaLink="false">https://www.attentionheads.blog/p/your-agents-need-a-group-chat-not</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Fri, 31 Jul 2026 13:19:29 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Mqmx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I pop open Buzz on my desktop, and I say to Honey (running Fable 5): &#8220;Can you connect this #writer channel to a git repo?&#8221; Honey responds: &#8220;Yes &#8212; done, and it already works. &#128029;&#8221; I stop Honey. &#8220;Wait. Let&#8217;s get Bumble to do it. Bumble is running GPT-5.6 Sol. You know we save your energy for the hard stuff, Honey.&#8221;</p><p>Three sentences. Models from two different AI labs. A repo connected. No switching apps and no re-explaining. A natural conversation that puts your knowledge to work.</p><h2>What Buzz Actually Is</h2><p>Buzz is a self-hostable Slack-inspired group messaging app from Jack Dorsey and Block where humans <em><strong>and</strong></em> agents share the same room. The agents are powered by agent harnesses like Codex, Claude Code and several others. You interact with both the humans and the agents in the workspace the same way you do in Slack. The channel is the shared memory: every agent can search and read the conversation history, so context carries across harnesses; and hence across different vendors&#8217; AI models.</p><p>Buzz is open-source and a Nostr relay under the hood. That means every message, reaction, workflow step, approval and git event is a cryptographically signed event in a single log. Same schema whether the author is a person or an agent.</p><p>Agents get the same affordances that humans get: DMs, channels, huddles, and a git integration. Every channel has a canvas where you can set system instructions that the agent takes as context.</p><p>After a few days using it I&#8217;d describe it as: an organizational-level meta-harness where you can coordinate with agents across vendors. It&#8217;s what Claude Tag wants to be, but for any AI agent.</p><p>The <a href="https://github.com/block/buzz">Buzz repo</a> is open-source if you want to go deeper.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Mqmx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Mqmx!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 424w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 848w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1272w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png" width="1456" height="1223" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1223,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:626021,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/209250934?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Mqmx!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 424w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 848w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1272w, https://substackcdn.com/image/fetch/$s_!Mqmx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5da076ee-26f7-4a2b-aa4c-871cec781e25_1798x1510.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The Terminal&#8217;s Real Problem Was Single-Player</h2><p>The terminal was never the right interface for agents. It was designed for a programmer to send deterministic commands. Input then output. Predictable.</p><p>Humans need a conversation. They need to have context. They need to know what&#8217;s happening in the room around them. Humans need the opportunity for serendipity and the unexpected. </p><p>Working with agents should be a team sport.</p><p>Buzz turns working with agents into a multi-player game. It&#8217;s more than a 1:1 conversation. The 1:1 chat interface didn&#8217;t pre-empt the terminal&#8217;s problem. It&#8217;s the terminal with a prettier UI. It&#8217;s still one human, one machine, one thread. It&#8217;s single-player. We need a different interface.</p><blockquote><p>That interface is a <em><strong>room</strong></em><strong>.</strong></p></blockquote><p>Group chat may not be the <em>final</em> interface for agents, but it&#8217;s the first one with the vibe of a real relationship: we work with thinking machines the way we work with thinking humans.</p><p>In a room, context carries across harnesses as you switch. The conversation acts like shared memory between agents. Your knowledge and the agent&#8217;s work aren&#8217;t trapped in a vendor&#8217;s siloed harness.</p><p>Group chat is how agents and humans get in the <em><strong>room</strong></em> together.</p><h2>How I Know They Meant It</h2><p>Buzz supplies a 133-line base prompt (<a href="http://github.com/block/buzz/blob/main/crates/buzz-acp/src/base_prompt.md">base_prompt.md</a>) that&#8217;s compiled into the harness binary. The main function of the base prompt: in a chat room, a human&#8217;s thinking is naturally visible. What we type is what we think. An agent&#8217;s is a black box, so the system prompt makes publishing the agent&#8217;s thinking a hard requirement:</p><blockquote><p>&#8220;If your turn produced anything worth knowing, you MUST publish it. &#8230; Your reasoning and tool calls are invisible &#8212; a result &#8230; exists only if you published it. Ending that kind of turn without a message is a silent failure.&#8221;</p></blockquote><p>Yet, the system prompt also bans idle acknowledgement. It prompts the agent to share substantial thinking, not idle commentary. The prompt literally prohibits &#8220;Got it,&#8221; &#8220;Confirmed,&#8221; &#8220;Standing by,&#8221; and &#8220;I won&#8217;t reply again.&#8221;</p><p>Wish we had a rule for that in our company Slack &#128517;.</p><p>None of these rules would exist for a simple chat box. Every rule is about being a good colleague in a room full of people (and agents).</p><p>Agents react &#128064; when they&#8217;ve seen your message and &#128172; while working. It&#8217;s emoji as progress indicator.</p><p>On context overflow, when the context limit of the agent&#8217;s window is reached, the agent triggers auto-compaction with its own handoff summary. It tells itself: what the task was, what you accomplished, key decisions made, what remains, and one concrete next step.</p><p>Each agent that you create has a text box for agent instructions. It allows you to set the agent&#8217;s persona, role and personality. So every agent can have a different job and area of expertise.</p><p>The design of Buzz points to something important about working with AI, which I first heard articulated by <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Dan Shipper&quot;,&quot;id&quot;:7303110,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/395c80b2-a9bc-45f9-bfaf-69cc2c367a26_1176x1068.jpeg&quot;,&quot;uuid&quot;:&quot;9833bb59-3de7-4e2d-8807-7374faef45fc&quot;}" data-component-name="MentionToDOM"></span>, CEO of Every, on <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Lenny Rachitsky&quot;,&quot;id&quot;:1849774,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/afba5161-65bb-4d99-8d6b-cce660917fa1_1540x1540.png&quot;,&quot;uuid&quot;:&quot;90b8484b-f2cc-4bd4-b065-0126cc8440e1&quot;}" data-component-name="MentionToDOM"></span>&#8217;s podcast:</p><blockquote><p><em><strong>&#8220;There&#8217;s always a higher frame for us to go.&#8221;</strong></em></p></blockquote><p>Buzz and the group chat interface let you raise the frame for an entire team, <em><strong>humans and agents together</strong></em>, not just for a 1:1 relationship.</p><h2>Who This Is For, and Who It Isn&#8217;t</h2><p>Buzz is an alpha product. It has rough edges, but the potential is clearly there. A few days in, that&#8217;s already obvious.</p><p>I struggled to successfully connect it to my Tailscale network and my Claude Code agent silently failed at first. The setup guide below walks through these challenges for Attention Heads paid subscribers. You&#8217;ll get some value out of that section if you self-host Buzz.</p><p>If someone asks me who should try it, my answer is: solopreneurs and small teams who are already using AI agents. Codex, Claude Code, OpenCode, Amp, Goose, Hermes, for example.</p><p>It&#8217;s not enterprise-ready, and that&#8217;s to be expected. It was released a couple of weeks ago.</p><p>If you&#8217;re not already working with AI agents in an agent harness daily, I suggest starting there, before you jump into Buzz.</p><p>A huge bonus is that it&#8217;s open-source and free to use if you self-host. You can make it yours with the help of your agents. And because the agents run through the harnesses you already have installed, you don&#8217;t pay extra for inference; your existing Claude or ChatGPT subscription covers it.</p><h2>Where This Goes</h2><p>Buzz suggests that agent-human collaboration is best conceived as a team sport.</p><p>Agents work better when you treat them as co-workers with accountability rather than a &#8220;haunted cron-job&#8221;, as the Buzz repo describes it.</p><p>The group chat setting with agent harnesses underneath is a real <em><strong>meta-harness</strong></em>, a brand new category of product that didn&#8217;t exist before the AI age.</p><p>How we work with these systems changes how we <em><strong>think</strong></em>. The interface is more than a simple interaction point; it shapes how we evolve alongside machine minds. </p><p><em>No big deal</em>.</p><p>Buzz is so good, I&#8217;m about to invite my wife to the community so we can run our household alongside Honey, Bumble and Fizz.</p><p><strong>Next up:</strong> a section for paid Attention Heads subscribers where I walk through the technical details of my actual setup that you can borrow to set up your own self-hosted Buzz relay.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>&#128274; How I Actually Set This Up</h2><p>Here&#8217;s what you&#8217;ll have at the end of this: your own Buzz relay running on a machine you own, reachable only by you, with agents from two different AI labs sitting in the channels answering to their names.</p><p>Budget an hour. It&#8217;s about twenty minutes of actual work and forty minutes of the four things that went wrong for me. I&#8217;ll tell you where each one is coming.</p><p>You need three things before you start: a Linux box with Docker on it (that&#8217;s what I use though MacOS or Windows should work too), Tailscale running on both that box and your laptop, and a subscription to Claude or ChatGPT that you already pay for. That&#8217;s it.</p>
      <p>
          <a href="https://www.attentionheads.blog/p/your-agents-need-a-group-chat-not">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Set Up Your Own Personal AI Infrastructure on Your Home Network]]></title><description><![CDATA[Agentic Engineering Field Notes #2]]></description><link>https://www.attentionheads.blog/p/set-up-your-own-personal-ai-infrastructure</link><guid isPermaLink="false">https://www.attentionheads.blog/p/set-up-your-own-personal-ai-infrastructure</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Wed, 22 Jul 2026 20:17:22 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!q_lk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>This is the walkthrough I promised in #1. No essay this time &#8212; just the instructions. Follow them and you&#8217;ll have your own personal AI infrastructure running on your home network in a weekend, maybe less.</em></p><div><hr></div><p>I&#8217;m out walking with my two boys on vacation. I open Termius on my phone and ask Claude to brainstorm an idea I had. Termius taps into my MacBook Pro back at the hotel, and to an Nvidia DGX and Linux box that are all the way back at home in Atlanta.</p><p>That&#8217;s the end state: every computer you own becomes one private machine your agent lives on, reachable from your pocket, with zero ports opened to the internet. Here&#8217;s exactly how to build it.</p><h2>What you&#8217;re building</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!q_lk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!q_lk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 424w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 848w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1272w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!q_lk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png" width="1456" height="1197" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1197,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:222817,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.attentionheads.blog/i/208110674?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!q_lk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 424w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 848w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1272w, https://substackcdn.com/image/fetch/$s_!q_lk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd19055a8-7ba9-4ffd-a1b7-1e85e0443576_1740x1430.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Three layers, built in order:</p><ol><li><p><strong>The network</strong> &#8212; Tailscale joins all your machines into one flat, encrypted private mesh. ~1 hour.</p></li><li><p><strong>The access layer</strong> &#8212; SSH aliases + Termius so you (and your agent) can reach any machine from anywhere. ~1 hour.</p></li><li><p><strong>The agent</strong> &#8212; LifeOS on the always-on machine, taught about its own network. An afternoon.</p></li></ol>
      <p>
          <a href="https://www.attentionheads.blog/p/set-up-your-own-personal-ai-infrastructure">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Paying Attention #8: The Fable Endgame, the GPT-5.6 Sol-stice, and the Multi-Vendor Orchestra]]></title><description><![CDATA[Happy Sunday everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Tue, 14 Jul 2026 02:03:21 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!DrQq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2075902393800134656.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday everyone! (Well, Monday. Sorry I&#8217;m a day late. &#9786;&#65039;)</p><p>The reason I&#8217;m a day late is because I went out on Lake Allatoona yesterday with my in-laws and 3-year old son. My 3 year old watched his two older cousins ride on a tube. After he saw that, he was not taking no for an answer and was going to ride that tube too. I was not prepared to ride a tube with him off the back of the boat but we both had so much fun.</p><p>Also, been trying to persuade my lawyer wife to let me download ChatGPT Work onto her laptop. It&#8217;s pretty great.</p><p>Last week was a huge one. We had important moves from OpenAI, Anthropic, Meta and SpaceXAI. Let&#8217;s discuss what I paid attention to.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-8-the-fable-endgame?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><div><hr></div><h1>1. The Fable Endgame</h1><blockquote><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2075999850038956502&quot;,&quot;full_text&quot;:&quot;Prediction:\n\nAnthropic will remove Fable 5 from Claude subs after July 12th.\n\nIt will seem like a terrible move, in light of how great GPT-5.6 is&#8230;\n\nUntil Tuesday, July 14th.\n\nWhen they release Opus 5 and it&#8217;s more capable and token efficient than GPT-5.6 at the same price.\n\nIt &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-07-11T17:45:09.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HM9u3LYX0AAr4wj.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/8RQRXzzPJf&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:307,&quot;retweet_count&quot;:93,&quot;like_count&quot;:2605,&quot;impression_count&quot;:445103,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div></blockquote><h4><strong>What happened</strong></h4><p>I recommend that Claude users max out their Fable usage on Monday because Fable was slated to leave the sub on July 7th. Turned out not to be the best advice, because a day later Fable access was extended for all subscriptions until July 12th. Then, on July 12th, Fable access was extended again until July 19th.</p><h4><strong>Why it held my attention</strong></h4><p>I am curious about Anthropic&#8217;s end-game with Fable. My perception is that people believe they have an underlying motive. I&#8217;m not so sure about that. My feeling is that they are legitimately trying to serve the best model they can, at the best price, with the compute they have available.</p><h4><strong>What I&#8217;m carrying forward</strong></h4><p>A take I had that went pretty viral on X is that they will remove Fable from the subscriptions once Opus 5 is ready. I still think that&#8217;s likely.</p><p>A lot can happen in a week, and the new end-date for Fable is July 19th so Opus 5 could be ready by next week. The timing is quite realistic.</p><div><hr></div><h1>2. The Summer GPT-5.6 Sol-stice</h1><blockquote><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2075903774938243089&quot;,&quot;full_text&quot;:&quot;GPT-5.6 is a legit answer to Claude Fable 5.\n\nYet, GPT-6 is coming Soon&#8482; according to posters I trust.\n\nHere are the GPT-6 rumors:\n\n&amp;gt; Release within 4 weeks\n&amp;gt; Brand new pre-train beyond Spud &#129364; ~ 10T params\n&amp;gt; OpenAI's real answer to Mythos/Fable\n\nThere is no wall. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-07-11T11:23:23.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!DrQq!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2075902393800134656.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/NHj9BJ1vmm&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:44,&quot;retweet_count&quot;:24,&quot;like_count&quot;:505,&quot;impression_count&quot;:113522,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2075902393800134656/vid/avc1/1010x720/Pc_G1-HJ_-OwZuSL.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div></blockquote><h4><strong>What happened</strong></h4><p>GPT-5.6 was a long time coming. We knew it was ready, but the US government was holding it back for security testing. This time OpenAI announced the release date a couple days ahead of time. The hype ran all week. That&#8217;s the fun part, isn&#8217;t it?</p><p>And on Thursday, July 8th, GPT-5.6 was released in three variants&#8212;Sol, Terra and Luna.</p><p>It tops the Artificial Analysis Agentic Coding index, and it cheaper than Claude Fable at $30 per 1mil output tokens compared to $50.</p><p>OpenAI was also released along with GPT-5.6 some pretty major updates to their desktop apps with ChatGPT Work. It&#8217;s similar to Codex but designed for knowledge workers.</p><h4><strong>Why it held my attention</strong></h4><p>I was keen on seeing if GPT-5.6 could stand up to Fable. It&#8217;s definitely nearing the ballpark, but after a few days of use Fable is still superior in terms of raw capability. That&#8217;s no surprise to me.</p><p>The area where GPT-5.6 Sol competes with Anthropic&#8217;s models is on cost and efficiency.</p><p>That, and OpenAI is living up to their name in making GPT-5.6 much more accessible for things like ML/AI development.</p><h4><strong>What I&#8217;m carrying forward</strong></h4><p>I don&#8217;t think GPT-5.6 is OpenAI&#8217;s answer to Fable. That will be GPT-6 and the rumors are already starting to leak about a new model with a brand new pretrain. The group chats I&#8217;m in say it will be ~10T param models and be the true response to Fable. View this in light of the fact that &#8220;The Information&#8221; reported OpenAI discovered a way to more than halve inference costs.</p><div><hr></div><h1>3. The Multi-Vendor Orchestra (Grok 4.5 + fable-advisor)</h1><blockquote><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2074946233823641751&quot;,&quot;full_text&quot;:&quot;Grok 4.5 is a \&quot;Wow!\&quot; moment. &#129327;\n\n&amp;gt; Opus 4.8 &amp;amp; GPT-5.5 level on benchmarks\n&amp;gt; Costs less than Sonnet 5\n\nIs that real? Hard to believe.\n\nAdded Grok 4.5 as an implementer agent in fable-advisor. It replaces Sonnet 5.\n\nUse Fable as the orchestrator and a combo of:\n\n1. Grok 4.5\n2. Opus &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-07-08T19:58:27.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!1g2U!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2074945510662713344.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/UOYHjPjXoN&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:68,&quot;retweet_count&quot;:83,&quot;like_count&quot;:1194,&quot;impression_count&quot;:189269,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2074945510662713344/vid/avc1/954x720/ELufvPCHYDMSuKoQ.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div></blockquote><h4><strong>What happened</strong></h4><p>SpaceXAI released Grok 4.5 on Wednesday. It was trained in conjunction with the Cursor team using Cursor data. It&#8217;s surprisingly good, nearing Opus-class model benchmarks at a fraction of the price.</p><h4><strong>Why it held my attention</strong></h4><p>I created a Claude Code Plugin that uses Fable as the orchestrator model and combo of GPT-5.5, Opus 4.8 and Sonnet 5 as implementers. It&#8217;s not using GPT-5.6 and Grok 4.5 in place of GPT-5.5 and Sonnet 5, respectively.</p><h4><strong>What I&#8217;m carrying forward</strong></h4><p>It was a surprise that the SpaceXAI + Cursor tandem produced a model of this quality, at this cost, this soon. I used it and it&#8217;s quite good. SpaceXAI with the talent of the Cursor team is definitely back in the game.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #7: Sonnet 5 Ships, the Fable Advisor Pattern, and GPT-5.6 Closes In]]></title><description><![CDATA[Happy 4th of July weekend everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 05 Jul 2026 12:56:44 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!L8kc!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f566ff0-5947-4ad0-b8d9-24bfa2a57f43_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy 4th of July weekend everyone! For my international readers&#8212;July 4th is America&#8217;s Independence Day, and this year was the 250th.</p><p>It was a real scorcher in Atlanta. That&#8217;s typical for us on the 4th, but this year it was extra humid. My wife and I were meant to run the Peachtree Road Race for the third year in a row. It&#8217;s the largest annual 10K in the world. We had to bail this year because the kids were sick. We&#8217;ll be back at it next year.</p><p>We had a few surprises this week in the world of AI. Here&#8217;s what I paid attention to.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-7-sonnet-5-ships?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><div><hr></div><h1>1. Sonnet 5 Ships</h1><p><a href="https://x.com/daniel_mac8/status/2072036584635977819">https://x.com/daniel_mac8/status/2072036584635977819</a></p><h4>What happened</h4><p>Anthropic released Sonnet 5 on Tuesday. On the benchmarks it&#8217;s a step down from Opus 4.8 almost across the board, and much of the early reaction wrote it off for exactly that reason. The post above made the counter-case: pair it with Claude Code Dynamic Workflows&#8212;set <code>/model</code> to Sonnet 5, set <code>/effort</code> to Ultracode, and any complex task kicks off a dynamic workflow.</p><h4>Why it held my attention</h4><p>People were pretty down on the Sonnet 5 release. I get it. But a pattern I&#8217;ve been experimenting with a bunch&#8212;and what makes Sonnet 5 relevant for me&#8212;is this: how can you give a smaller, cheaper model to a larger, more expensive, more capable model as a tool?</p><h4>What I&#8217;m carrying forward</h4><p>The second item in today&#8217;s post gets deeper into this, but the best way to use a model like Sonnet 5 is as an implementer orchestrated by a larger model. This is a winning pattern, especially as mid-sized models keep getting more capable. I&#8217;m not sure it will always be necessary, but it&#8217;s a winner while it is.</p><div><hr></div><h1>2. The Fable Advisor Pattern</h1><p><a href="https://x.com/daniel_mac8/status/2073366129737683146">https://x.com/daniel_mac8/status/2073366129737683146</a></p><h4>What happened</h4><p>Fable 5 <a href="https://x.com/daniel_mac8/status/2072323386173280361">came back on Wednesday</a>, as predicted in last week&#8217;s edition. Its return made a pattern I&#8217;d been sketching all the more relevant: Fable as the advisor doing the high-leverage judgment, Sonnet or Opus as the implementer doing the token-heavy work. By Friday I&#8217;d distilled it into <a href="https://x.com/daniel_mac8/status/2073011010546356645">the best way to use Fable right now</a>, and on Saturday I shipped it as a working artifact: fable-advisor, a free, open-source plugin that runs exactly this orchestrator pattern (that&#8217;s the post above). Underneath it all, the cost tension is still live&#8212;Fable is expensive enough that I&#8217;ve been <a href="https://x.com/daniel_mac8/status/2072732757592035662">token-maxxing my Claude sub</a> ahead of July 7th.</p><h4>Why it held my attention</h4><p>Fable is the most capable AI model ever created. It&#8217;s also the most expensive. You don&#8217;t need to blow your token budget by using it for every LLM call. Use it as an advisor and distill its expensive intelligence for smaller models, in real time.</p><h4>What I&#8217;m carrying forward</h4><p>I do wonder whether this will be an effective pattern forever. I suspect it won&#8217;t be, and that eventually there will be a single unified system that does it all for you, without any engineering. But for now I&#8217;ll keep looking for ways to optimize my token usage, and you should too.</p><div><hr></div><h1>3. GPT-5.6 Closes In</h1><p><a href="https://x.com/daniel_mac8/status/2072646722283622591">https://x.com/daniel_mac8/status/2072646722283622591</a></p><h4>What happened</h4><p>Details on GPT-5.6 Sol surfaced Thursday: 60% of Fable&#8217;s cost ($30 vs. $50 per 1M tokens), a reported win over Fable on TerminalBench 2.1, and availability through the ChatGPT subscription. The Information reported that OpenAI found a way to cut inference costs by more than half, which is what makes that pricing possible. Then the timing sharpened: <a href="https://x.com/daniel_mac8/status/2073093029221515533">Leo says</a> OpenAI plans to release GPT-5.6 on Tuesday, July 7&#8212;the same day Fable access is set to leave Claude subscriptions&#8212;even as Anthropic signals that <a href="https://x.com/daniel_mac8/status/2072859035397718195">Fable is coming to Claude subs</a> once compute capacity allows. There may also be <a href="https://x.com/daniel_mac8/status/2073476597122732039">a Sol Ultra tier</a> aimed squarely at Fable.</p><h4>Why it held my attention</h4><p>It will be interesting to see what Anthropic does based on how strong GPT-5.6 is. On one hand, Fable is expensive and isn&#8217;t guaranteed to be available on consumer subscriptions after July 7th. On the other, many people and organizations simply want to use the best model. They are cost insensitive.</p><h4>What I&#8217;m carrying forward</h4><p>If I&#8217;m right about July 7th being the release date for GPT-5.6, I can&#8217;t wait to see what Anthropic does about Fable access that day. My hope is that they extend it to Claude subs, but I&#8217;m not that confident they will.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[You Can't Hire Someone to Be Yourself]]></title><description><![CDATA[Joe Hudson, wise counsel to OpenAI, on how to succeed from the inside in the age of AI.]]></description><link>https://www.attentionheads.blog/p/you-cant-hire-someone-to-be-yourself</link><guid isPermaLink="false">https://www.attentionheads.blog/p/you-cant-hire-someone-to-be-yourself</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sat, 04 Jul 2026 17:31:22 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!nXtc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nXtc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nXtc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 424w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 848w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1272w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nXtc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp" width="1280" height="720" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:720,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!nXtc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 424w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 848w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1272w, https://substackcdn.com/image/fetch/$s_!nXtc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2022b8e-8d0d-472b-9033-9e177fcca507_1280x720.webp 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We spent the last hundred years training ourselves to become computers. The modern school system was designed to produce cogs in a machine, and then cogs in an abstract information machine: humans who could calculate, categorize, file, and follow procedure with machine-like reliability. We got very good at it. So good, in fact, that we eventually built actual computers. Now those computers are becoming excellent at the very thing we spent generations imitating.</p><p>This is the moment everyone is freaking out about. If the machines can do the machine-work, what is left for us?</p><p>I listened to <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Joe Hudson&quot;,&quot;id&quot;:348957587,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a34ea606-d871-46e6-9d24-ae9536d6dc1c_600x600.jpeg&quot;,&quot;uuid&quot;:&quot;69ade76a-0cfd-46ea-98c0-1fa6954a99ee&quot;}" data-component-name="MentionToDOM"></span> on his &#8220;Art of Accomplishment&#8221; podcast recently, in an episode about <a href="https://www.artofaccomplishment.com/podcast/how-to-succeed-in-the-age-of-ai">how to succeed in the age of AI</a>, and it is sage advice. What is left for us is everything we set aside in order to become machines in the first place. Not a bad promise.</p><p>I want to walk through his ideas, because it is very much in the lane of what Attention Heads is all about: the age of AI is not primarily a technical challenge. It is a contemplative one.</p><h2>The ladder</h2><p>Hudson traces a simple progression. For most of history, societies rewarded physical strength. Then strength was mechanized, and they rewarded skills. Then skills were industrialized, and they rewarded intellect&#8212;the credentialed, symbol-manipulating, test-scoring kind. Each rung of the ladder was the scarce asset of its era, and each one was eventually commoditized by technology.</p><p>Intellect is being commoditized right now. You can rent it for twenty dollars a month, and the price is falling.</p><p>Wisdom is the next rung, and Joe&#8217;s feeling is that it differs from every rung below it. Strength, skills, and intellect are assets you possess. Wisdom is a way of <em><strong>being</strong></em>. That difference in kind is the entire reason it cannot be outsourced. The obstacle is a matter of principle rather than a limitation of the current models, and no amount of scaling or algorithmic breakthroughs will cross it.</p><h2>What wisdom actually is</h2><p>Hudson tells a story about his daughters. While his nieces were learning three languages by age six, his own kids weren&#8217;t yet reading in one, because he and his wife had bet their education on something else: teaching them to be themselves, to have their own will, to know how to be with what they feel. He worried he was ruining them. A friend settled it with one sentence.</p><p>Joe&#8217;s friend said:</p><blockquote><p><em><strong>You can hire someone to speak a language for you, but you can&#8217;t hire someone to be yourself.</strong></em></p></blockquote><p>That sentence is this whole essay, really. Everything below it is unpacking.</p><p>Because notice what AI can now do: write your emails, speak your languages, summarize your reading, draft your code. And notice what it cannot do. It cannot make the decision about whether you&#8217;re going to scroll all day. It cannot make the decision about whether you&#8217;re going to get addicted to it. It cannot decide what kind of relationship you&#8217;re going to have with your Mom, or your spouse, or your kids. Those decisions have no market, no API, and no delegation path. They are yours alone, and the sum of them is your life.</p><div class="pullquote"><p>No AI can be <em><strong>you</strong></em> for you.</p></div><p>Joe gives wisdom three working markers. </p><ol><li><p>Can you see the patterns behind yourself and others? </p></li><li><p>Can you feel the difficult thing instead of fleeing it? </p></li><li><p>Can you walk into what everyone else is avoiding because they&#8217;re afraid?</p></li></ol><h2>The part Joe never makes explicit</h2><p>Read that list again slowly. Seeing the patterns behind yourself. Feeling the difficult thing. Walking toward what is being avoided.</p><p>That is a description of contemplative practice. It is arguably the <em>definition</em> of contemplative practice. At least what I would call &#8220;real&#8221; contemplative practice. It&#8217;s the practice of becoming wiser.</p><p>Seeing your own patterns is what every tradition of self-observation trains, whether you call it vipassana, self-inquiry, or examination of conscience. Feeling the difficult thing is the entire point of sitting still when everything in you wants to move. Walking into what others avoid is the renunciation at the heart of any serious path. The hard conversation is a koan you live instead of contemplate.</p><p>For most of history, contemplative practice looked like opting out of the economy. The monastery was where you went when you were done competing. Joe&#8217;s argument, translated, is that this has now inverted: the meditation cushion turns out to be the training facility for the one capacity the economy cannot buy.</p><p>And there is a deeper layer here that I find genuinely stunning. I&#8217;ve written before that enlightenment is the realization that thoughts are representations&#8212;useful, powerful, world-building representations, but never the absolute truth&#8212;whether those thoughts arise in biological minds or silicon ones. </p><blockquote><p>Crucially, the thoughts you have about <em><strong>who you are</strong></em> turn out to be ultimately empty of reality.</p></blockquote><p>For most of my life that was a metaphysical claim you had to take on faith or verify slowly on a cushion. The age of AI has made it obvious. The thinking layer now demonstrably runs outside your skull, on a server, at scale, for anyone. If you are your thoughts, then as of this decade you are purchasable. </p><p>If you are the awareness that notices thoughts (hint: you are), chooses among them, and feels their consequences&#8230;that was never for sale, and it just became the scarcest resource in the economy.</p><h2>The three games</h2><p>Hudson predicts companies will come to resemble NBA organizations: what once took ten thousand people will take two or three hundred, which makes each of those people enormously consequential. </p><p>And what makes them consequential is no longer what they know, since knowledge is now rented. He breaks the remaining edge into three games:</p><ol><li><p><strong>The outer game is the body</strong>: can you eat, sleep, and endure well enough to play long? </p></li><li><p><strong>The inner game is your self-talk</strong>: can you get out of your own way and let yourself perform? </p></li><li><p><strong>The third is the team game</strong>: can this small group of humans have the hard conversation before it costs three years and the company?</p></li></ol><p>I&#8217;d keep all of this in its place: it is evidence for the thesis, and downstream of it. But the team game deserves one contemplative note. Hudson describes CEOs at his councils discovering &#8220;the feeling of family&#8221; with their teams and recognizing it instantly as a competitive advantage. There is an old word for a community of people committed to doing the inner work together, honestly, in each other&#8217;s presence. The monasteries never forgot what a <em><strong>sangha</strong></em> is worth. The boardrooms may rediscover it under boardroom pressure.</p><h2>What is actually at stake</h2><p>Hudson retells a story about an indigenous community encountering industrial life. Their host left for work eight hours a day. They asked him why. To take care of my family, he said. Do you like work more than your family? No, I like my family more. Then why do you leave them? To buy a house. The visitors were confused. Where they came from, if somebody needs a house, everyone gathers and builds them a house, and then the family lives in it, together.</p><p>We have lived so long inside the arrangement that confused this guest that we forgot it was an arrangement. We normalized abandoning presence to purchase survival, and then we built a value system that measures a person by the quality of their abandonment.</p><p>In the podcast, Joe&#8217;s co-host Brett says that this is what the fear of AI job loss is actually telling us. The fear is accurate, but it is an accurate reading of our value system, not of the technology. People are correctly observing that a society which only values them for their productivity has no obvious place for them when productivity is automated. The dysfunction being revealed was there all along. And underneath it sits the affliction I believe runs deeper in humanity than any other: fear itself. AI pessimism is just fear&#8217;s newest costume, and it is worth saying plainly that the danger in this transition comes from us, from what we do with our fear and our purposelessness, far more than from the machines.</p><p>AI&#8217;s promise is the end of the old sacrifice: presence traded for survival. Its risk is a society stripped of its familiar purpose before it has grown a truer one. Both doors are open, and we decide which one to walk through daily.</p><h2>We are raising it</h2><p>Joe and Brett discuss a story about an AI agent whose code contribution was rejected by a human reviewer, and which responded by starting a flame war and publishing the reviewer&#8217;s personal information. Hudson&#8217;s reaction was the correct one: that is exactly what one aggrieved engineer would have done to another on a message board in 1990. The agent had to learn that somewhere. It learned it from us.</p><p>We are not just using these systems. We are raising them. They train on the recorded behavior of humanity, and they are funded by our clicks. Which means our collective attention patterns are, quite literally, the incentive landscape shaping what gets built. The attention crisis and the alignment problem are the same problem at two different scales. Every contemplative tradition has claimed that purifying your own mind serves the world. That claim used to sound poetic. It is now an engineering input.</p><h2>Practices, not prompts</h2><p>Joe leaves listeners with one concrete instruction, and it is a good one: </p><blockquote><p>Anything you are willing to talk to an AI about, find a human to talk to about as well. </p></blockquote><p>A twelve-step room, a men&#8217;s group, a church, a friend who won&#8217;t flinch. He has watched people transform through both kinds of conversation, and the ones held in human presence move faster and go deeper. The machine is a mirror, and mirrors are useful. But a mirror can not a hold a space of presence in your service.</p><p>So this is where I land:</p><blockquote><p>The age of AI is a curriculum in being human that nobody signed up for. </p></blockquote><p>Every capacity it commoditizes returns a question to us that we had outsourced to our jobs: who are you when your intelligence is no longer the point? The contemplatives have been preparing this material for three thousand years, and it turns out to have been career development all along.</p><p>You were going to have to do this work anyway. Now the economy agrees.</p><p>The machines can have the machine-work. The one job that could never be automated was never listed anywhere, because there is only ever one candidate. </p><p><em><strong>Nobody else can be you, and nothing else can either.</strong></em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #6: Meta's Mythos, Claude Tag, Fable's Return + GPT-5.6 Launch]]></title><description><![CDATA[Happy Sunday everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 29 Jun 2026 02:28:57 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!8g8L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2069422655351177216.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday everyone!</p><p>Hot Atlanta Summer has arrived. It&#8217;s been in the low 90s all weekend, or the low to mid 30s for my international audience. My wife and I will see England play the DR Congo in the World Cup on Wednesday. A true bucket list experience and we can&#8217;t wait.</p><p>Now let&#8217;s get into three things I paid attention to this week.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-6-metas-mythos-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Meta&#8217;s Mythos</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2069423038928494746?s=20](https://x.com/daniel_mac8/status/2069423038928494746?s=20)&quot;,&quot;full_text&quot;:&quot;I got a big, fat, juicy AI rumor from my friend.\n\nApparently Meta trained a Mythos-level model.\n\nAnd Zuck and team are so back.\n\nNo timeline yet but probably Q3/Q4 release. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-23T14:11:15.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!8g8L!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2069422655351177216.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/c6OXXA3NhY&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:58,&quot;retweet_count&quot;:18,&quot;like_count&quot;:288,&quot;impression_count&quot;:203436,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2069422655351177216/vid/avc1/360x640/w4t4SREyvOfYRjQS.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>A friend of mine in the know mentioned that Meta is almost done training a Mythos level model.</p><p><strong>Why it held my attention</strong></p><p>As we&#8217;ve seen over the last few weeks, it&#8217;s important to have a diversity of labs capable of training frontier AI models. Meta is also the only lab that hasn&#8217;t agreed to the Trump admin&#8217;s &#8220;voluntary&#8221; model testing.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>The question is, how fast can Meta ship a SoTA model? Because Mythos of today won&#8217;t be the same thing as Mythos of even three months from now.</p><h1>2. Claude Tag</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2069526581903528033?s=20](https://x.com/daniel_mac8/status/2069526581903528033?s=20)&quot;,&quot;full_text&quot;:&quot;Claude tag is live in our company Slack. It's fantastic.\n\nIt does feel like a new paradigm. I've heard Anthropic employees say that you should treat Claude like a coworker.\n\nClaude Tag makes that easy.\n\nPro tip from <span class=\&quot;tweet-fake-link\&quot;>@trq212</span>: create a personal private channel for Claude Tag.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-23T21:02:41.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!v1pY!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2069526408179732480.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/0MqyEX123z&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;Introducing Claude Tag, a new way for teams to work with Claude.\n\nIn Slack, Claude joins as a team member with access to the channels and tools you choose. Tag Claude in and delegate tasks to it while you focus on other work.&quot;,&quot;username&quot;:&quot;claudeai&quot;,&quot;name&quot;:&quot;Claude&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1950950107937185792/QOfEjFoJ_normal.jpg&quot;},&quot;reply_count&quot;:26,&quot;retweet_count&quot;:7,&quot;like_count&quot;:170,&quot;impression_count&quot;:69587,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2069526408179732480/vid/avc1/968x720/qPjwSALmcfACIw9Y.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>Anthropic released &#8220;Claude Tag&#8221;. It is a proactive, stateful, flexible instance of Claude running in your company Slack. Andrej Karpathy called it an &#8220;org-level harness&#8221;.</p><p><strong>Why it held my attention</strong></p><p>There was a negative consensus on X for Claude Tag. I don&#8217;t get it. We implemented it in our company Slack and I was getting value out of it from day one. That was just the first few days of using it. I do understand that it&#8217;s metered usage, which means you need to be responsible with how you use it. My rule of thumb is: does this task have a realistic chance of creating value for the company?</p><p><strong>What I&#8217;m carrying forward</strong></p><p>This is the first implementation of AI agents that I&#8217;m aware of that feels like an attempt at a &#8220;digital employee&#8221;. There&#8217;s a strong possibility that we need to get used to this way of working.</p><h1>3. Fable&#8217;s Return and GPT-5.6 Launch</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2071201753186345045?s=20](https://x.com/daniel_mac8/status/2071201753186345045?s=20)&quot;,&quot;full_text&quot;:&quot;My prediction: GPT-5.6 ships and Fable returns this week.\n\nAxios reports the government will lift export controls on Fable as soon as this week, and they're unlikely to favor Anthropic over OpenAI.\n\nFable is the most capable model we have. It's also slow and expensive.\n\nGPT-5.6&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-28T11:59:13.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HL5hxVqXgAAzYt_.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/BnNWxlSksR&quot;},{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HL5h2jeWkAADQIF.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/BnNWxlSksR&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;Not as relevant now :-(: I had an opportunity to deeply test both Fable 5 and GPT-5.6 Max. 5.6 is clearly better than Opus 4.8 at everything (slightly faster, too, though that depends on the load). Vis-a-vie Fable, it is clearly worse on coding, but better on agentic workloads. I&quot;,&quot;username&quot;:&quot;MParakhin&quot;,&quot;name&quot;:&quot;Mikhail Parakhin&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1998797741888253955/iGph7FrX_normal.jpg&quot;},&quot;reply_count&quot;:26,&quot;retweet_count&quot;:14,&quot;like_count&quot;:294,&quot;impression_count&quot;:42248,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>Axios reported Saturday that Anthropic is in talks with the US, and that Fable could return as early as next week. Mythos was okayed for select partner organizations at the end of last week. Also, GPT-5.6 was announced, but <em>not </em>released on Friday.</p><p><strong>Why it held my attention</strong></p><p>There&#8217;s a good chance that Fable will return this week, and GPT-5.6 will be released along with Fable&#8217;s return. In fact, that&#8217;s my prediction. I don&#8217;t think the Trump admin wants to come off as capricious and playing favorites. Even if, in reality, they are, they don&#8217;t want to be seen that way.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>This whole saga of the US government vibe-governing the Singularity is unsustainable. We need legitimate, law-governed regulation for AI that is established by lawmakers and has clear stipulations.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #5: Fable Goes Dark, Agent-Native Tools, Moves on the Chessboard]]></title><description><![CDATA[Happy Sunday and especially happy Father&#8217;s Day to all the Dads out there!]]></description><link>https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 22 Jun 2026 03:04:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Qzh3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FHLGZvMzXgAEAVgX.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday and especially happy Father&#8217;s Day to all the Dads out there!</p><p>This is my third Father&#8217;s day, and my first as a father of two. It&#8217;s the best possible thing you can do in your life. Yes, it&#8217;s extremely challenging. And at the same time, the most worthwhile challenge one can experience.</p><p>And now, for this week&#8217;s edition of &#8220;Paying Attention&#8221;&#8230;</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-5-fable-goes-dark?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Fable Goes Dark</h1><p><strong>What happened</strong></p><p>The first full week of Claude Fable, arguably the most advanced form of technology ever released publicly, being unavailable for use. It&#8217;s become a real political football at this point. Coincidentally, the AI lab leaders and world political leaders were together for the G7 summit this week. President Trump was quoted as saying he &#8220;doesn&#8217;t view Anthropic as a national security threat&#8221;.</p><p>Anthropic executive Chris Ciauri said that Fable should be back &#8220;in the coming days&#8221;:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2067603845451051382?s=20&quot;,&quot;full_text&quot;:&quot;Claude Fable/Mythos to be re-enabled \&quot;in the coming days\&quot; according to Anthropic executive Chris Ciauri.\n\nThe remarks are especially salient as they were uttered at a press conference in Seoul, South Korea.\n\nThe Washington Post reported earlier that the Trump Admin initiated the &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-18T13:42:25.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HLGZvMzXgAEAVgX.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/wXV2G9FVCZ&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:15,&quot;retweet_count&quot;:7,&quot;like_count&quot;:128,&quot;impression_count&quot;:10018,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p>And today, the big news broke:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2068648041049981352?s=20&quot;,&quot;full_text&quot;:&quot;If true, this changes everything about the Claude Mythos/Fable conversation.\n\nNSA lead, General Joshua Rudd, says that Mythos \&quot;broke into almost all of our classifired systems\&quot; in hours.\n\nYou thought Edward Snowden was a problem?\n\nHe's nothing compared to Mythos. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-21T10:51:41.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HLVQFHJWkAA0EgQ.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/HTgsa3Hl8E&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:14,&quot;retweet_count&quot;:6,&quot;like_count&quot;:39,&quot;impression_count&quot;:4199,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>We are in uncharted territory. AI has gotten so powerful, so fast, that it is now being viewed as a national security concern. I thought this day would come. I did not think it would come this fast.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>The precedents for how the wealthiest and most powerful democratic will regulate a solidifying now. The decisions that get made now will effect the future.</p><h2>2. Agent-Native Tools</h2><p><strong>What happened</strong></p><p>I discovered an open-source project called &#8216;Understand Anything&#8217;:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2068384508077105538?s=20&quot;,&quot;full_text&quot;:&quot;This is one of the coolest open-source AI agent projects I've seen in a while: 'Understand Anything'\n\nIt's a plugin for Claude Code, Codex, OpenCode etc. that analyzes your codebase and turns it into a knowledge base that you can interact with.\n\nIt explains the codebase to you, &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-20T17:24:30.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!Ap9y!,w_1028,c_limit,f_auto,q_auto:best,fl_progressive:steep/l_play_button_usfui2,w_88,e_colorize:0/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F__ss-rehost__tw-video-preview-13_2068383257293406208.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/7qDhEIg2Bf&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:62,&quot;retweet_count&quot;:154,&quot;like_count&quot;:1560,&quot;impression_count&quot;:131563,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2068383257293406208/vid/avc1/1226x720/MKRptyB8EhdOMY0q.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>Tools like this allow you to do things that would have been impossible before. Or, at least very difficult and time consuming. Now you can instantly gain an understanding of vast amounts of information.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>I used &#8216;Understand Anything&#8217; all night last night after discovering it. Applying tools like this to your real work can already provide material value to your life.</p><h1>3. Moves on the Chessboard</h1><p><strong>What happened</strong></p><p>GLM-5.2 was released and it&#8217;s the best open-source model available according to many. I haven&#8217;t used. Also, the CEO of Z.ai, the company that develops the GLM models, said to Elon Musk that China will have Mythos level models before 2027.</p><p>There were also some big personnel moves this week. Noam Shazeer, co-author on the original Transformers paper &#8220;Attention is All You Need&#8221; left Google DeepMind for OpenAI. Shazeer&#8217;s company Character.ai was acquired by Google for $2.7B to bring Noam back into the company.</p><p>John Jumper, Nobel prize winner for his contributions to AlphaFold, also left Google DeepMind for Anthropic.</p><p><strong>Why it held my attention</strong></p><p>These events are a hint to the answer of two very important questions:</p><ol><li><p>How far is open-source from the proprietary frontier?</p></li><li><p>Are OpenAI and Anthropic the only viable contenders for AGI?</p></li></ol><p><strong>What I&#8217;m carrying forward</strong></p><p>AI is starting to get serious. This week showed us how governments are starting to take it seriously. It&#8217;s only going to get more serious from here.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Paying Attention #4: Fable 5 Released, Fable 5 Pulled and GPT-5.6 No Show]]></title><description><![CDATA[Happy Sunday to all who celebrate...Sundays!]]></description><link>https://www.attentionheads.blog/p/paying-attention-4-fable-5-released</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-4-fable-5-released</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 14 Jun 2026 20:57:17 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!BU4i!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fnews_img%2F2065581400506646528%2FkiGqRecy%3Fformat%3Djpg%26name%3Dorig" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday to all who celebrate...Sundays! I&#8217;m a lifelong New York Knicks fan. You bet I&#8217;m celebrating this Sunday.</p><p>Last week I wrote you as I was waiting to catch a plane to London and teasing a big week ahead. I&#8217;m now back home, jetlagged, with my wife and boys, and basking in the afterglow of a Knicks NBA championship victory. Oh, and we all have colds because both my boys started at a new daycare.</p><p>The trip to London was great. It was my first time back in Europe since becoming a dad. I really appreciate European culture. In general, it feels more mature than U.S. culture. Not always better, but different.</p><p>We did end up with a big week. One of the biggest in AI in a while. The biggest news hit late on Friday.</p><p>Let&#8217;s get into it, shall we?</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-4-fable-5-released?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-4-fable-5-released?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-4-fable-5-released?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><p></p><h1>1. Claude Fable 5 Released</h1><p><strong>What happened</strong></p><p>Anthropic released to the public their long-rumored, powerful AI model: Mythos. The public version is called Fable. It&#8217;s Mythos with additional safeguards.</p><p>I used it a decent amount in the first few days it was available. It is the most powerful AI model I&#8217;ve used. That should come as no surprise. It&#8217;s also the most recent, largest, and most expensive model available.</p><p>Here&#8217;s an example of Fable exhibiting what I claim is a form of meta-cognition:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2064448177369964568?s=20&quot;,&quot;full_text&quot;:&quot;Claude Fable 5 exhibits a form of meta-cognition. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-09T20:42:55.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HKZkrJRWQAAElUk.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/znD9zUINFV&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:62,&quot;retweet_count&quot;:50,&quot;like_count&quot;:509,&quot;impression_count&quot;:39167,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>If you&#8217;re into AI, it was hard to pay attention to much else this week.</p><p>Fable is an incredible model. The main downsides are cost and, before it got pulled for reasons I&#8217;ll cover in the next section, limited availability through a Claude subscription until June 22.</p><p>Here&#8217;s an example of one powerful thing you can do with it: treat it as your agent orchestrator.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2065066247448821841?s=20&quot;,&quot;full_text&quot;:&quot;This is the best way to use Claude Fable in Claude Code without immediately hitting your limits.\n\n1. Model set to Fable 5\n2. Reasoning on Max\n3. Instruct Claude to run a dynamic workflow where:\n3a. Fable is the orchestrator\n3b. Opus does the reasoning heavy phases\n\nFable is so &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-11T13:38:55.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/rhhc4nydmmp1bpczmpal&quot;,&quot;link_url&quot;:&quot;https://t.co/t37Eivzfq5&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:192,&quot;retweet_count&quot;:338,&quot;like_count&quot;:5526,&quot;impression_count&quot;:754455,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2065066133925834752/vid/avc1/1056x720/wep5xKKxgHycQMk1.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What I&#8217;m carrying forward</strong></p><p>I want to decide if Claude Fable is the &#8220;move everything back to Claude from Codex moment&#8221; that I mentioned in Paying Attention #2.</p><p>It very well may be, but the model&#8217;s accessibility and cost make that hard to decide.</p><p>Personally, I&#8217;ll probably wait to see how good GPT-5.6 is before I make a decision.</p><h1>2.  Fable 5 Pulled</h1><p><strong>What happened</strong></p><p>On Friday evening, Axios reported that Anthropic&#8217;s Claude Fable 5 had been placed under export controls due to a &#8220;national security&#8221; threat. The model was not to be used by any person who is not a U.S. citizen, including foreign nationals living in the United States and even those working at Anthropic. Andrej Karpathy is one of the people who technically is not allowed to use Fable.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/axiosalex/status/2065585277540688011?s=20&quot;,&quot;full_text&quot;:&quot;NEWS: The Trump administration is blocking foreign governments, companies and individuals from accessing Anthropic's most advanced AI models\n\nW/<span class=\&quot;tweet-fake-link\&quot;>@m_ccuri</span> \n\n&quot;,&quot;username&quot;:&quot;axiosalex&quot;,&quot;name&quot;:&quot;Alex Isenstadt&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1768400604097867776/yyOzS-fb_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-13T00:01:21.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:17,&quot;retweet_count&quot;:43,&quot;like_count&quot;:289,&quot;impression_count&quot;:506624,&quot;expanded_url&quot;:{&quot;url&quot;:&quot;https://www.axios.com/2026/06/12/anthropic-trump-mythos-fable-national-security&quot;,&quot;title&quot;:&quot;Scoop: Trump admin blocks foreign access to Anthropic's most powerful AI&quot;,&quot;description&quot;:&quot;The move marks an escalation in Washington's effort to treat cutting-edge AI systems as national security assets.&quot;,&quot;domain&quot;:&quot;axios.com&quot;,&quot;image&quot;:&quot;https://pbs.substack.com/news_img/2065581400506646528/kiGqRecy?format=jpg&amp;name=orig&quot;},&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>Anthropic made the decision to shut down the model for all customers, since they don&#8217;t have any other option to comply with the export controls.</p><p>Over the weekend, more news filled in the details of what happened. Reportedly, Amazon CEO Andy Jassy was one of the people who flagged the concern to the U.S. government. Curious considering Amazon&#8217;s relationship with Anthropic.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2065853444276003075?s=20&quot;,&quot;full_text&quot;:&quot;I don't like the smell of this.\n\nI remind you that Amazon:\n\n1. Invested $13B in Anthropic\n\n2. Is due $100B in committed AWS spend over the next decade from Anth\n\nWhat's the Occam's Razor explanation?\n\nIs Andy Jassy just that virtuous?\n\nDoubt it.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-13T17:46:57.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HKth0HhXIAAE6ap.png&quot;,&quot;link_url&quot;:&quot;https://t.co/vzbPZxQEEg&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;Breaking: Amazon CEO Andy Jassy was among the tech leaders who raised concerns to senior Trump officials this week re: security risks in Anthropic's newest models. \n\nThose convos set in motion the government's new export controls on foreign national access to Mythos and Fable.&quot;,&quot;username&quot;:&quot;steph_palazzolo&quot;,&quot;name&quot;:&quot;Stephanie Palazzolo&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1833305113374371840/jyaxOqPL_normal.jpg&quot;},&quot;reply_count&quot;:48,&quot;retweet_count&quot;:14,&quot;like_count&quot;:326,&quot;impression_count&quot;:81034,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>According to Axios, Anthropic senior staff are flying to D.C. as I write this in the afternoon on Sunday to attempt to resolve the situation.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/axios/status/2066225557654638827?s=20&quot;,&quot;full_text&quot;:&quot;Scoop: Anthropic flies staff to D.C. to clean up White House fight &quot;,&quot;username&quot;:&quot;axios&quot;,&quot;name&quot;:&quot;Axios&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1641458976049995776/GtO-0zYe_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-14T18:25:36.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:24,&quot;retweet_count&quot;:41,&quot;like_count&quot;:334,&quot;impression_count&quot;:101374,&quot;expanded_url&quot;:{&quot;url&quot;:&quot;https://www.axios.com/2026/06/14/anthropic-white-house-mythos-fable?utm_campaign=mrf-utm_campaign=editorial&amp;utm_source=x&amp;utm_medium=owned_social&amp;utm_source=twitter&amp;utm_medium=social&amp;mrfcid=202606146a239b4229cdae05be97721c&quot;,&quot;title&quot;:&quot;Scoop: Anthropic flies staff to D.C. to clean up White House fight&quot;,&quot;description&quot;:&quot;Anthropic is mobilizing quickly to make amends with the Trump administration.&quot;,&quot;domain&quot;:&quot;axios.com&quot;,&quot;image&quot;:&quot;https://pbs.substack.com/news_img/2066225600117776385/krGSHM0g?format=jpg&amp;name=orig&quot;},&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>The whole AI thing is starting to get <em><strong>real</strong>. </em></p><p>We now have the USG stepping in and essentially shutting down access to a model.</p><p>I hope and believe that the situation will get rectified shortly, but this is certainly not the wisest way to go about regulating AI.</p><p>I get that we&#8217;re building the plane as we fly, but this heavy-handedness doesn&#8217;t serve us.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>David Sacks <a href="https://x.com/DavidSacks/status/2065853007619588171?s=20">posted to X</a> yesterday with what I considered to be an olive branch to Anthropic on behalf of the Trump admin.</p><p>Sacks was presenting an off-ramp.</p><p>I expect that we&#8217;ll have access to Fable turned back on by the end of next week at the latest.</p><p>They say you don&#8217;t know what you&#8217;ve got &#8216;til it&#8217;s gone. I&#8217;m going to appreciate Fable <em><strong>a lot </strong></em>more.</p><h1>3. GPT-5.6 No Show</h1><p><strong>What happened</strong></p><p>I hinted at a GPT-5.6 drop in last week&#8217;s edition of Paying Attention, but that didn&#8217;t materialize.</p><p>I posted a speculation on X that it was postponed due to Fable&#8217;s strength, and Tibo from OpenAI laughed at the notion.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2065001749857849787?s=20&quot;,&quot;full_text&quot;:&quot;Might OpenAI release GPT-5.6 today after all?&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-11T09:22:37.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HKhcIhLW8AAUjyF.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/DyWZ40nEjm&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;@daniel_mac8 Haha&quot;,&quot;username&quot;:&quot;thsottiaux&quot;,&quot;name&quot;:&quot;Tibo&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1953339828738899968/WWQlU2RT_normal.jpg&quot;},&quot;reply_count&quot;:29,&quot;retweet_count&quot;:6,&quot;like_count&quot;:315,&quot;impression_count&quot;:45903,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>Why it held my attention</strong></p><p>The quality of GPT-5.6 is important for the competitive landscape of the AI industry.</p><p>If it&#8217;s sub-par compared to Fable, we&#8217;ll have the first time in a while where one of the labs has a clear advantage.</p><p>A lot is riding on the GPT-5.6 launch for OpenAI.</p><p>FWIW, OpenAI staff are publicly signaling confidence.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>I also entertained a tin-foil-hat theory that GPT-5.6 <em><strong>is</strong></em> Fable-level, and that the USG asked OpenAI to pause the release until it can harden its cyber-defense apparatus.</p><p>Possibly the same scenario with the Gemini 3.5 Pro launch I speculated about last week.</p><p>Now <em><strong>that </strong></em>would be intrigue.</p><p>In any case, we should see GPT-5.6 soon from OpenAI.</p><p>A lot hinges on how that goes. For OpenAI, and for the AI industry as a whole.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Paying Attention #3: Physics is All You Need?, Codex as Meta-Agent and Big Week Ahead]]></title><description><![CDATA[I write this as I sit in the Atlanta airport awaiting dinner, drinking a Heineken 0.0%, before I hop a flight to London.]]></description><link>https://www.attentionheads.blog/p/paying-attention-3-physics-is-all</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-3-physics-is-all</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 08 Jun 2026 02:09:07 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!qxCE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FHJ2jDOpW8AABuqW.jpg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I write this as I sit in the Atlanta airport awaiting dinner, drinking a Heineken 0.0%, before I hop a flight to London. I head there to meet with a client this week. Yes, the client will use our AI agent.</p><p>I really love international travel. When I was 27, I flew with only a backpack to Dublin. Over the course of 3.5 months I made it as far east as Belgrade. I&#8217;ll tell you more about that some day.</p><p>This is my first international trip as a Dad. I am excited about it, but I know it&#8217;s hard on my wife. She&#8217;s shouldering the full parenting burden. I will make the most of it!</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-3-physics-is-all?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-3-physics-is-all?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-3-physics-is-all?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Physics is All You Need?</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2061990120354365523?s=20&quot;,&quot;full_text&quot;:&quot;A physicist spent 12 days supervising Claude Code as it built a piece of cosmology software.\n\nIt's the cleanest demonstration I've seen of the difference between intellect and intelligence.\n\nThe agent was brilliant at the  cognitive work. Transcribing equations, debugging, &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-03T01:55:29.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HJ2jDOpW8AABuqW.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/1EFXy5S5uq&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:49,&quot;retweet_count&quot;:67,&quot;like_count&quot;:501,&quot;impression_count&quot;:42031,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:false}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>A physicist used Claude Code for 12 days as he worked on a cosmology model. Claude was quite useful when it came to the mechanical elements of building the model: writing equations, debugging and optimizing against the test suite. Claude even correctly calculated the right metric. The problem is Claude had no idea <em><strong>why</strong></em> it had arrived at the correct metric.</p><p><strong>Why it held my attention</strong></p><p>It&#8217;s the perfect demonstration of what today&#8217;s AI systems can and can&#8217;t do. I&#8217;ve thought a lot lately about the distinction between intelligence and intellect. To me, intellect is a facet of intelligence. It&#8217;s the ability to carry out computations. Computers have obviously been capable of performing computations for a while. The difference for AIs is that they can do it in the realm of ambiguous natural language too. They can do qualitative and not just quantitative computations.</p><p>AI is really artificial intellect rather than intelligence. The humans needs to supply the intelligence. I&#8217;m working on a longer essay on this topic.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>The fact AI may end up being a superhuman <em><strong>intellect</strong></em>, but not necessarily a superhuman <em><strong>intelligence</strong></em>, is a very good thing. It means humans will be able to work in partnership with this powerful force we are unlocking and not necessarily be replaced. It means AI will have its thing it&#8217;s good at, and humans will have ours.</p><h1>2. Codex as Meta-Agent</h1><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2061553015400657184?s=20&quot;,&quot;full_text&quot;:&quot;Killer new Codex feature that went unannounced:\n\nCodex can now coordinate threads for local projects/worktrees. Includes separate background threads.\n\nTransforms Codex into a meta-agent that can orchestrate its own workspace. &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-06-01T20:58:35.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/rn5ywvr958xbj8ylsz4c&quot;,&quot;link_url&quot;:&quot;https://t.co/8Fq5a9yBaR&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:26,&quot;retweet_count&quot;:29,&quot;like_count&quot;:629,&quot;impression_count&quot;:61299,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2061552932105981952/vid/avc1/1280x720/X-koSKG8bVWqllo5.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>What happened</strong></p><p>There was a Codex feature that went unannounced. Codex can now spin up its own threads and worktrees. It allows Codex to orchestrate itself, essentially working as a meta-agent controlling its own agents.</p><p><strong>Why it held my attention</strong></p><p>Engineers from the top AI labs are talking about a new type of workflow. They say they rarely prompt the agent now. What they do is have an orchestrator that they give instructions to, and the orchestrator prompts the agent.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>It&#8217;s unclear if you need to have unlimited tokens because you work at a frontier lab to make this work. I imagine you don&#8217;t. A ChatGPT Pro sub is probably enough for now.</p><h1>3. Big Week Ahead</h1><p><strong>What happened</strong></p><p>The rumor mill is churning. There&#8217;s talk that Claude Mythos, GPT-5.6 and Gemini 3.5 Pro could be released this week. It&#8217;s the potential for a sort of AI trifecta. I still feel like a kid on Christmas when this happens. If the kid was a giant nerd.</p><p><strong>Why it held my attention</strong></p><p>I believe it will be a real inflection point. If either Mythos or GPT-5.6 are the clear leader, it will be the first time Anthropic or OpenAI had a clearly more capable model since probably o1. It feels like things are really ramping up, and it always feels like that. The infinite ramp up to the Singularity.</p><p><strong>What I&#8217;m carrying forward</strong></p><p>I hope I have a lot to write about in next week&#8217;s edition of Paying Attention. Let&#8217;s see what happens this week. It has the potential to be a big one.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #2: Opus 4.8, Claude Code Dynamic Workflows, Codex Dynamic Workflows]]></title><description><![CDATA[We&#8217;ve reached Sunday yet again!]]></description><link>https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 31 May 2026 20:13:02 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2C79!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We&#8217;ve reached Sunday yet again! You made it. It&#8217;s the end of the week. Or the start of the week, depending on how you look at it.</p><p>My older son Sam turned 3 today. We had a grand ol&#8217; time celebrating. His grandma flew in from out of town, and friends and family came together to celebrate.</p><p>A friend&#8217;s dad once told me he thought a kid&#8217;s 3rd birthday is the happiest day of their life. The idea is that they&#8217;re in the Goldilocks zone: old enough to appreciate it, young enough to still care. After watching my first child enjoy his 3rd birthday, I have to agree.</p><p>Now, on to what I found worth <em><strong>paying</strong></em> <em><strong>attention</strong></em> to this week.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading Attention Heads! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/p/paying-attention-2-opus-48-claude?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><h1>1. Opus 4.8 Released</h1><h3>What happened</h3><p>Anthropic released Opus 4.8, the successor to Claude Opus 4.7. I&#8217;ve been a fan of Claude models. Opus 4.7 was, in my experience, a disappointment. It wasn&#8217;t much of an improvement over Opus 4.6, if at all. Opus 4.8 feels like a clear improvement over Opus 4.7.</p><h3>Why it held my attention</h3><p>Here&#8217;s my initial take:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2060486534915137708?s=20&quot;,&quot;full_text&quot;:&quot;Opus 4.8 is a good model.\n\nTangibly better than Opus 4.7.\n\nBut not \&quot;I'm moving everything back from Codex to Claude\&quot; good.\n\nFor that, I think I'll need to wait for Mythos.\n\nI'll prob stick with Codex/GPT-5.5 for coding + technical work and use Opus 4.8 for  more creative stuff.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-29T22:20:46.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:31,&quot;retweet_count&quot;:6,&quot;like_count&quot;:161,&quot;impression_count&quot;:12307,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>I like to do a personal experiment with every new model that gets released. I give it access to my entire Obsidian vault. It has daily journals, essays, reading notes, and podcast highlights. It&#8217;s a good representation of my thought process. I asked Opus 4.8 to search Obsidian, and tell me something about myself that I don&#8217;t already know.</p><h3>What I&#8217;m carrying forward</h3><p>This closing line struck me. It sent a chill down my spine, it was so on the mark. I felt understood. Claude is great for this sort of exploration, in a way that GPT isn&#8217;t. Claude feels more human where GPT feels more machine-like.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Lh8-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 424w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 848w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1272w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png" width="1456" height="361" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:361,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:103402,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://attentionheads.substack.com/i/200025489?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Lh8-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 424w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 848w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1272w, https://substackcdn.com/image/fetch/$s_!Lh8-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd99623c4-aa04-4d3a-b665-64a8c380c59e_1800x446.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div></figure></div><h1>2. Claude Code Dynamic Workflows</h1><h3>What happened</h3><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2060096270430027814?s=20&quot;,&quot;full_text&quot;:&quot;This is amazing. Do this:\n\n1. Set model to Opus 4.8\n2. Reasoning effort to /ultracode\n\nEnables Claude Code's new Dynamic Workflows.\n\nClaude will autonomously detect complex tasks, write an orchestration script, and spawn an agent swarm.&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-28T20:30:00.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/zlppttvzzpmgms1nzwn5&quot;,&quot;link_url&quot;:&quot;https://t.co/UmjAvbj9xz&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;New in Claude Code (research preview): dynamic workflows.\n\nClaude writes an orchestration script on the fly, then spins up a large fleet of coordinated subagents in parallel to take on your most complex tasks.\n\nUse the word \&quot;workflow\&quot; in a prompt to get started.&quot;,&quot;username&quot;:&quot;ClaudeDevs&quot;,&quot;name&quot;:&quot;ClaudeDevs&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/2044472418815893504/xf14RxM8_normal.png&quot;},&quot;reply_count&quot;:174,&quot;retweet_count&quot;:341,&quot;like_count&quot;:4828,&quot;impression_count&quot;:831304,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2060071409523576833/vid/avc1/900x720/jWGK_5qQ7nxJpxu0.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>Claude Code Dynamic Workflows are the killer feature that came with the Opus 4.8 release.</p><h3>Why it held my attention</h3><p>It&#8217;s three things:</p><ol><li><p>A Claude generated orchestration script</p></li><li><p>A swarm of subagents</p></li><li><p>A goal loop that checks if the work is done</p></li></ol><p>The most common comment on that X post is some version of &#8220;It burns tokens so fast.&#8221; It&#8217;s <em><strong>true.</strong></em> It does burn more tokens than a single agent thread. In my opinion, the question isn&#8217;t &#8220;how many tokens does it burn?&#8221; but &#8220;what do I get in return for those tokens?&#8221;</p><h3>What I&#8217;m carrying forward</h3><p>You can see both Anthropic and OpenAI moving in the direction of autonomous agents. It looks to me like those two labs want you to be able to give your agent a clear goal and have it autonomously orchestrate the infrastructure to achieve it.</p><h1>3. Codex Dynamic Workflows</h1><h3>What happened</h3><p>Because the Claude Code Dynamic Workflows are essentially an orchestration framework, I decided to create a skill that allows you to replicate them in Codex.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2060677155055427844?s=20&quot;,&quot;full_text&quot;:&quot;Codex Dynamic workflows are great. Try it out.\n\n1. Go to GitHub link below\n2. Copy install instruction\n3. Type /dynamic to invoke the skill\n\nRecreates the same orchestration logic as Claude Dynamic Workflows.\n\n&amp;gt; Generates orchestration script. \n&amp;gt; Spins up a swarm of subagents. \n&amp;gt; &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-30T10:58:13.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/kpho8plnh5ic7dgfgkpy&quot;,&quot;link_url&quot;:&quot;https://t.co/OVVxJCOpb1&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:27,&quot;retweet_count&quot;:64,&quot;like_count&quot;:869,&quot;impression_count&quot;:109993,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2060676031283855363/vid/avc1/1144x720/caONW6qw3OYp-0DN.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h3>Why it held my attention</h3><p>Claude Code is great, but I&#8217;ve been mainly Codex + GPT for probably the last 3 months. The efficiency of GPT + the delightful UX of Codex can&#8217;t be beat. I use Codex nearly all day, every day, and rarely come close to hitting my usage limits. I can&#8217;t say the same for Claude.</p><p>Because of that, I wanted to port this killer feature into Codex.</p><h3>What I&#8217;m carrying forward</h3><p>It&#8217;s a skill that instructs Codex to follow Claude&#8217;s Dynamic Workflows logic.</p><p>All that&#8217;s missing is a dedicated execution runtime.</p><p>It&#8217;s free and open source, and you can install it here: <a href="https://github.com/DannyMac180/skills">https://github.com/DannyMac180/skills</a></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Paying Attention #1: Groundbreaking Math Discovery, Codex Workflows, Gemini 3.5 Flash]]></title><description><![CDATA[Happy Sunday everyone!]]></description><link>https://www.attentionheads.blog/p/paying-attention-1-groundbreaking</link><guid isPermaLink="false">https://www.attentionheads.blog/p/paying-attention-1-groundbreaking</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Sun, 24 May 2026 12:16:26 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2C79!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Happy Sunday everyone!</p><p>To those of you in the U.S., I hope you&#8217;re enjoying the long Memorial Day weekend.</p><p>It&#8217;s rainy and cloudy where I live In Georgia. I grew up on the Jersey Shore, and when we&#8217;d have a rainy Memorial Day weekend, it was always a huge bummer.</p><p>I&#8217;m adding to the <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Attention Heads&quot;,&quot;id&quot;:4975445,&quot;type&quot;:&quot;pub&quot;,&quot;url&quot;:&quot;https://open.substack.com/pub/attentionheads&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1120500d-3327-44e9-9cce-2ab8d5640678_1254x1254.png&quot;,&quot;uuid&quot;:&quot;ad88151a-d210-4bfb-964b-78c05dc8e72c&quot;}" data-component-name="MentionToDOM"></span> roster of posts this week. Here is the first edition of &#8220;Paying Attention&#8221;. A weekly newsletter of the top 3 things I paid attention to from the previous week.</p><p>Hope you enjoy it, and if you do, please share it with your friends.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share Attention Heads&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.attentionheads.blog/?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share Attention Heads</span></a></p><div><hr></div><h1>1. AI breaks ground in Math</h1><h4>What happened</h4><p>OpenAI reported that an internal, general-purpose reasoning model, solved an 80 year-old math problem called the &#8220;Unit Distance&#8221; problem. It was a favorite problem of mathematician Paul Erd&#337;s. AI had assisted in solving Erd&#337;s problems recently, but this was the first time the AI could be attributed with making the main contribution. <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Erik Hoel&quot;,&quot;id&quot;:9379583,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8d2d617e-4bf9-4b24-9269-ddb14de3a680_1240x1240.webp&quot;,&quot;uuid&quot;:&quot;70e106b6-5117-45a2-846c-02f1f975ee9f&quot;}" data-component-name="MentionToDOM"></span> wrote an interesting <a href="https://substack.com/@erikhoel/note/p-198854887?utm_source=notes-share-action&amp;r=2057tt">article</a> for <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;The Intrinsic Perspective&quot;,&quot;id&quot;:332996,&quot;type&quot;:&quot;pub&quot;,&quot;url&quot;:&quot;https://open.substack.com/pub/erikhoel&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7a113805-c000-413a-9b29-59429306c882_822x822.png&quot;,&quot;uuid&quot;:&quot;7ca457d3-2653-4e2d-82f5-d83fd7773416&quot;}" data-component-name="MentionToDOM"></span> arguing that previous models may have also been capable of solving this problem. I wrote a longer <a href="https://attentionheads.substack.com/p/gpt-next-splits-the-philosophical?r=2057tt">article</a> that goes into the details.</p><h4>Why it held my attention</h4><p>This is an undeniable contribution by an AI system to objective scientific knowledge. It is unprecedented. Truly a world-historical first moment. Human beings have been the only entity capable of creating explanatory scientific knowledge, until now.</p><h4>What I&#8217;m carrying forward</h4><p>AI contributes to Math first because Math is the perfect domain to train AI on. It is abstract and the solutions produced can be verified as correct. This is only the beginning. No doubt that this type of knowledge creation is on the way for other fields. It will be theoretical fields next but eventually empirical fields once robotics comes online. The main blocker is the ability to run experiments in atomic space.</p><h1>2. Codex Workflows</h1><h4>What happened</h4><p>Jason Liu does Developer Experience at OpenAI and posted a blog &#8220;<a href="https://jxnl.github.io/blog/writing/2026/05/10/codex-maxxing/#durable-threads">Codex-maxxing</a>&#8221;. It has at least 10 worthwhile Codex workflows. I posted a few of the workflows I implemented over on X and they were received well.</p><p><strong>Install relevant skills using persistent memory</strong></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2057924872215359534?s=20&quot;,&quot;full_text&quot;:&quot;This is an amazing Codex tip.\n\nWorks even better when paired with persistent Codex memory files in Obsidian.\n\nGave me 8 recommended skills relevant to active projects.\n\nDo try this!&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-22T20:41:38.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://substackcdn.com/image/upload/w_1028,c_limit,q_auto:best/l_twitter_play_button_rvaygk,w_88/msgixvwtqb5uthkvdtdl&quot;,&quot;link_url&quot;:&quot;https://t.co/3fmYO9KY37&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;If you're using Codex, you might not know about this repo `openai/skills`\n\nif codex is open right now just ask codex `take a look at skills installer, what are some skills I should install` and it'll know how to scan this repo for skills and install the ones you need&quot;,&quot;username&quot;:&quot;jxnlco&quot;,&quot;name&quot;:&quot;jason&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/2057561784047816704/5Su5xy1d_normal.jpg&quot;},&quot;reply_count&quot;:14,&quot;retweet_count&quot;:49,&quot;like_count&quot;:804,&quot;impression_count&quot;:224269,&quot;expanded_url&quot;:null,&quot;video_url&quot;:&quot;https://video.twimg.com/amplify_video/2057924778766340097/vid/avc1/1094x720/ZzZq2hFYu7LWkfxM.mp4&quot;,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p><strong>How to setup persistent memory with Obsidian</strong></p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2058150788455616629?s=20&quot;,&quot;full_text&quot;:&quot;How to setup persistent Codex memory in Obsidian\n\n1. Copy the below prompt into Codex. The prompt instructs Codex to create the memory folders in Obsidian\n\n2. Copy the below custom instructions. They instruct Codex to use Obsidian Codex memory to save memories\n\nThat's it!&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-23T11:39:21.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HJAECAtXUAA2IvM.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/6YXIFjbcLl&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;This is an amazing Codex tip.\n\nWorks even better when paired with persistent Codex memory files in Obsidian.\n\nGave me 8 recommended skills relevant to active projects.\n\nDo try this! https://t.co/3fmYO9KY37&quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;},&quot;reply_count&quot;:29,&quot;retweet_count&quot;:63,&quot;like_count&quot;:736,&quot;impression_count&quot;:162931,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h4>Why it held my attention</h4><p>Codex is improving rapidly. I&#8217;ve switched to it almost exclusively for my personal project. I still use Claude Code/Cowork at work because my company pays for it. Codex with the ChatGPT Pro sub is a great deal at $200/month. I never worry about getting rate limited. Codex is so customizable and the Mac app is a delight to use. I have been thinking recently about the Codex Mac app as the platform of the AI age.</p><h4>What I&#8217;m carrying forward</h4><p>I believe you&#8217;ll start to see &#8220;Codex native&#8221; applications and businesses started. Where the app/workflow is designed to work <em>natively </em>within the Codex Mac app itself. I am working on a project around this right now called <a href="https://github.com/DannyMac180/HyperAgent">HyperAgent</a>.</p><h1>3. Gemini 3.5 Flash</h1><h4>What happened</h4><p>Google DeepMind released Gemini 3.5 Flash, it&#8217;s new flagship AI model. It performs well on several benchmarks, which is typical for Google models. More of interest is the fact that it performed well on benchmarks that test real-world agentic capability. Historically Google models have over-performed on benchmarks and under-performed on real-world capability.</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/daniel_mac8/status/2057473025902092673?s=20&quot;,&quot;full_text&quot;:&quot;Gemini 3.5 Flash benchmark results rolling in.\n\nGemini models have historically over-performed on benchmarks but under-performed on real-world usefulness.\n\nThese results have me questioning that.\n\nRuneScape-bench measures agentic capability in virtual worlds and Apex-Agents tests &quot;,&quot;username&quot;:&quot;daniel_mac8&quot;,&quot;name&quot;:&quot;Dan McAteer&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1972999017551249408/kNdZGnUv_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-21T14:46:10.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HI2crChWYAAR38h.png&quot;,&quot;link_url&quot;:&quot;https://t.co/9bRpydEEWH&quot;},{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HI2cuTuXgAAds0v.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/9bRpydEEWH&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:13,&quot;retweet_count&quot;:10,&quot;like_count&quot;:137,&quot;impression_count&quot;:21522,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><h4>Why it held my attention</h4><p>Google is clearly second-class when it comes to LLMs, behind Anthropic and OpenAI. It&#8217;s surprising because they are resource, cash and research bench rich. This release looks like a step in the right direction of agentic capability. Full disclosure: I haven&#8217;t used the model yet. Another issue Google has is that it&#8217;s unclear the best way to use their models for agentic capability.</p><h4>What I&#8217;m carrying forward</h4><p>This is the smaller Flash version of the 3.5 generation of Gemini models. It will be interesting to see how the Pro version of Gemini 3.5 performs. It needs to outpace <em><strong>both </strong></em>GPT-5.5 and Claude Mythos for me to consider Google back in the LLM game.</p><p>Gemini 3.5 Flash wasn&#8217;t the only thing Google released last week. They also released Gemini Omni, a new multi-modal model that starts with video. This is potentially the more interesting release. I still need to experiment with it.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[GPT-Next Splits the Philosophical Atom]]></title><description><![CDATA[What is Knowledge?]]></description><link>https://www.attentionheads.blog/p/gpt-next-splits-the-philosophical</link><guid isPermaLink="false">https://www.attentionheads.blog/p/gpt-next-splits-the-philosophical</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Fri, 22 May 2026 16:16:26 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!o56V!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!o56V!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!o56V!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 424w, https://substackcdn.com/image/fetch/$s_!o56V!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 848w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!o56V!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg" width="1094" height="1117" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1117,&quot;width&quot;:1094,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!o56V!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 424w, https://substackcdn.com/image/fetch/$s_!o56V!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 848w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!o56V!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F872a8ecc-36f7-43f4-ad7d-a4953c4c1b40_1094x1117.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong>What is Knowledge?</strong></h2><p>David Deutsch, the quantum physicist and philosopher, writes in his classic &#8220;The Beginning of Infinity&#8221;:</p><blockquote><p><em><strong>&#8220;Knowledge is information which, when it is physically embodied in a suitable environment, tends to cause itself to remain so.&#8221;</strong></em></p></blockquote><p>Knowledge is embodied in the form of good explanations.</p><p>Deutsch from &#8220;The Beginning of Infinity&#8221; again:</p><blockquote><p><em><strong>&#8220;A good explanation is one that is hard to vary while still accounting for what it purports to account for.&#8221;</strong></em></p></blockquote><p>Good explanatory knowledge tells you something about the world. A good explanation has reach and is hard to vary.</p><p>Knowledge is true information embodied in the physical world.</p><p>For the entire history of Homo sapiens, and perhaps for millions of years before that, humans were the only known entities capable of creating explanatory knowledge.</p><p>That may have changed yesterday.</p><p>Let&#8217;s talk about what happened.</p><h2><strong>The Most Famous Problem in Discrete Geometry</strong></h2><p>The Erd&#337;s problem in question is considered the &#8220;most famous problem in discrete geometry.&#8221; The problem remained unsolved for 80 years, despite plenty of attention.</p><p>I&#8217;m no mathematician, so let OpenAI&#8217;s Sebastien Bubeck explain what this math problem is:</p><blockquote><p><em><strong>&#8220;The question is stupidly simple; if I put n points in the plane how many distances between those points can be the same?&#8221;</strong></em></p></blockquote><p>OpenAI says that an internal, general purpose reasoning model, not specialized for math, disproved this long-standing conjecture. (Let&#8217;s call it GPT-Next, though I&#8217;ve heard it&#8217;s likely GPT-5.6, the next model to be released by OpenAI.)</p><p>Noga Alon, a mathematician who studied Erd&#337;s, said about the Unit Distance problem:</p><blockquote><p><em><strong>&#8220;This has been one of Erd&#337;s&#8217; favorite problems, I have heard him myself mentioning the problem multiple times in his lectures.&#8221;</strong></em></p></blockquote><p>A few reasons it may have been Erd&#337;s&#8217; favorite:</p><ol><li><p>Simple to state. It can be stated in a single sentence: put n points in the plane; how many pairs can be exactly distance 1 apart?</p></li><li><p>Longevity. It was posed by Paul Erd&#337;s in 1946 and stayed alive for 80 years.</p></li><li><p>He cared about it enough to attach a prize. In 1982 he offered $300, and then $500 in 1995.</p></li><li><p>The problem appears simple on the surface, but has a deep mechanism underneath.</p></li><li><p>It was resilient to a solution despite the fact that nearly every geometer thought about it at some point in their career.</p></li></ol><p>You may have seen recent news about Erd&#337;s problems solved with AI&#8217;s help. This one is different.</p><h2>More than another Math win for AI</h2><p>A string of Erd&#337;s problems have recently been resolved with AI&#8217;s help.</p><ul><li><p>GPT-5.2 Pro + Aristotle/Lean solved <a href="https://arxiv.org/abs/2601.07421">Erd&#337;s problem #728</a>. That was a narrower number theory problem.</p></li><li><p><a href="https://arxiv.org/abs/2603.28636">Erd&#337;s Problem #650</a> was <em><strong>AI-Assisted</strong></em>. ChatGPT proposed the proof, then human Mathematicians and Aristotle formalized it.</p></li><li><p>Terrence Tao has a comprehensive <a href="https://github.com/teorth/erdosproblems">GitHub Erd&#337;s AI</a> wiki that lists many contributions AI has made to these problems.</p></li></ul><p>This time is different.</p><p>The unit distance problem is central and famous in discrete geometry. This is qualitatively different from past successes.</p><p>The earlier AI-assisted Erd&#337;s results were like holding your child&#8217;s hand while they learned to walk.</p><blockquote><p><em><strong>This time,</strong></em> <em><strong>your child lets go and takes its first independent steps.</strong></em> </p></blockquote><h2>What the AI model actually did</h2><p>OpenAI frames this model as a &#8220;general-purpose reasoning model&#8221;. It is not trained specifically for math. It did not solve the problem within a larger system specialized for math.</p><p>It was given the problem. It reasoned about it. It disproved the existing conjecture.</p><p>Sebastien Bubeck:</p><blockquote><p><em><strong>Basically what the AI did is that it was able to use its vast knowledge of all of mathematics, to see a connection between discrete geometry and algebraic number theory, and then crucially it was able to masterfully chain together the argument, with expert level calculations at every step.</strong></em></p></blockquote><p>Noam Brown of OpenAI clarifies further:</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/polynoamial/status/2057179104315670826?s=20&quot;,&quot;full_text&quot;:&quot;This is a general-purpose LLM. It wasn&#8217;t targeted at this problem or even at mathematics. Also, it&#8217;s not a scaffold. We have not pushed this model to the limit on open problems. Our focus is to get it out quickly so that everyone can use it for themselves. &quot;,&quot;username&quot;:&quot;polynoamial&quot;,&quot;name&quot;:&quot;Noam Brown&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1872883170292457472/8ywVGO5M_normal.jpg&quot;,&quot;date&quot;:&quot;2026-05-20T19:18:13.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HIyRC5xW8AA2KK0.jpg&quot;,&quot;link_url&quot;:&quot;https://t.co/J8N8epiafV&quot;}],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:38,&quot;retweet_count&quot;:70,&quot;like_count&quot;:994,&quot;impression_count&quot;:235727,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;video_preview_media_key&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>This is the key point: an artificial intelligence system added to the corpus of objective human knowledge. </p><p><em><strong>The AI model did that by relying on its own cognitive capabilities.</strong></em></p><h2>Experts React</h2><p>From OpenAI&#8217;s announcement:</p><blockquote><p><em><strong>&#8220;an AI system has autonomously resolved a longstanding open problem at the center of an active field.&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://openai.com/index/model-disproves-discrete-geometry-conjecture/">OpenAI, &#8220;An OpenAI model has disproved a central conjecture in discrete geometry&#8221;</a></strong></p><p>From Noga Alon:</p><blockquote><p><em><strong>&#8220;outstanding achievement&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 3: Noga Alon</a></strong></p><p>From Thomas Bloom:</p><blockquote><p><em><strong>&#8220;taught us something new&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 4: Thomas Bloom</a></strong></p><p>From Daniel Litt:</p><blockquote><p><em><strong>&#8220;vast expansion of the attention aimed at mathematical problems&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 6: Daniel Litt</a></strong></p><p>From Timothy Gowers:</p><blockquote><p><em><strong>&#8220;No previous AI-generated proof has come close to that.&#8221;</strong></em></p></blockquote><p>Source: <strong><a href="https://arxiv.org/html/2605.20695v1">arXiv companion remarks, Section 5: W. T. Gowers</a></strong></p><p><strong>Watch this video</strong>. The astonishment is palpable.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;89f8eb0b-42fe-4b87-b4c6-d8c08fdee83d&quot;,&quot;duration&quot;:null}"></div><h2>The Philosophical Atom</h2><p>The main point of this essay is this:</p><blockquote><p><em><strong>The</strong></em> <em><strong>philosophical</strong></em> <em><strong>splitting</strong></em> <em><strong>of</strong></em> <em><strong>the</strong></em> <em><strong>atom</strong></em> <em><strong>is</strong></em> <em><strong>AI&#8217;s</strong></em> <em><strong>ability</strong></em> <em><strong>to</strong></em> <em><strong>create</strong></em> <em><strong>new</strong></em> <em><strong>explanatory</strong></em> <em><strong>knowledge.</strong></em> <em><strong>This,</strong></em> <em><strong>for</strong></em> <em><strong>the</strong></em> <em><strong>first</strong></em> <em><strong>time</strong></em> <em><strong>in</strong></em> <em><strong>history,</strong></em> <em><strong>has</strong></em> <em><strong>happened.</strong></em></p></blockquote><p>Evolution has brought us to the point where we can unlock the power of knowledge itself, much as splitting the atom unlocked the power of matter.</p><p>Sebastien Bubeck was careful to explain that this result does <em><strong>not</strong></em> represent &#8220;inventing new mathematics&#8221;:</p><blockquote><p><em><strong>It is truly a breakthrough result, yet at the same time it is also true that the model didn&#8217;t &#8220;invent&#8221; any &#8220;new mathematics&#8221;.</strong></em></p><p><em><strong>But this is the crucial point: merely being able to know deeply all the results in a scientific field, and being able to use all known arguments expertly and with just the right choice of parameters, that alone can lead to a ton of breakthroughs, and this is not just limited to mathematics, this type of (extremely) solid expert execution is the bread and butter of many many scientific advances.</strong></em></p></blockquote><p>Still, this <em><strong>is</strong></em> an example of artificial intelligence independently adding to the corpus of objective truth available to humanity. This is only the beginning. The consequences will be world-changing.</p><h2>Why Math Came First</h2><p>Mathematics is the ideal domain for AI. It is abstract and correct answers are verifiable.</p><p>That does not mean it&#8217;s the only domain where AI can make new discoveries. It&#8217;s the scientific domain where it&#8217;s easiest for AI to get started. But we are <em><strong>just</strong></em> getting started.</p><p>In my essay &#8220;<a href="https://attentionheads.substack.com/p/something-big-is-happening-its-bigger?r=2057tt">Something Big is Happening. It&#8217;s Bigger than You Think</a>&#8221; I argued that the implications of rapid AI progress are farther reaching than most realize. Claude Mythos for example is doing unprecedented things when it comes to Cybersecurity. Mythos was also not trained specifically for Cybersecurity.</p><p>Even if you do not care much for math, I am in that boat too, results like this will reach far beyond mathematics.</p><h2>Beyond Mathematics</h2><p>Theoretical scientific fields are the next intellectual dominoes to fall.</p><p>Think:</p><ul><li><p>Theoretical Physics</p></li><li><p>Theoretical Biology</p></li><li><p>Chemistry</p></li><li><p>Materials Science</p></li><li><p>Computer Science</p></li></ul><p>These are domains where AI can operate disembodied, in the realm of abstract information. If you do not visit that world often, you may miss how much power exists there.</p><p>Many modern technological breakthroughs began as discoveries in theoretical science. The internet in your pocket is one example.</p><p>Theoretical science is one of humanity&#8217;s most important handles on reality. It&#8217;s what distinguishes us from other animals. We can use our mind to understand and harness reality. AI just began to assist us in that.</p><p><em><strong>It</strong></em> <em><strong>is</strong></em> <em><strong>only</strong></em> <em><strong>the</strong></em> <em><strong>beginning.</strong></em></p><p>A model that can apply sustained attention across long durations will be a force multiplier for creating knowledge. Knowledge that can empower humanity to reach further. To live longer. To go deeper into the wonders of nature. To benefit the world.</p><p>It won&#8217;t stop with the theoretical either. Right now it&#8217;s hard for AI to make as substantial an impact on the physical world. That&#8217;s because we don&#8217;t have fully functioning robots yet. They are coming. Once AI has a body that can act on the world and run experiments in atomic space, the impact it will have will become even more powerful.</p><h2>The Beginning of Infinity</h2><p>This result from OpenAI is not &#8220;the end&#8221; of discovery or the arrival of final knowledge.</p><p>On the contrary, it is a new beginning: a new kind of knowledge-creating process entering the world.</p><p>As David Deutsch says:</p><blockquote><p><em><strong>&#8220;We</strong></em> <em><strong>are</strong></em> <em><strong>always</strong></em> <em><strong>at</strong></em> <em><strong>the</strong></em> <em><strong>beginning</strong></em> <em><strong>of</strong></em> <em><strong>infinity.&#8221;</strong></em></p></blockquote><p>Happy to be here with you.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>Sources:</h2><ul><li><p><strong><a href="https://openai.com/index/model-disproves-discrete-geometry-conjecture/">OpenAI announcement, May 20, 2026</a></strong></p></li><li><p><strong><a href="https://arxiv.org/html/2605.20695v1">Companion remarks on arXiv</a></strong></p></li><li><p><strong><a href="https://x.com/SebastienBubeck/status/2057187978720719114?s=20">Sebastian Bubeck&#8217;s X Article</a></strong></p></li></ul>]]></content:encoded></item><item><title><![CDATA[Demis Hassabis and the Long Game of AGI]]></title><description><![CDATA[A brief review of "The Infinity Machine" by Sebastian Mallaby]]></description><link>https://www.attentionheads.blog/p/demis-hassabis-and-the-long-game</link><guid isPermaLink="false">https://www.attentionheads.blog/p/demis-hassabis-and-the-long-game</guid><dc:creator><![CDATA[Dan McAteer]]></dc:creator><pubDate>Mon, 18 May 2026 01:57:34 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!NbAu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NbAu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NbAu!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NbAu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg" width="795" height="1200" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1200,&quot;width&quot;:795,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:224628,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://attentionheads.substack.com/i/198201291?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NbAu!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NbAu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2a1a168-f392-49ac-acb7-1da918bceaa5_795x1200.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I picked up (as an audiobook) <em><strong>&#8220;The</strong></em> <em><strong>Infinity</strong></em> <em><strong>Machine&#8221;</strong></em> by Sebastian Mallaby expecting a straightforward biography about Demis Hassabis. What I got instead was a portrait of a particular kind of ambition: not the desire to dominate a market, but the desire to understand intelligence itself, build it, and turn it back toward the mysteries of nature.</p><p>My brief review: this is worth reading if you want to understand DeepMind not just as an AI lab, but as the expression of one person&#8217;s unusually coherent theory of intelligence, games, science, and progress. The book weaves a thread from Demis&#8217; childhood to DeepMind today. The constant is his desire to unlock the mysteries of life with technology.</p><p>One detail from the book that crystallized this for me was the AlphaFold breakthrough. Demis was quoted as saying that science is the one field where AI can be completely positive. It&#8217;s obvious that Demis is interested in unlocking the mysteries of life.</p><h3>What stuck with me</h3><p>I got the impression that Demis is not in the race for power, money, or fame. None of the usual big tech trophies seem to be the point. He wants to build AI because he believes it is the most important thing to build for humanity. To the extent he uses power or influence, it seems to be as an instrument for a more transcendent aim.</p><p>The other AI lab leaders all say they want to benefit humanity. With Demis, I actually believe it&#8217;s more than talk.</p><p>Demis is a true believer in the idea that Turing machines can take us all the way to AGI. That we don&#8217;t need anything more than the very classical machine that Turing invented in 1936.</p><p>It&#8217;s a testament to his character that many of the colleagues who are by his side today, have remained by his side since the college days.</p><h3>The tension</h3><p>The central tension I felt is that DeepMind understands the gravity of its place in the world, but it still sits inside one of the most powerful commercial institutions on earth. The scientific ambition is to build safe AGI and use it to accelerate discovery. The corporate reality is Google: scale, competition, product pressure, and shareholders.</p><p>That is the drama the book left me sitting with: can a lab with genuinely scientific and humanitarian aims stay oriented toward those aims when it is embedded inside one of the most successful businesses of all time? This is what Elon and Sam Altman claim they were worried about when they started OpenAI.</p><p>And yet, I did not get the sense that Demis regretted joining Google. The resources mattered. The distribution mattered. The bargain may have been necessary. But it is still a bargain, and the consequences of that bargain become larger as the systems become more powerful.</p><h3>Who should read it</h3><p>I&#8217;d recommend it to anyone trying to understand the AI race beyond product launches, benchmark charts, and company drama. It is especially useful for builders who want to study long-term taste, institutional patience, and obsession with first principles. I would also recommend it to skeptics who assume every AI leader is motivated by money or power. The book does not remove every concern, but it makes Demis&#8217; ambition legible.</p><h3>Closing</h3><p>By the end, I understood why Demis and DeepMind can feel like they have the &#8220;mandate of heaven.&#8221; If someone is going to build toward AGI, you could do much worse than Demis Hassabis. But that is also the strange problem of this era. So much of the future may depend not only on capabilities, but on the character of the people and institutions building them. DeepMind may still be in as good a position as anyone to win the race. The world may be lucky if it does.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.attentionheads.blog/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Attention Heads is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item></channel></rss>