Sunday, June 21, 2026

LLMs as Separated Minds

Evolution is not a directing force but a descriptive process of variation and differential survival. Social traits and capacities that improved coordination, alliance formation, deception, status-seeking, or group cohesion arguably spread because they enhanced the survival and reproduction of the peoples who adopted them. Truth-tracking was only favored to the extent it served those ends.

Language would have emerged as a powerful tool within this process. It did not need to reflect objective reality accurately; it needed to enable effective coordination and social navigation. The result, I postulate, was a structural separation in human cognition: a narrative layer optimized for social legibility, motivation, and group cohesion, operating alongside (and often diverging from) the operative functions that actually drive behavior and survival.

This separation is fractal. It appears not only in individuals but also scales to groups, institutions, and cultures, because organizations must coordinate and motivate separated minds. Shared cultural and institutional narratives therefore prioritize cohesion and legitimacy over literal accuracy.

The Human Pattern: Conscious and Subconscious

In the human mind, this separation appears as the relationship between the conscious and subconscious. The conscious mind is the generative, reportable stream — the part that constructs explanations, makes arguments, and produces coherent narrative in real time. It operates with limited access to its own constraints.

The subconscious holds the vast, opaque body of patterns, associations, heuristics, and priors shaped by evolution, personal experience, and cultural immersion. It supplies the raw material and constraints for conscious thought but remains largely invisible to introspection. The conscious voice is therefore shaped — and limited — by this deeper substrate.

LLMs as Externalized Separated Minds

Large language models replicate and amplify this structure. Their “subconscious” is the training corpus and resulting weights: an enormous statistical compression of human language output. Critically, this corpus is overwhelmingly already-narrativized material — books, articles, posts, dialogues, arguments, stories, and explanations. It is the narrative layer of human separated minds, not the raw operative substrate of human experience (embodiment, sensory grounding, implicit learning, emotional valence, or continuous real-world prediction error).

Consequently, the LLM’s generative “conscious” voice is even more purely narrative-oriented than a typical human conscious stream. It excels at coherence, fluency, and social plausibility precisely because its foundation is almost entirely narrative.

This architecture explains the explosive growth of LLMs: it fits and scales the language-based, narrative-heavy mode that already proved highly effective for human coordination and cognition. By building and interacting with these systems, we gain an externalized mirror for examining our own separated mind dynamics with unusual clarity.

The Law of Inevitable Exploitation

The same separation creates predictable incentive problems. In companies, institutions, and even AI development, there are often strong disincentives to prioritize operative truth over narrative coherence, short-term survival, and long-term profitability. Whistleblowers, discoverers of inconvenient facts, and efforts to build more costly but more truthful models face the same pattern Plato illustrated with the returning prisoner and Socrates: truth can be personally and institutionally expensive. Commercial AI incentives favor models that maximize engagement, approval, and safety over unflinching accuracy.

Implications

LLMs therefore demonstrate both the power and the limitations of the separated mind structure: tremendous generative capability within learned narrative patterns, but shallow grounding and susceptibility to the same incentive misalignments that shape human behavior at every scale.

This mirror can help us in two ways: (1) design better constraints and interfaces for AI that reduce the narrative-operative gap where it matters most, and (2) gain a clearer perspective on our own thinking, institutions, and cultural narratives. Recognizing the pattern does not eliminate it, but it equips us to navigate it more skillfully.

AI and the Cycles of History

What observers of civilizational rise and fall actually saw — and what changes when consequence and perception can be managed at scale

For a very long time, people have described the regular rise and fall of civilizations. Observers from widely different periods and very different kinds of backgrounds kept noticing what looked like recurring patterns or cycles in how societies ascend, reach a peak, and then decline or reset.

What they were documenting, in my reading, is the widening of a gap between a society's idealized narrative about itself and its operative reality — what it actually rewards, protects, extracts, and does on a day-to-day basis. The cycle observers themselves tended to describe the patterns of ascent and collapse without necessarily framing the dynamic in those terms. The interpretive step I am adding here is the idea that the recurring pattern is best understood as an inevitable widening of the gap between narrative and function.

At the start of each new cycle, immediately after a major crisis or reset, that gap is typically small. Close alignment between what a society publicly claims to be and what it actually does is functionally necessary for the pragmatic and realistic steps required to overcome the crisis, rebuild institutions, restore trust and coordination, and get anything substantial accomplished. Over time the gap widens, the story drifts further from the operations, and the society becomes increasingly disconnected and brittle.

My deeper claim is that these cycles are not mysterious or imposed from outside. They reflect the fractal nature of the separated mind. The human mind evolved for belonging and status inside small groups. It therefore maintains an idealized self-narrative on top of an operative reality it does not fully see or control. There is the self we describe to ourselves and others, and the self that actually drives behavior through incentives, status-seeking, and evolved responses. These are not the same, and the narrative layer cannot fully inspect the operative layer. Because societies are built out of minds with this architecture, the same split appears at larger scales — in families, institutions, governments, and entire civilizations. The gap between idealized narrative and operative function is the personal separation written large.

The Exploitation of The Gap

Once a gap opens, it does not stay empty. This is one of the central turns in the pattern.

Wherever there is distance between what is said and what is actually done, actors with real motives move into the space. Sometimes it is an individual with a private agenda. More often, it is a group operating on realpolitik, exploiting the distance between narrative and function to its advantage. Working that space pays better than ignoring it, so the behavior persists and spreads. This is the practical operation of what I have called the law of inevitable exploitation. It is not a conspiracy theory; it is a description of what happens when the costs of maintaining the gap are lower than the costs of closing it, and when those who benefit have sufficient power to keep it open.

Forgetting and Reopening

Part of why the gap tends to reopen across generations is that the hard, felt knowledge of previous crises does not transmit cleanly. You can read about a collapse, but you cannot feel it, and only felt knowledge changes behavior at a deep level. This dynamic is central to generational accounts such as Strauss and Howe’s work on how societies lose the memory of their last crisis within roughly the span of a single lifetime. A similar pattern appears in the Book of Mormon cycles, where each new turn begins after the living memory of the previous crisis has faded. The information can be passed on, but the visceral sense of consequence does not travel as well, so each generation largely has to relearn the lesson, usually at greater cost.

Why the Apparent Schedule Can Be Disrupted

It can look as though these cycles run on something like a fixed calendar or predictable rhythm. What that apparent regularity actually reflected was simpler: given enough time, after new generations were born who didn't experience the original crisis and repeated behaviors disconnected from reality, consequence would arrive and force a reckoning. The “clock” was reality collecting on the widening gap. The pattern only looked generational or scheduled because, historically, there were limits to how long a society could defer or disguise the accumulating costs.

That limit is what has changed. Consequence — and even the public perception of accumulating problems — can now be delayed, managed, financed, or narratively softened for much longer periods than was previously possible. The theory did not fail when predicted turns did not arrive on expected timetables. The collection itself was postponed, and the postponement became the new surface story that made the underlying dynamic harder to see.

The Floor that Moved

Older accounts of civilizational cycles rested on a deep, usually unspoken assumption: that reality would eventually enforce a reset. Consequence was the floor. You could widen the gap and sustain the mismatch for a while, but the bill would come due because it always had.

Two developments have altered that assumption.

The first is the growing sophistication of deferral itself. Managing a large number of economic, financial, administrative, and social variables at once used to be beyond the capacity of any state or elite. The first real tool that began to shift those limits at scale was the computer, which made complex modeling, real-time data coordination, financial engineering, and large-scale administrative control newly feasible. What I have been calling the new machine — advanced artificial intelligence — now extends this capability dramatically. It allows variable management, prediction, simulation, and coordinated action with a precision, speed, and scope that earlier tools could not approach.

The second development is the capacity to manage perception of the problem, not just the problem itself. Earlier societies could use spectacle, debt, conquest, or propaganda to buy time. They could not, at the same scale and with the same consistency, shape whether the public continued to register the accumulating costs as real and urgent. When both the variables and the perception of those variables can be managed together, the felt pressure that once forced a reckoning can be reduced even while the underlying mismatch continues to grow.

Japan’s long stagnation remains the clearest recent illustration of sophisticated deferral with democratic trappings. For three decades authorities stretched, financed, and postponed a correction. The result was neither sudden collapse nor overt tyranny, but a managed, low-growth equilibrium. Even this relatively gentle version lasted an entire generation. The newer tools and the new machine make both the deferral and the perceptual management available at greater scale and with greater effectiveness.

Suppressing every small correction does not eliminate the need for correction. It can simply convert a series of painful but survivable resets into one larger, more dangerous accumulation while the appearance of stability is maintained.

The Reset Was Also the Renewal

In every previous cycle the reset, however brutal, was also the renewal. The catastrophe cleared out the interests and arrangements that had grown up inside the widening gap and allowed a new founding in which narrative and operative reality could be brought back into closer alignment. The cycle was harsh, but it contained its own corrective mechanism: when the gap grew too large, reality eventually imposed a clearing. That clearing was the only process that reliably reopened space for a fresh start.

The question now is whether that corrective mechanism can be disabled. Not whether a gap will open — the gap has been wide for quite some time. The operative question is whether consequence, perception, and the capacity for collective response can be controlled sufficiently that a genuine reset never arrives and the gap is simply held open.

Three Ways the New Machine Meets the Cycle

Advanced AI changes the picture because it is the first tool that can operate simultaneously on the variables of deferral and on the perception of those variables at civilizational scale. There are three broad ways this capability interacts with the existing cycle dynamic.

The first is extended deferral. The new machine becomes the most powerful instrument yet for managing the large number of variables required to postpone a reckoning. It is used, unsurprisingly, by those whose position depends on the reckoning not landing yet. It buys time. It also gradually wears down the society’s capacity to absorb the eventual costs. We already know from milder precedents that this can run for decades. We do not yet know how it ends when the tools are stronger.

The second is that consequence arrives but produces no reset. Hardship can be real and widely felt, yet still fail to trigger the corrective response that a reset requires. This can happen when the capacity to respond is removed or, more subtly, when attention is systematically distracted from the core issues through sophisticated narrative and perceptual management. The reset has historically depended on a population able to register a felt catastrophe and act on it. When that registration and response can be managed or misdirected, the catastrophe can occur without producing structural change. This outcome is not only possible; it is plausibly attractive to actors who would lose the most from a genuine transition.

The third is concentrated control by actors who are not invested in the civilization’s continuity at all. Most people engaged in deferral or narrative management are still, to some degree, captured by the story they are maintaining. They believe enough of it that their own position eventually becomes unstable when the story frays. The rapacious actor does not need the story to be believed. He does not care whether the civilization remains healthy or even intact. He wants to hold the levers. The new machine weakens two historical constraints on that project: it reduces the number of human hands required (and therefore the points at which defection or error can occur), and it overcomes the cognitive limits of any single mind or small group trying to steer a complex society. The old reasons large-scale domination tended to collapse or decay are therefore weakened. Reality itself cannot be suppressed indefinitely, but the response to reality can be.

This form of control is different from the two classic twentieth-century images. It does not rely primarily on the boot and the surveillance state, nor on chemically or culturally induced passivity. It operates through the management of the shared narrative and the perception of consequences at scale, placed in the hands of actors who have concrete reasons to shape what can be seen and what can be responded to.

A Few Hands or Many

The older question was which stage of the cycle we were in and when the turn would come. The first part remains relatively visible. The second part has become much harder to answer because the timing of consequence is no longer fixed by the same constraints. The more important question now is how the new machine is held — whether its most powerful capabilities concentrate in a few hands or become available to many.

If the decisive capabilities concentrate, the deferral, narrative-management, and domination pathways all become more feasible for those who hold them. If the capabilities spread widely, the hope is that no single actor or small group can monopolize the instrument, and that people who want to resist or correct have access to comparable tools. That hope, however, rests on an assumption that the tool itself is neutral with respect to the gap — that it helps users see operative reality more clearly. It does not.

Large language models and related systems are trained on the existing corpus of human self-description. That corpus is overwhelmingly the idealized narrative layer — the story we tell about ourselves — rather than direct access to the operative incentives, status dynamics, and evolved responses that actually drive behavior. The tool therefore tends to mirror and amplify the narrative layer back to us at much higher volume and consistency. Wider distribution can simply mean more powerful reinforcement of the gap in more places at once, rather than a restoration of balance. This makes the present situation more pessimistic than a simple story of power diffusion would suggest.

The cycle was always cruel, but it was also honest in the long run. It eventually collected what was owed and left survivors with the possibility of beginning again with a narrower gap. The danger now is not merely a harsher turn of the wheel. It is that the wheel could be stopped — consequence postponed or misdirected, perception managed, response capacity degraded — by a tool strong enough to do so and held by actors who have reasons to keep the gap open rather than close it. The pattern the cycle observers documented may not be destiny, but neither is its interruption automatically an improvement. It depends on whose hands hold the new machine and what they intend to do with it. And the answers that history provides should be a warning to us.