Skip to main content
Main Series · TAM_003

The Irrational Quest — Summary

Summary Read the full essay.

We chase impossible dreams. We hold contradictory beliefs. We want everything at once, knowing we cannot have it. This is not a bug in human cognition. It is a feature, and it poses a fundamental challenge to approximating human understanding in AI.

Three quests define the pattern. The quest for omniscience: spending three hours researching which coffee maker to buy long after the marginal value of information has collapsed to zero, because exhaustive research feels productive and because if the decision is data-driven, you escape responsibility for it. The quest for omnipotence: starting seven projects simultaneously because each beginning feels possible, before reality arrives. The quest for omnivalence: wanting deep commitment and complete freedom, security and risk, simultaneously, refusing the premise that choosing is necessary.

These patterns persist because they serve real needs. Omniscience protects against regret. Omnipotence protects self-image. Omnivalence protects against loss, against the grief of closing off the paths not taken.

An AI optimizing decisions under uncertainty would never exhibit these patterns. It would stop researching when marginal gains fall below marginal costs. It would allocate resources efficiently. It would recognize value conflicts and make tradeoffs. It would, in other words, be rational. And in being rational, it would miss something essential about what it means to be a meaning-making creature who refuses to fully accept being bounded.

AI will never fully understand humans because humans are not fully predictable — not because they are random, but because they are fundamentally contradictory in ways that resist modeling. This is not a problem to solve. It is a fact to accept.