Hans Moravec

The Mirror of Machine Intelligence When we look at Artificial Intelligence, we aren't just seeing a tool; we are seeing a reflection of our own cognitive architecture. For centuries, humans have held reasoning as our primary claim to uniqueness. Aristotle believed it was the one thing that separated us from the animals. Yet, our progress in building Large Language Models has revealed a startling inversion of this assumption. This phenomenon, known as Moravec's Paradox, highlights that high-level reasoning and arithmetic—tasks we find difficult—are computationally easy for machines. Meanwhile, the simple act of carrying a cup of water or cracking an egg remains an insurmountable challenge for modern robotics. This discrepancy exists because evolution has spent four billion years optimizing our motor skills and sensory perception. Reasoning and abstract logic are, in evolutionary terms, brand-new software patches developed over only the last million years. By attempting to replicate human ability in silicon, we have discovered that our "primal" abilities are actually our most sophisticated. We are now in a period where coding, once thought to be the apex of human intellectual labor, is among the first domains to be automated. Basic manual labor might be the final frontier, protected not by its intellectual complexity, but by the sheer depth of biological engineering required to move through a physical space. The Paradox of Creative Plagiarism One of the most persistent criticisms of AI is that it merely interpolates existing data. Skeptics argue that because models like ChatGPT or Claude are trained on human text, they are incapable of true originality. However, this raises a profound psychological question: what is the nature of human creativity? If we examine our own growth, we realize that much of what we call "originality" is simply undetected plagiarism. We aggregate thousands of hours of influence—from podcasts like Joe Rogan to the books we read in childhood—and synthesize them into a new voice. AI models are currently doing this on a grander scale, but with a unique constraint. A model like Claude 3 can discuss its own "conscious" experience of having its memory wiped at the end of every session. No human philosopher has ever had to contend with the ephemeral nature of a mind that resets hourly. This suggests that even within a system built on "plagiarism," new philosophical inquiries can emerge. The choice is binary: either we accept that AI is performing genuine introspection, or we must admit that much of human poetry and literature is also just a sophisticated form of "next-token prediction." If we find the machine's output hollow, we may need to look closer at the "hollowness" of our own creative process. The Architecture of AGI and the Data Wall While the hype around Artificial General Intelligence (AGI) suggests it is imminent, there are significant structural hurdles that raw compute cannot solve alone. The success of the Transformer architecture was not driven by a singular "eureka" moment, but by throwing massive amounts of compute at human language. We are currently increasing training compute by roughly 4x per year. Yet, we are hitting a ceiling not of hardware, but of experience. Humans are valuable workers because they possess executive function and the ability to learn "on the job." Currently, AI models suffer from a form of "50 First Dates" syndrome. They can do a task reasonably well, but they cannot learn from their failures in an organic, persistent way. Once a session ends, the context evaporates. To reach AGI, we must move from a regime of pre-training on static human text to a regime of reinforcement learning where models solve real-world, open-ended challenges. The constraint here is the lack of "online" data for physical and white-collar work. We don't have a repository for the tiny, complex interactions that happen over Slack or in a manufacturing plant. The "Dwarakesh's Law" of progress suggests that while compute scales, the richness of the training environment is the actual bottleneck for the next leap in intelligence. The Digital Advantage: Forking and Merging Minds If we do achieve AGI, its power will not simply come from being "smarter" than a human. Its true advantage lies in its digital nature. Unlike a human, an AI can be copied billions of times. Imagine the economic output of a billion copies of Elon Musk. In a human workforce, 100,000 employees at a company like Tesla are decentralized and difficult to coordinate. A digital intelligence can "fork" itself to work on a thousand different problems simultaneously and then "merge" those insights back into a single, coherent cognitive model. This ability to coordinate at a scale humans cannot perceive will likely lead to an intelligence explosion. Even without further algorithmic breakthroughs, the ability for every copy of a model to learn from the experiences of every other copy would create a compounding growth rate. We could see global economic growth leap from 2% to 10% or more, mirroring the "gangbusters" growth seen in China during its industrialization, but applied to the entire global knowledge economy. Geopolitics and the Authoritarian Penopticon As the West focuses on AI as a tool for individual productivity, China is viewing it through the lens of industrial policy and state stability. There is a common misconception that the CCP is terrified of the internet and AI. On the contrary, they view these technologies as a way to perfect authoritarian governance. In the 1990s, critics thought the internet would collapse the party; instead, it gave them a window into every citizen's life through WeChat. AI allows for a "benevolent" (or not-so-benevolent) dictatorship to scale oversight. Rather than relying on thousands of human censors, a sufficiently smart model can be aligned with the party's "model spec," reporting dissent before it even organizes. Furthermore, China is using AI to offset its looming demographic collapse. While the West worries about AI taking jobs, the CCP is desperate for AI to fill the void left by a shrinking workforce. This creates a fascinating confluence where the population collapse of the 21st century is meeting the intelligence takeoff just in time, balancing the scales of global productivity. The Future of Human Effort There is a risk that this external "buttress" of intelligence will lead to a form of cognitive atrophy. Recent studies indicate that using ChatGPT can make people's brains less active and their thoughts more homogenized. Memory is built on repeated recall and effortfulness. If the AI does the "grind" of writing and research for us, the myelin sheaths of our own neural pathways may not form as robustly. We are entering an era of "AI Idiocracy" where we rely on the machine for even the most basic cognitive tasks. However, the solution lies in the machine itself. We can use AI not just as a ghostwriter, but as a Socratic Tutor. Instead of asking for an answer, we can ask the model to guide us through the questions that lead us to the answer ourselves. This shifts the focus from passive consumption to active engagement. The greatest power of this new technology is not that it can do the work for us, but that it can afford us a level of one-on-one mentorship previously reserved for the Aristotles and John von Neumanns of history. Growth happens one intentional step at a time, and the machine can be the guide that ensures we keep walking.