CompCert

The Myth of the Unavoidable Bug Most users experience software as something that "just works" until it suddenly doesn't. For the person using a banking app or a camera, a bug is a fleeting frustration. For the developer, however, bugs are a source of constant atmospheric pressure—a reality of on-call rotations, pager alerts, and the relentless creep of technical debt. We have conditioned ourselves to believe that perfection is impossible, citing millions of lines of code, ambiguous specifications, and the sheer unpredictability of the physical world. Johann Schleier-Smith from Temporal Technologies challenges this defeatist status quo. He argues that the industry already knows how to build Zero-Bug Software. The methodologies have existed for decades, tucked away in the high-stakes corridors of aerospace and medical engineering. The primary barrier has never been a lack of knowledge; it has been the crushing weight of economics. High-assurance software traditionally costs upwards of $2,500 per line of code, a price point that renders it inaccessible for 99% of commercial applications. We are now entering an era where AI agents could bridge this 100x cost gap, making aerospace-grade reliability the default for every digital interaction. Lessons from the Flight Deck and Deep Space The Airbus A320 stands as a monument to what is possible when the industry rejects defect tolerance. Its control software, developed in the 1980s, has never been implicated in a serious flight incident. This wasn't achieved through luck, but through a rigorous adherence to N-version programming: separate teams using different processors (Intel x86 versus Motorola) and distinct operating systems to ensure that a single logic error couldn't bring down the aircraft. Similarly, NASA demonstrated near-perfection with the Space Shuttle program. Over its final versions, the software averaged only one error per 420,000 lines of code. This level of precision is roughly 1,000 times more reliable than typical commercial software. These systems prioritize static memory allocation, explicit error handling, and the total decoupling of verification teams from development teams. While critics argue that such processes stifle innovation, the data suggests that quality through process is the only proven path to absolute reliability. The Three Pillars of Manageable Complexity To understand how we move toward zero bugs, we must revisit the foundation of computer science. The first pillar is the high-level language. By moving away from assembly in the 1950s and 60s, we gained a 10x productivity boost by abstracting machine implementation details like registers and memory layout. This allows us to focus on "essential complexity"—the logic of the problem itself—rather than the quirks of the hardware. Edgar Dijkstra introduced the second pillar: structured programming. By eliminating the "go-to" statement and replacing it with sequences, selections, and iterations, developers gained the ability to use compositional reasoning. This means you can understand a block of code by looking at its immediate context rather than tracing a tangled web of jumps. Finally, David Parnas gave us modularity. Modularity allows for local reasoning, ensuring that as systems grow, the complexity scales linearly rather than exponentially. These three pillars are not just historical footnotes; they are the exact features that make code interpretable for Large Language Models (LLMs) today. Formal Methods and the Power of Proof While testing only proves the presence of bugs, formal methods can prove their absence. Languages like Daphne allow developers to write proofs directly alongside their code. When you run a verifier, it uses automated reasoning to ensure that every assertion holds true across all possible execution paths. We are seeing a renaissance in these techniques. The seL4 microkernel is a fully verified operating system used in security-critical applications. The CompCert compiler is a verified C compiler that guarantees the generated machine code exactly matches the source program’s intent. Even the Internet itself is increasingly protected by Project Everest, which provides verified cryptographic libraries. The speed and success rates of these verification tools have improved by orders of magnitude over the last 20 years, turning what was once a theoretical academic exercise into a commercially viable toolset. Engineering the Agentic Future The rise of Agentic Coding introduces a paradox. While LLMs are non-deterministic and prone to hallucinations, they possess a unique resilience: the ability to handle ambiguity and unanticipated inputs that would crash traditional rigid software. The key to "Software 3.0"—as Andrej Karpathy calls it—is applying old high-assurance processes to new AI workflows. Instead of asking an LLM to just "write code," we should be prompting it to conduct explicit risk analysis and write "safety cases" for its logic. We can emulate the Airbus model by using one foundation model (like GPT-4) to write the tests and another (Claude) to write the code. When agents are tasked with verifying their own work through formal methods, the cost of high-assurance code plummets. Schleier-Smith notes that while human-written high-assurance code costs $2,500 per line, agent-generated code can be produced for pennies. This 10,000x reduction in cost is the catalyst for the zero-bug vision. Once agents routinely produce software with fewer defects than humans, adoption will reach a point of absolute takeoff, fundamentally altering our expectations of what software can—and should—be.