The CLAUDE.md Experiment: Quantifying the Cost of AI Context
Overview: The Context Overload Scenario
Technical debt isn't just in your code; it's increasingly found in the metadata feeding your AI agents. This analysis examines an experiment where CLAUDE.md files—markdown documents designed to guide Claude through project-specific rules—were stripped from five distinct Laravel projects. The goal was to determine if these instruction sets provide genuine value or simply act as high-latency noise that bloats token usage and slows down development velocity.
Key Strategic Decisions: Cutting the Cord
The primary move involved a complete removal of CLAUDE.md and AGENTS.md files across varied tech stacks: React, Vue.js, Livewire, Filament, and a standard API. Instead of relying on pre-baked guidelines, the experiment forced the LLM to rely on its internal training and immediate MCP tools like Laravel Boost. This strategy tested the "Zero-Shot" capabilities of modern models against the industry trend of massive context injection.
Performance Breakdown: Speed vs. Precision
The results were immediate and jarring. Without the markdown guidelines, the AI achieved nearly a 2x increase in speed. For the API project, the session was completed in just 73 seconds. Token consumption plummeted, dropping from 31% of the session limit down to a lean 13%. This suggests that large instruction files force the model to "run in circles" to ensure compliance with every minor formatting rule, wasting computational resources on non-functional requirements.
Critical Moments: The Filament Failure
The success streak hit a wall with Filament. While the AI successfully generated working CRUDs for well-known frameworks, it failed on the less ubiquitous Filament admin panel. Without CLAUDE.md to enforce documentation lookups, the model defaulted to outdated version 3 syntax instead of the required version 4. Crucially, the AI skipped running automated tests entirely. This highlights a dangerous blind spot: without explicit enforcement in the context file, agents prioritize speed over verification.
Future Implications: Lean Context Architecture
Blindly deleting your context files is a mistake, but the bloated "slash-init" defaults are clearly suboptimal. The move forward is a Minimalist Context strategy. You must retain two critical directives: test enforcement and documentation lookup triggers. Forcing the agent to verify its own work and consult the latest docs covers the gaps where internal model training fails. Efficiency doesn't come from removing instructions, but from ensuring every line of your CLAUDE.md earns its keep in saved tokens.
I Tried Deleting CLAUDE.md. Here's What Happened.
WatchAI Coding Daily // 15:11
This channel is not for vibe-coders. It's for professional devs who want to use AI as powerful assistant, while still keeping the control of their codebase. My name is Povilas Korop, and I'm passionate about coding with AI. So I started this THIRD YouTube channel, in addition to my other ones Laravel Daily and Filament Daily. You will see a lot of my experiments with AI: I will try new things and share my discoveries along the way.