🛠 contextrot tool for analyzing AI agent degradation
The open-source tool contextrot has been released to analyze the quality degradation of AI agents (such as Claude Code) as the context window fills up. The utility analyzes local session logs, identifying code editing errors, retry loops, and excessive file re-reading.
🌍 It enables a shift from synthetic benchmarks to real-world performance evaluation of agents on actual workloads, revealing the practical limits of long-context performance.
👤 It helps you understand when your AI assistant starts "acting up" due to information overload, and how to effectively manage context to avoid wasting extra tokens and time.
Source 1: https://github.com/Priyanshu-byte-coder/contextrot