Researchers Uncover Hidden 'Pyramid' of LLM-API Resales

🔍 Researchers Uncover Hidden 'Pyramid' of LLM-API Resales

A paper on arXiv (2608.20732) introduces CacheTracer: a tool that finds hidden connections between LLM-API resellers by using prefix caching as a side channel — Flood fills the cache, and Prove checks access from another endpoint. Across 1.1 million requests to 39 endpoints, 37.1% of 636 pairs were linked by a shared cache, with nesting up to 7 levels.

🌍 The work gives auditors a reproducible way to verify who is whose upstream without access to infrastructure. A common top-level node is a single point of failure: compromising one could immediately affect many independent services.

👤 When buying model access from an intermediary, remember: a request may pass through several contractors, and each can read and alter traffic. Official APIs or providers with transparent infrastructure are safer.

Source 1: https://arxiv.org/abs/2608.20732 Source 2: https://arxiv.org/pdf/2608.20732