🚀 AI Data Center Capacity is Doubling Every 7 Months
An Epoch AI study shows exponential growth in the computing resources of the largest AI data centers. Since the launch of xAI's Colossus 1 in August 2024, the growth rate has been approximately 3.3x per year.
🌍 Exponential infrastructure growth requires unprecedented amounts of electricity and hardware, such as NVIDIA H100s, which directly dictates the pace of LLM development.
👤 The speed of infrastructure scaling correlates with model progress: current rates imply that qualitative leaps in AI capabilities could occur extremely rapidly.
Source 1: https://epoch.ai/data-insights/largest-data-center-compute