This is a critical economic shift. The reason lies in the sharp price increase for HBM memory chips and a shortage of production capacity. Wall Street had factored a decrease in token generation costs into its financial models as algorithms became optimized, but hardware inflation has eaten up that difference. For hyperscalers, this means immense pressure on margins: they will not be able to subsidize B2B clients indefinitely. The economics of AI is paradoxically becoming more complex—the dropping cost of API requests is rigidly offset by the record cost of the hardware needed to process them.
Source: Nvidia / Bloomberg News
HardwareNVIDIAPricingCAPEXMacroeconomics