The industry has hit hardware limitations. Training models with trillions of parameters requires new memory architectures (HBM), custom interconnects, and photonics. Tech giants and startups are mass-patenting physical solutions to reduce power consumption and increase chip bandwidth. The WIPO report is a direct indicator that the software race for generative models is smoothly transitioning into a hardware war for physical data center infrastructure.
Source: WIPO / AFP
R&DWIPOPatentsSemiconductorsHardware