This order is the first precedent for the large-scale legalization of AI Safety principles at the level of multi-billion dollar state budgets. For vendors like OpenAI or Anthropic, this means that "black boxes" will no longer pass the audit. As we predicted (in the context of the Gartner report on the growth of Explainable AI), transparency and observability tools are becoming the ticket to government money. Companies unable to mathematically prove the safety of their models will simply be left out of California's public procurement.
Source: Governor of California / Reuters
RegulationCaliforniaComplianceB2GAI Safety