California's legislature is currently considering a bill that aims to regulate powerful artificial intelligence models. Despite concerns that it could stifle innovation, Democratic state senator Scott Wiener of San Francisco, the bill's sponsor, believes that California needs to act in order to address the risks associated with rapidly advancing AI while still promoting innovation. However, critics, including Democratic members of the US Congress, argue that punitive measures against developers in this emerging field could hinder progress. Influential Democratic congresswoman Nancy Pelosi of California voiced her concerns about the bill, stating that while they want to protect consumers, data, and intellectual property, SB 1047 may do more harm than good in achieving that goal. Pelosi highlighted the opposition to the bill from Stanford University computer science professor Fei-Fei Li, an esteemed figure in the field of AI. Li and other opponents argue that the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act, as the bill is called, will not solve the intended issues and instead harm academia, startups, small companies, and the open-source community. Wiener maintains that AI safety and innovation can coexist and asserts that the bill has been modified to address some of the critics' concerns.

OpenAI, the creator of ChatGPT, also opposes the bill and prefers national regulations instead of state-level ones to avoid a fragmented landscape of AI regulations. Despite the varying opinions, at least 40 states have introduced bills this year to regulate AI, with several already adopting resolutions or legislation on the matter. OpenAI raises the concern that the bill could drive innovators away from California, which is home to Silicon Valley. However, Anthropic, another player in generative AI, sees more benefits than flaws in the bill after certain modifications. The bill has garnered support from high-profile figures in the AI community, such as computer scientist Geoffrey Hinton. He believes that AI regulation with "real teeth" is crucial and sees California as a fitting starting point due to its historical association with technological advancements. Meanwhile, professors and students at the California Institute of Technology are urging people to oppose the bill, claiming it imposes burdensome and unrealistic regulations that hinder AI research and development.