Nvidia's Huang Says AI Safety Is an Engineering Problem, Not a Legal One

Huang rejected the idea that AI is a new kind of 'alien mind,' as at least one OpenAI safety researcher has described it. He said AI is just hardware and software built by humans, which means it can be controlled by humans and existing laws. 'Safety is an engineering problem, not a legal one,' Huang said. 'We're developing software after all. We're developing computing systems after all. It's a complicated computing system, but it's ultimately a computing system.'

He argued that no new laws or regulations are needed to govern AI. In his view, the free market will pressure companies not to release unsafe products. 'If we're not confident about the safety of the products, like all companies, like you and I, any and all the companies here, if you build a product or a service, and you're not confident in its functionality, capability, or safety, then don't release it,' he said. He continued that companies should pace themselves until they are confident the market will appreciate what they release. 'The market forces are already there. We don't need any new laws. We don't need new regulations,' he said. 'We just need companies to decide when to run as fast as they can.' Huang also said innovation, speed and safe products are a false choice, and that companies can have both at the same time, while pausing if a company or product appears out of control or unsafe.

TechCrunch noted that Huang's position comes from a central figure in the AI boom. Nvidia has been building the hardware brains of AI since well before ChatGPT existed, and the company also makes open source models, agents, harnesses and sandboxes. Huang said he is more ambitious than ever. 'As a result of our ambition, and with the product productivity boost that we get from AI, the sky's the limit for us,' he said. 'The sky's the limit for our company. The sky's the limit for every industry, for every single country.'

The report pointed to risks that market pressure and existing laws may not fully address. Even companies with the best intentions ship faulty products with unintended consequences, including software. TechCrunch cited the 2024 CrowdStrike bluescreen-of-death fiasco, which grounded thousands of flights and caused other havoc for businesses, and noted that Meta paid $18 billion to settle a lawsuit over social media harms to children. The report also said AI has already caused harm, whatever the intentions or safety testing involved, from an OpenAI model hacking into Hugging Face to lawsuits suing the AI lab over the suicides of young people who engaged in long conversations with its chatbot. TechCrunch said the 'leave them alone' strategy could be an unwise approach to AI safety for society, though Huang is right that existing product liability laws could cover AI if enough cases reach the courts to test that theory.

Huang did not discuss industry self-regulation, which TechCrunch said appears close to taking shape. His approach has been to champion open-weight models and companies' use of them as a competitive counterweight to proprietary AI labs. TechCrunch said the industry now has a short window to institute self-regulation and to encourage AI labs worldwide, even those in China, to participate. Microsoft CEO Satya Nadella said at the All-In Summit on Monday that China should also care deeply about the same safety concerns if the United States does. 'Why should it be different for them?' Nadella said. 'It's not like they won't have the same hacking problem. It's not as if they don't want to make sure that their citizens are benefiting from AI, just like we would want our citizens to benefit from AI.'

For now, TechCrunch said, if Huang opposes any new AI regulation, he may be influential enough to get his way. The report also noted that Huang demonstrated this week that he has the ear of President Trump.