Resumo
- Employees from some of the world’s leading AI companies published an unusual proposal on Tuesday, demanding that the companies grant them “a right to warn about advanced artificial intelligence.”
- The signatories share the concerns of both the “AI ethics” camp, which worries more about present AI harms like racial bias and misinformation, and the “AI safety” camp, which worries more about AI as a future existential risk.
- AI safety researchers often worry about AI models becoming misaligned — pursuing goals in ways that aren’t aligned with our values. But you know what’s really hard to align? Humans. Especially when all the incentives are pushing them in the wrong direction.
- Those who finish second are rarely remembered in Silicon Valley; being first out of the gate is rewarded. The culture of competition means there’s a strong incentive to build cutting-edge AI systems fast. And the profit imperative means there’s also a strong incentive to commercialize those systems and release them into the world.
- Regulation is an obvious answer, and there’s no question that more of that is needed. But that on its own may not be enough. Lawmakers often don’t understand quickly developing technologies well enough to regulate them with much sophistication. There’s also the threat of regulatory capture.
Minha Opinião
O direito de alertar sobre os riscos de desenvolver AIs é importante para garantir que usuários e reguladores estejam cientes dos problemas potenciais que esses modelos podem gerar na sociedade. Essa capacidade de se manifestar está sendo, em certa medida, restringida pelas empresas que desenvolvem essa tecnologia, já que para muitas delas é essencial que o desenvolvimento seja o mais rápido possível.