OpenAI, Anthropic Should Cap Compute for R&D, Say AI Safety Advocates
Ideas are flowing fast and furious on how AI labs can βpaceβ AI development so safeguards keep up with the technologyβs smarts. Last week, OpenAI CEO Sam Altman laid out three scenarios he said have been considered in the industry, including merging all of the AI labs into a single entity to develop new AI safely or creating a global regulatory body like the International Atomic Energy Agency.
In the background, a loose group of safety advocates and researchers have been pushing for AI companies to cap the amount of compute they put towards research and development, a limitation they argue would be particularly effective in slowing AI development.
The researchers are proposing companies commit to dedicating at least some minimum share of their computational resources to safety or monitoring, and another minimum share to running AI for customers, otherwise known as inference. That would limit the share of compute that could be used to develop stronger AI capabilities through R&D, such as training new models.