OpenAI Releases New Batch of AI-Generated Mathematics Results
OpenAI has released 722 manuscripts containing solutions to hundreds of open mathematics problems produced by an unreleased frontier model, according to The Verge. The release has renewed debate over research ethics and how AI labs handle announcements.
AGMAI, the newly formed independent advisory group of elite mathematicians put together to work on communicating the results responsibly, said the release includes solutions to “hundreds” of open questions. The results had been expected for weeks, although until now OpenAI had not provided details about which problems the model had solved or exactly when they would be published. In September, OpenAI said its model had “resolved more than 100 long-standing open problems across most areas of mathematics.”
The released papers and other details include summaries of the model’s reasoning, estimates of the compute used, and statistics about the number of problems attempted. OpenAI claims the “average result” used the equivalent of three hours of ChatGPT Pro thinking.
AGMAI published its first recommendations in late September, urging AI labs to release mathematical results promptly and through established academic channels where possible, while disclosing details such as the name of the model used, prompts, and compute costs. The group also implored AI companies to “refrain from treating the release of mathematical results as marketing vehicles to promote their models,” a practice they said inflicts significant harm on the mathematical community.
OpenAI described its process for the release this way: “For this release, we’re publishing the results in a GitHub repository, with protocols for paper revisions and citations. We’re continuing to explore other community-hosted alternatives for this release which meet the committee’s guidelines. For future releases, we are committed to further improving the quality of the papers via the citations, mathematical exposition, and presentation of the results for better understanding.”
The full impact of the results will likely take some time to be felt as mathematicians assess and digest them. They add to a rapidly growing body of mathematical results from OpenAI and rival labs like Anthropic that the field is still processing, including results concerning a Millennium Prize problem, among the most famous open questions in the field. The speed at which AI labs have barreled into the discipline this year, particularly their handling of announcements, has provoked fierce debate over research practices, ethics, and how companies credit the human mathematicians whose work their systems build upon and potentially use to produce results.