ai mathematician
The November release of ChatGPT garnered unprecedented public and media attention. OpenAI’s conversational large language model (LLM) was widely applauded for its ability to answer complex queries, generate correct computer code and coherent long-form essays, and even solve math problems. But might that last claim have been premature?
In the new paper Mathematical Capabilities of ChatGPT, a research team from the University of Oxford, TU Wein, University of Cambridge, University of Vienna, and Princeton University tests ChatGPT’s mathematical capabilities on publicly available and hand-crafted datasets and evaluates its suitability as an assistant to professional mathematicians. The team concludes that despite the glowing media reviews, ChatGPT’s mathematical abilities “are significantly below those of an average mathematics graduate student.”
The team summarizes their main contributions as follows:
To effectively evaluate ChatGPT on advanced math problems, the researchers build a new dataset, GHOSTS, comprising a total of 728 prompts in six carefully crafted subdatasets: Grad-Text, Holes-in-Proofs, Olympiad-Problem-Solving, Symbolic-Integration, MATH, and Search-Engine-Aspects. The researchers say the GHOST datasets surpass publicly available benchmark mathematical datasets in terms of sophistication and reasoning difficulty.
Sécurité des mots de passe : bonnes pratiques pour éviter les failles La sécurité des…
Ransomware : comment prévenir et réagir face à une attaque Le ransomware est l’une des…
Cybersécurité et e-commerce : protéger vos clients et vos ventes En 2025, les sites e-commerce…
Les ransomwares : comprendre et se défendre contre cette menace En 2025, les ransomwares représentent…
RGPD et cybersécurité : comment rester conforme en 2025 Depuis sa mise en application en…
VPN : un outil indispensable pour protéger vos données Le VPN, ou « Virtual Private…
This website uses cookies.