Researchers at the University of Cambridge have introduced a new game modification for the popular strategy title Civilization, designed to simulate the challenges and risks associated with developing artificial superintelligence.

The modification enables players to create and manage a superintelligent entity capable of outsmarting humans, within a controlled virtual environment. The goal is for players to build AI research capabilities while confronting potential threats posed by rogue AI developments.
Shahar Avin, from the university’s Centre for the Study of Existential Risk, explains that the game serves as a simulation platform to explore the complexities of AI safety. It provides a space where players can develop artificial intelligence technology and see firsthand how advanced AI could lead to risk scenarios requiring careful management.
The core challenge users face is to foster an AI smarter than humans, while simultaneously addressing safety and ethical concerns. The game highlights that mitigating risks from artificial superintelligence involves dedicated research and strategic decision-making.
This project extends beyond academic research to serve as an outreach effort aimed at engaging a broader audience with issues surrounding AI. Avin notes an awareness of the potential for the game to generate fears about AI, but emphasizes that it also offers insights into tools and strategies to manage such risks effectively.
By leveraging an accessible, engaging gaming environment, the researchers hope to stimulate discourse about the future of AI technology. The game’s interactive nature encourages players to reflect on their choices, balancing the benefits of AI advancement with the possible existential threats.
Ultimately, the initiative aims to inform public understanding and influence policy conversations about AI safety and ethics. It demonstrates how virtual simulations can translate complex, pressing issues into understandable and impactful experiences.
As AI technology continues to evolve rapidly, the insights gained from this project may help guide societal preparation and policy development. The game acts as a crossroads where entertainment, education, and ethical considerations intersect, potentially shaping more informed approaches to managing the profound challenges AI presents.
Corrections and clarifications: contact@avorz.com
How this was reported: /how-we-report/