New Book: A Treacherous Technology: Artificial Intelligence and Human Extinction Risk
William Leiss william.leiss@gmail.com and Richard Smith smith@sfu.ca
Our book is the first to bring the well-established risk management approach to the issue of the catastrophic risks associated with Artificial Intelligence (AI), which have been identified by many AI professionals. This approach uses a formal methodology in the evaluation of risks, considering probability or likelihood, and consequences or outcomes, as separate aspects.* Separating the two influences the perceived severity of risks and the options for managing them—as well as judgments as to whether the level of risk is acceptable to the public. Using this approach, we find that certain catastrophic risks of AI are unacceptable at present, and therefore stringent regulations by governments are necessary in order to guarantee the safety of Frontier AI systems. We call upon the Government of Canada to promulgate such regulations and join with other countries to create and enforce an international treaty on AI safety.
*This approach includes Quantitative Risk Assessment (QRA), and our book includes the first QRA study of an AI risk issue by our colleague Michael G. Tyshenko.
Contents
Part One: Artificial Intelligence
Chapter 4: The Superhuman Machine
Part 2: Risk Policy and Analysis
Chapter 5: The Risk-Based Approach
Chapter 6: The Control Problem
Chapter 7: Catastrophic and Existential Risks
Chapter 9: Quantitative Risk Assessment for Loss of Control (By Michael G. Tyshenko)
Part Three: Governance and Risk Management
Chapter 11: Risk Mitigation Options
Chapter 13: Blaming the Victims
Chapter 14: What Should the Public Do?
Chapter 15: What Should Governments Do?