Forthcoming 2027

New Book: A Treacherous Technology: Artificial Intelligence and Human Extinction Risk

William Leiss william.leiss@gmail.com and Richard Smith smith@sfu.ca

https://aiextinctionrisk.ca

Our book is the first to bring the well-established risk management approach to the issue of the catastrophic risks associated with Artificial Intelligence (AI), which have been identified by many AI professionals. This approach uses a formal methodology in the evaluation of risks, considering probability or likelihood, and consequences or outcomes, as separate aspects.* Separating the two influences the perceived severity of risks and the options for managing them—as well as judgments as to whether the level of risk is acceptable to the public. Using this approach, we find that certain catastrophic risks of AI are unacceptable at present, and therefore stringent regulations by governments are necessary in order to guarantee the safety of Frontier AI systems. We call upon the Government of Canada to promulgate such regulations and join with other countries to create and enforce an international treaty on AI safety.

*This approach includes Quantitative Risk Assessment (QRA), and our book includes the first QRA study of an AI risk issue by our colleague Michael G. Tyshenko.

Contents

List of Figures

List of Tables

Preface

Part One: Artificial Intelligence

Introduction

Chapter 1: The Good

Chapter 2: The Bad

Chapter 3: The Ugly

Chapter 4: The Superhuman Machine

Part 2: Risk Policy and Analysis

Chapter 5: The Risk-Based Approach

Chapter 6: The Control Problem

Chapter 7: Catastrophic and Existential Risks

Chapter 8: Risk Estimation

Chapter 9: Quantitative Risk Assessment for Loss of Control (By Michael G. Tyshenko)

Part Three: Governance and Risk Management

Chapter 10: Regulation

Chapter 11: Risk Mitigation Options

Chapter 12: Heart of Darkness

Chapter 13: Blaming the Victims

Chapter 14: What Should the Public Do?

Chapter 15: What Should Governments Do?

Chapter 16: Risk Management Summary

References

Acknowledgements