40
2030—Ray Kurzweil’s Predictions or Bill Joy’s Fears? (374)
Carolyn Mathas
S
UMMARY
Mathas summarizes Bill Joy’s and Ray Kurzweil’s the radically opposed futures concerning humans an artificial
intelligence. Are we on a collision course, leading to the doom of humankind (Bill Joy)? Are we on the threshold of a
summarizes the opposing positions and invites readers to weigh in.
TEACHING S
UGGESTIONS
This selection is structured as a straightforward comparison-contrast. Ask students to take notes on this structure, as
separate from content, and compare notes. How has Maathas organized the piece? Is she neutral in her presentation?
Does she favor one version of the future over the other?
An Open Letter on Artificial Intelligence (p. 377)
Future of Life Institute
Research Priorities for Robust and Beneficial Artificial Intelligence (p. 378)
Stuart Russel, Daniel Dewey, and Max Tegmark
An Open Letter on AI: Why Now? (p. 380)
Seán Ó hÉigeartaigh
S
UMMARY
This cluster of readings concerns a remarkable open letter on artificial intelligence signed by an all-star list of
scientists, initially, after an AI conference, and subsequently signed by more than 8.000 scientists world wide. While
certainly welcoming of, and encouraging, developments in AI, the letter is founded in part on an underlying wariness
of intelligent machines. It would seem that those most familiar with the science are most wary of possibilities it may
TEACHING S
UGGESTIONS
This passage is typical of, and central to, the letter and its ancillary documents—the research priorities and
Ó hÉigeartaigh’s statement on timing: “It’s no longer enough to ask “can we build it?” Now that it looks like we can,
we have to ask: “How can we build it to provide most benefit? And how must we update our own systems – legal,
economic, ethical – so that the transition is smooth, and we make the most of the positives while minimizing the
negatives?” Engage students in these questions, breaking them into groups to discuss legal, economic, and ethical
considerations of AI. Students can report on each group’s discussions with the entire glass. As a class, you might also
discuss Basulto’s preference of emphasizing existential reward over existential risk. Establish as a basis for this
discussion what AI science will look like in a few hundred years. Assume AI has vast capabilities. What are the
implications for human evolution? Would students object to AI enhancements to their bodies—if, for instance, such
enhancements could prevent cancer or heart attacks?