In the midst of 2015’s debates on the risks and possibilities of artificial intelligence which were fueled by the progress of self-driving cars, autonomous robotics, and the signature of an open letter in favor of AI security, Google invited philosopher John Searle to elaborate once more on his Chinese Room Argument of 1980.
The Chinese Room Argument was designed to demonstrate the impossibility of creating true intelligence out of computer code by comparing it to a hotel room that contains detailed instructions on how to respond to sequences of Mandarin characters. While a person who follows these instructions impeccably could lead an observer to believe that a dialogue between two Chinese speakers is taking place, the user of these instructions would in fact not need to understand a single character. Therefore, Searle argued, the Turing Test is inadequate, as it does not take true understanding of the input into account, but rather judges only the quality of the output. At its core, the Chinese Room Argument defends the notion of intelligence as a unique property of biological entities, something machines can at best simulate but never replace.
For an in-depth discussion of the thought experiment and its reception over the last three decades, see e.g. the Stanford Encyclopedia of Philosophy.