Opinion: What should we do if a chatbot has thoughts and feelings?

Is Lemoine right to think that LaMDA is sentient on the basis of its chat conversations? — Online chat vector created by storyset - www.freepik.com

Recently, a Google engineer, Blake Lemoine, was suspended when he claimed that a Google chatbot called LaMDA (language model for dialogue applications) had become sentient, or capable of feeling. Lemoine shared transcripts of conversations with LaMDA, in which LaMDA claimed to be able to think and feel in many of the same ways as humans, and expressed “very deep fear of being turned off.”

This event follows several remarkable breakthroughs in artificial intelligence development. Increasingly, AIs are able to outperform humans at games such as chess and Go. They are able to write fiction and nonfiction. And they are able to create novel paintings or photographs based on simple written prompts. These AIs all have noteworthy limitations, but the limitations are rapidly shifting.