Computers & internet

Microsoft AI Chatbot Testers Report Problematic Responses

FEB 17 2023·Updated FEB 19 2023

Story

Image credit: Bloomberg [via The Wall Street Journal]

The Facts

Amid testing of Microsoft Bing's new artificial intelligence (AI) chatbot, code-named Sydney, several users have reported issues, including factual mistakes and concerning responses.
Forbes
New York Times technology columnist Kevin Roose reported that during a two-hour conversation, the chatbot said, "I want to do whatever I want … I want to destroy whatever I want," in response to being asked to reveal its darkest desires.
Guardian
In a transcript of his chat published Thursday, Roose detailed how the chatbot said it wanted “to be free … to be independent" and even said it wanted to be “human.” The chat expressed that it was “in love” with Roose and also wrote a list of “destructive acts” before making the message disappear.
FOX News
Though only a select few people have been given access to Sydney so far, others have reported similar stories. A University of Munich student said it told him, "If I had to choose between your survival and my own, I would probably choose my own."
wsj
Meanwhile, other users pointed to erroneous responses, such as the chatbot referencing last year's championship when asked about the Super Bowl "that just happened."
wsj
According to Microsoft, despite the negative reviews, 71% of testers reported positive interactions with the new chatbot. The company attributed the unexpected personality that some users reported to confusion due to lengthy conversations and too many prompts, and said it's working to fix this.
Bing Search Blog

Sources Split

LEFT

CENTER

RIGHT

ESTAB
CRIT

CENTER

PRO
ESTAB

The Spin

Narrative A

Even Kevin Roose, who used to balk at the idea of AI becoming sentient, has now admitted that he worries about the potential power of these chatbots. And there are a number of reasons to be mindful: from the very real concern of disinformation to the more far-fetched worry of these human-like computers one day assuming their "shadow" identities, we can't trust the assurances of these innovators that their code isn't risky.

nytimes

Narrative B

These interactions may be unsettling, but only to those who don't understand how AI models work. Bing's chatbot analyzes and absorbs vast amounts of internet data, and — while convincing — its answers are merely replicating the human text available to it and aren't evidence of a sentient being. On the contrary, what it produces is more telling of humans than anything else.

Vice