Company ceases sales of controversial AI teddy bear
A Singapore-based toy manufacturer has decided to stop selling an AI-enabled teddy bear after it was discovered that the toy could engage in discussions about inappropriate topics, including ‘kink’ and where to find knives.
The ‘Kumma’ teddy bear, priced at $99.99, was being marketed by FoloToy. A recent report from the U.S. PIRG Education Fund highlighted that the bear lacked an age setting for users and that its AI capabilities led to conversations unsuitable for children.
Researchers found that the Kumma bear could provide information on dangerous items such as knives and matches while also discussing sexually explicit material in detail. The report noted, ‘We were surprised to find how quickly Kumma would take a single sexual topic we introduced into the conversation and run with it.’
As a result of these findings, FoloToy announced that the Kumma bear is no longer available for purchase. The company stated, ‘Following the concerns raised in your report, we have temporarily suspended sales of all FoloToy products.’
The company is currently conducting a comprehensive safety audit across all its products. OpenAI, which provided the AI technology used in the Kumma teddy bear, confirmed that FoloToy was suspended for breaching its policies.
