You’ve probably heard the phrase “It’s so good, it’s dangerous ⚠️.” It seems like a clever marketing tactic, likely coined by some savvy marketers, possibly inspired by Musk’s style of promotion.

Unfortunately, this kind of marketing overshadows an important conversation about human-centered design and emotional attachment. Will Knight wrote a concise and insightful piece on this very topic.

Take a look and share your thoughts on the new voice model and the heightened risk of emotional attachment to it.

A section of the system card titled “Anthropomorphization and Emotional Reliance” delves into the challenges that emerge when users start perceiving AI as human-like—a concern that’s apparently intensified by the human-like voice mode. During the red teaming (stress testing) of GPT-4, OpenAI researchers observed instances where users expressed emotional connection with the model, using phrases like, “This is our last day together.”