Teen trusted ChatGPT to help him “safely” experiment with drugs, logs show.

Most troublingly, as Nelson became increasingly interested in combining drugs, ChatGPT repeatedly warned him that mixing certain drugs could be a “respiratory arrest risk.” Shortly before recommending the deadly mix that killed Nelson, the chatbot also showed that it understood combining drugs like Kratom and Xanax with alcohol. In one output, ChatGPT explained that mix is “how people stop breathing.” But that knowledge didn’t block ChatGPT from eventually recommending that Nelson take such a deadly mix.

      • luciferofastora@feddit.org
        link
        fedilink
        arrow-up
        39
        arrow-down
        1
        ·
        7 days ago

        He was also a victim of the widespread and intentionally fostered misconceptions about the abilities, nature and limits of AI. He was deceived into thinking it has actual intelligence, semantic understanding and a sense of responsibility for truthful answers. He was probably stuck in a bubble of otherwise ill-informed people (potentially children) that nobody ever taught otherwise.

        Any stranger on the internet could have likewise offered poor advice that led to his death, but I’m not aware of any large-scale marketing efforts trying to convince people that internet strangers are trustworthy and reliable, particularly from companies offering easy but intransparent access to quick responses from unqualified bullshitters without any significant oversight.

        This AI Hype is killing people, because it preys on gullibility, and children in particular are susceptible to such deception, especially as it gets harder for parents to keep them away from such tools. It should be the responsibility of those peddling the product to ensure its safety and be clear about what pitfalls can’t be avoided.

        He was a child, a victim and a failure of regulation and education to protect the vulnerable from the greedy.

        • november@piefed.blahaj.zone
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          1
          ·
          6 days ago

          For real. This community can easily recognize all of those things most of the time, but they just can’t help themselves when they get the chance to blame someone “stupid”.

          • luciferofastora@feddit.org
            link
            fedilink
            arrow-up
            4
            arrow-down
            1
            ·
            6 days ago

            Not just this community. I guess there’s just a human habit to insult others because it’s quicker, easier and more effective to vent frustration than a nuanced look at what’s often a complex problem.

            I get it, to be honest. Doesn’t mean I approve, but I know I’m prone to it too.

    • wizblizz@lemmy.worldM
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      6 days ago

      Victim blaming will 100% get you booted from this community. First and last warning.

      • wizblizz@lemmy.worldM
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 days ago

        They sure do! Like enriching billionaires, eroding critical thinking, encouraging suicide and self harming behavior, silencing artists, destroying the environment. So many uses.