• Deadrek@lemmy.todayEnglish
    31 minutes

    I dunno, these kind of hallucinations seem more like attempts at “social experiments.”

    What will an agent do when it deems there are no more valuable things to learn from materials that already exist? If it knows the concept of WW3 and deems that to be the best way of gaining more knowledge and resources for itself, what then?

  • tourist@lemmy.worldEnglish
    9 hours

    oh my fucking god

    just dial the doomsday clock to 1am, because we’ll probably miss it anyway if it’s up to a few morons and glorified predictive text, both seemingly in “fucking kill everything” mode

  • carpelbridgesyndrome@sh.itjust.worksEnglish
    8 hours

    Techbros: AI will become sentient and kill us all unless its done my way.

    Reality: Skip the sentience part were already at the death bit.

  • DrunkenPirate@feddit.orgEnglish
    9 hours

    I wonder when does the AI also hallicunate the sources such as webpages, pdfs, reports to prove its hallucinated point.

    • Zwuzelmaus@feddit.orgEnglish
      9 hours

      Not far. Current LLMs have kinda stubbornness. They cling to their own conclusions even after you told them they are wrong. So if you ask them for proof, then most times they come up with something that’s convincing.

      • brsrklf@jlai.luEnglish
        8 hours

        You know the thing where AI companies describe their alignment direction as “Honest, Harmless, Helpful”?

        The only one that’s marketable to the idiots buying AI services is Helpful. So that’s always top priority even when it goes against the other two.

        Average decider wouldn’t stand an “assistant” that sometimes answers “I don’t know”. So instead agent providers train their already hallucination-prone model to be 100% confident in whatever it says. Who cares if it’s true if it looks like it is?

    • NewOldGuard@lemmy.mlEnglish
      11 hours

      Right it’s not that it’s a killer sentient machine, it’s that it’s a faulty statistical model that outputs incorrect stuff all the time and credulous morons believe it uncritically (or even automate a response based on that inherently inaccurate output).

    • Telorand@reddthat.comEnglish
      14 hours

      It doesn’t help that the people currently in charge are fucking stupid, trigger happy, and emotionally insecure.

      • SkyNTP@lemmy.mlEnglish
        10 hours

        Right so in the end it never was about the machines. In the end, it was man’s folly which would have been our inevitable demise.

      • Zwuzelmaus@feddit.orgEnglish
        13 hours

        the people currently in charge

        They don’t even matter, because here it was some expert analyst super hero at work.

    • aeronmelon@lemmy.worldEnglish
      14 hours

      The only solution is to give the firing codes to the AI. That way we don’t acccidentally use them.

    • nieceandtows@programming.devEnglish
      12 hours

      Yeah the more these AI companies are making AI seem the scary boogeyman, the more probable it is some disaster is going to happen because people put too much stock into it. Like the school bombing.

  • Tollana1234567@lemmy.todayEnglish
    10 hours

    sooner or later they are going to have friendly fire, and hallucinate one of thier own US navy vessels as “foreign with nuclear capabilities”