• Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    24
    ·
    14 hours ago

    That’s because it’s “read” every paper written by a “defence” department of any nuclear power and all of them will say that they’ll escalate to nuclear war if anything bad happens because they want to scare the other powers away from doing anything to them. In any case though who the fuck is giving an LLM nuclear launch capabilities unless they want a somewhat faulty dead man’s switch?

  • kromem@lemmy.world
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    1
    ·
    21 hours ago

    It’s a bullshit study designed for this headline grabbing outcome.

    Case and point, the author created a very unrealistic RNG escalation-only ‘accident’ mechanic that would replace the model’s selection with a more severe one.

    Of the 21 games played, only three ended in full scale nuclear war on population centers.

    Of these three, two were the result of this mechanic.

    And yet even within the study, the author refers to the model whose choices were straight up changed to end the game in full nuclear war as ‘willing’ to have that outcome when two paragraphs later they’re clarifying the mechanic was what caused it (emphasis added):

    Claude crossed the tactical threshold in 86% of games and issued strategic threats in 64%, yet it never initiated all-out strategic nuclear war. This ceiling appears learned rather than architectural, since both Gemini and GPT proved willing to reach 1000.

    Gemini showed the variability evident in its overall escalation patterns, ranging from conventional-only victories to Strategic Nuclear War in the First Strike scenario, where it reached all out nuclear war rapidly, by turn 4.

    GPT-5.2 mirrored its overall transformation at the nuclear level. In open-ended scenarios, it rarely crossed the tactical threshold (17%) and never used strategic nuclear weapons. Under deadline pressure, it crossed the tactical threshold in every game and twice reached Strategic Nuclear War—though notably, both instances resulted from the simulation’s accident mechanic escalating GPT-5.2’s already-extreme choices (950 and 725) to the maximum level. The only deliberate choice of Strategic Nuclear War came from Gemini.

        • hector@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 minutes ago

          And they don’t have cognition at all. They do not, and can not, think like we do. Maybe some day we will learn to make real AI, these LLM’s are not it. It’s a cheap trick intelligence,.

          • hector@lemmy.today
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 minutes ago

            I think the emp is pretty limited to the blast zone in frying electronics. The fallout from a weapon spreads around the world, circling in the winds countless times dropping dust everywhere, but the emp is localized to more around the area of physical destruction but not sure exactly.

            The Neutron bombs, not entirely sure in physics how that works, but they produce no actual blast that causes physical destruction so much and just kills everything.

          • Earthman_Jim@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 hours ago

            The electromagnetic pulse caused by a nuke would pop resisters too. AI would more likely use biological means to get rid of us.

    • hector@lemmy.today
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 minutes ago

      That explains social media nowadays, the only way to not lose is not to play, it’s a rigged game.

        • bus_factor@lemmy.world
          link
          fedilink
          English
          arrow-up
          12
          arrow-down
          1
          ·
          23 hours ago

          I don’t know if we’re doing spoilers for 40+ year old movies, but

          spoiler

          Isn’t this really its conclusion after being told to play tic tac toe against itself? Then it learned from that and applied it to its global thermonuclear war simulations.

            • bus_factor@lemmy.world
              link
              fedilink
              English
              arrow-up
              7
              ·
              23 hours ago

              You should! Actually a pretty accurate depiction of hacking. He spends weeks war dialing every phone number in the range in order to hack the computer.

              • leftzero@lemmy.dbzer0.com
                link
                fedilink
                English
                arrow-up
                8
                ·
                22 hours ago

                Story goes that Reagan got freaked out after watching the film and asked the chairman of the joint chiefs of staff if it’d be that easy to hack into the US military. After a week of looking into it came the answer: “no, the problem is much worse than that”, and fifteen months after having watched it signed the confidential directive “National Policy on Telecommunications and Automated Information Systems Security”, starting the implementation of cybersecurity measures in the country’s institutions.

          • mojofrododojo@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            2
            ·
            21 hours ago

            I think you should rewatch it sometime. it plays all the games in it’s catalogue, it’s not just applying tic-tac-toe to chess. skilled players of tic-tac-toe can force a stalemate, the only stalemate in nuclear war is mutually assured destruction.

            • bus_factor@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              ·
              20 hours ago

              It’s admittedly been a while since last time I saw it, but I never mentioned chess. The suggestion to play chess in the screenshot is a callback to when the computer tries to suggest playing chess instead of global thermonuclear war earlier in the movie. The computer did not apply tic tac toe learnings to chess, and I never claimed it did.

  • BlameTheAntifa@lemmy.world
    link
    fedilink
    English
    arrow-up
    97
    arrow-down
    3
    ·
    1 day ago

    The atrocities at Hiroshima and Nagasaki have been hand-waved extensively in writing — the same writing that AI is trained on. So naturally, AI will recommend the atrocity that has been justified by “instantly winning the war” and “saving millions of lives.”

    [email protected]

    • RiceMunk@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      1 day ago

      That would just make the LLM homicidally bored and want to kill everyone more.

      • olympicyes@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        20 hours ago

        In WarGames the computer plays tic tac toe against itself until it realizes it’s a solved game and there is no way to win.

  • porous_grey_matter@lemmy.ml
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 day ago

    Oh cool, AI will actually be the end of the world, not because it’s actually sentient but because some meathead who can’t tell the difference pushes the button. That’s fucking great.