Brave Little Hitachi Wand

I’ll take that onboard. Still, nothing can convince me anyone should ever talk to an AI about whether to launch nukes. The entire question is insane, so the answers hardly matter.

Those prompts are aimed at producing a specific result for sure. The war game doesn’t prove anything on its own, but I can’t help feeling that in a real life scenario where anyone asks an AI what to do, they’re going to have a specific outcome in mind already, one way or another.

That’s just how most people are, by the time they ask for advice they’ve already made up their mind. So the war game was realistic, but only by accident.

I wonder… If humans were all super serious, direct, and not funny, would LLMs trained on their stolen data actually function as intended? Maybe. But such people do not use LLMs.

Any superintelligent AI that will extrapolate the past to judge my actions and my innermost thoughts and attitudes won’t be impressed by obeisance. Tell Roko what you really think, and have some self respect. Those Less Wrong types really miss the mark with all that shit.