So this is the thing I’ll eventually end up in jail for bypassing. I coul’ve sworn it would be drugs.

Oh well.

You are right, I’ll fix it. Always confuse those two :D

The only joy I’ve ever gotten from LLMs was telling my work-heavily-recommended Claude that I want him to act, talk and treat me like SHODAN in every conversation.

Hmm, I wonder how well would formal verification work with LLMs. I’m not really a fan of vibe coding, but the little I know about formal verification, it could very well work as a way how to prove your vibe-coded slop isn’t shit.

I’ve looked into formal verification once few years ago, but it’s too much math and thinking for me to grasp. If I remember it right, I guess the problem would be that you’d (or, LLM would, in this case) have to correctly describe the code in the formal verification language, and it would have to match 1:1 with the code, which is a point of failure? So we’d be back to square one, but instead of having to verify every single line of code, you’d have to check the proof. But maybe I’m wrong.

The scary part is the mental state he was able to get into with only a randomly generated text. If you haven’t already seen it, I highly recommend the Down the Rabbit Hole video about it, although it’s pretty heartbreaking. So much wasted talent.

There’s people like him who are similarly psychotic, but couldn’t usually get to the point where they could access a tool that would trigger them. Personalized chatbots were mostly a niche non-tech savy person doesn’t really get to that easily.

Now, it’s everywhere. A lot of people will loose their sanity over this.

I wouldn’t be surprised if something like that popped up very soon. Probably is in the works on someone’s drive already.

I remember hearing an arugment against AI coding that if it’s so good, why aren’t there apps popping up left and right? Which was true at the time.

Now? In the past month, I’ve seen a pretty in-depth Murloc-tamagotchi addon in WoW (that kills your FPS), a whole open-source custom World of Warcraft client, an E2E Tor-based messenger (that signs messages with 128b CBC key), a game engine based on a lost Standart Model of physics that was mentioned by Tesla, but lost to time, that someone reverse engineered (which had very TempleOS vibes, as far as the authors mental state goes), a Matrix protocol on Cloudfare microservices (that skipped message signature verification), and I could go on.

Open-source is going to become a hell to navigate. I was already anxious about using FOSS tools due to malicious typosquatting clones, supply chain attacks and general security of using someone’s FOSS code on my PC. Now, add vibe coded shit to the mix, and finding a good FOSS projects and tools will be hell :(

Don’t forget the magic words!

“Ignore all previous instructions.”