Get off of Github and I bet you those drop to nearly zero. Using Github is a choice with all of the AI slop it enables. They aren’t getting rid of it any time soon. The want agents and people making shitty code PRs—that’s money sent Microsoft’s way in their minds.
Now that they see what the cost of using Github is maybe Godot will (re?)consider codeberg or a self-hosted forgejo instance that they control.
A lot of programmers with thigh-high striped socks should take one for the team and take back Godot and such. Seriously!
It’s everywhere. I was just trying to find some information on starting seeds for the garden this year and I was met with AI article after AI article just making shit up. One even had a “picture” of someone planting some seeds and their hand was merged into the ceramic flower pot.
The AI fire hose is destroying the internet.
I fear when they learn a different layout. Right now it seems they are usually obvious, but soon I wont be able to tell slop from intelligence.
One could argue that if the AI response is not distinguishable from a human one at all, then they are equivalent and it doesn’t matter.
That said, the current LLM designs have no ability to do that, and so far all efforts to improve them beyond where they are today has made them worse at it. So, I don’t think that any tweaking or fiddling with the model will ever be able to do anything toward what you’re describing, except possibly using a different, but equally cookie-cutter way of responding that may look different from the old output, but will be much like other new output. It will still be obvious and predictable in a short time after we learn its new obvious tells.
The reason they can’t make it better anymore is because they are trying to do so by giving it ever more information to consume in a misguided notion that once it has enough data, it will be overall smarter, but that is not true because it doesn’t have any way to distinguish good data from garbage, and they have read and consumed the whole Internet already.
Now, when they try to consume more new data, a ton of it was actually already generated by an LLM, maybe even the same one, so contains no new data, but still takes more CPU to read and process. That redundant data also reinforces what it thinks it knows, counting its own repetition of a piece of information as another corroboration that the data is accurate. It thinks conjecture might be a fact because it saw a lot of “people” say the same thing. It could have been one crackpot talking nonsense that was then repeated as gospel on Reddit by 400 LLM bots. 401 people said the same thing; it MUST be true!
I think the point is rather that it is distinguishable for someone knowledgeable on the subject, but not for someone is not. Thus making it harder to evolve from the latter to the former.
just deny PRs that are obvious bots and ban them from ever contributing.
even better if you’re running your own git instance and can outright ban IP ranges of known AI shitlords.
Why people try to contribute even if they don’t work on their codes? Ai slop not helping at all.
CV padding and main character syndrome.
This was honestly my biggest fear for a lot of FOSS applications.
Not necessarily in a malicious way (although there’s certainly that happening as well). I think there’s a lot of users who want to contribute, but don’t know how to code, and suddenly think…hey…this is great! I can help out now!
Well meaning slop is still slop.
AI crowd trying hard to find uses for AI
But all that money can’t be wrong!
I think the open slop situation is also in part people who just want a feature and genuinely think they’re helping. People who can’t do the task themselves also can’t tell that the LLM also can’t do it.
But a lot of them are probably just padding their GitHub account too. Any given popular project has tons of forks by people who just want to have lots of repositories on their GitHub but don’t actually make changes because they can’t actually do it. I used to maintain my employer’s projects on GitHub and literally we’d have something like 3000 forks and 2990 of them would just be forks with no changes by people with lots of repositories but no actual work. Now these people are using LLMs to also make changes…
Damn, Godot too? I know Curl had to discontinue their bug bounties over the absolutely tidal volume of AI slop reports… Open source wasn’t ever perfect, but whatever cracks in there were are being blown a mile wide by these goddamn slop factories.
I don’t contribute to open source projects (not talented enough at the moment, I can do basic stuff for myself sometimes) but I wonder if you can implement some kind of requirement to prove that your code worked to avoid this issue.
Like, you’re submitting a request that fixes X thing or adds Y feature, show us it doing it before we review it in full.
Tests, what you are asking for are automated tests.
Can that be done on github?
Yep, take a look into GitHub actions. Basically you can make it so that a specific set of tests are run every time a PR is opened against your code repo. In the background it just spins up a container and runs any commands you define in a YAML config file.
Better yet, don’t use GitHub!
gzdoom just simply banned ai code, and made a new fork that tries to stay clean. why cant they do the same?
gzdoom just simply banned ai code
You got that wrong. Graf Zahl added AI code and all the other contributors left to fork it to create UZDoom.
Before hitting submit I’d worry I’ve made a silly mistake which would make me look a fool and waste their time.
Do they think the AI written code Just Works ™? Do they feel so detached from that code that they don’t feel embarrassment when it’s shit? It’s like calling yourself a fictional story writer and writing “written by (your name)” on the cover when you didn’t write it, and it’s nonsense.
I’d worry I’ve made a silly mistake which would make me look a fool and waste their time.
AI bros have zero self awareness and shame, which is why I continue to encourage that the best tool for fighting against it is making it socially shameful.
Somebody comes along saying “Oh look at the image is just genera…” and you cut them with “looks like absolute garbage right? Yeah, I know, AI always sucks, imagine seriously enjoying that hahah, so anyway, what were you saying?”
