Thoughts on answering/fixing AI LLM-created garbage code?

Correct. But in a well-moderated forum the moderation should remove ALL posts that violate the rules and ostracize another person, regardless of how many likes these posts get. Clearly not the case with this forum. Unfortunately, the moderator is taking sides which is a bad thing for a great open community such as this one.

1 Like

@Dream_dev wasn’t rude, and when explained the issue, apologized and moved on to their own thread. No posts have been deleted for either of you as far as I can tell.


You @mrkpl125 appear to be cherry picking what to respond to and seem to have ignored the last few replies I made to you. The responses you personally have gotten have, in some cases, responded to the tone in which you initially engaged the community. Your first post appeared to be intentionally incendiary - which is fine. But don’t expect people to treat that kind of post the same way as an honest request for help.

The community is very welcoming to people coming and asking for help, but we also like to debate things. @normalized and I have had heated arguments on multiple occasions, but we still manage to respect one another in the end. Same with @OriginalBadBoy and I.

If you want to bring down the tone, you can. But if you keep arguing with personal attacks, you get what you get. No one owes you anything.

5 Likes

You have the point, and it’s absolutely no problem to keep the tone down if one is sure that everyone else’s tone is also kept down. Arguing and debating is ok - it’s in human nature.

What is NOT ok is letting others ostracize a person while promptly deleting that person’s messages depriving them the right to speak. The forum rules should apply universally. If they aren’t applied that way, it is called ‘double standards’.

Ok, but like I said, I don’t see that any of your posts have been deleted. As for everyone else, well it might seem unfair, but this is a small community. At least 90% of posters show up, then disappear after a few days - typically when their question is answered. Everyone who has been replying to you has been around longer and so yeah the metric may be applied differently. And I can see how that would feel unfair. But again, you came out swinging here. If you introduce yourself to a community by starting a fight, you cannot expect people to welcome you with open arms.

As for moderation, yes we do have moderators, but they are overworked and it is a thankless job that they do not get paid for. So we tend to moderate ourselves. Which is kinda where this thread came from. We create norms within this forum and it seems to work for us.

This is a welcoming community. The fact that you do not feel that way is likely because you appeared to be looking for a fight from your first post. And yes, we also have some biases against AI for various reasons and to different degrees. Hence this thread. We literally generate knowledge that gets scraped by AI to make it better. I personally, would like to be helping humans learn - not LLM companies that don’t pay me.

6 Likes

Please recognize that people are constructively criticizing AI and the use of it, based on how it affects us, and do so in a friendly way, everyone’s entitled to their individual views on this and people are entitled to disagree with AI as a technology, its use, and especially on whether they should feel obligated to help anyone using AI to “solve” things instead of learning themselves or thinking themselves

5 Likes

Some more contextual info to help us decide for ourselves what the heck to do with AI. I’m so not surprised they have that kind of flaws :

2 Likes

I’m sorry to bring this up but this isn’t nearly as effective as you think it might be. You’ve been on this forum for quite a few months now, and contributed next to nothing. You are most active in this thread, seemingly to provoke others and ignore posts which challenge your views. From the outside looking in, you’re not here to contribute to this “great open community”, you are here to provoke people and get a reaction out of them.

4 Likes

Oh my god this thread is a bit long ! Plenty of people have plenty of things to say !

I personally tend to see AI as a tool rather than an agent effective in doing tasks the way people want, at least as of today. We’ve seen AI capabilities skyrocket, whilst some people say the “AI bubble" will burst. Who knows ! Maybe tomorrow it will be able to do even more, or maybe it will be scrapped off the marked.

I have answered quite a few similar posts back when I was on Roblox, people had the same questioning and, eventually it always ended up being a whole argument ground. Let’s remind everyone that this is all speculative : no one will ever have a final answer to the AI bubble in advance.

I personally believe that AI as a discovery/learning tool is fine. It boils down to whether the end consumer is willing to learn out of it, knowing that the AI agent can also be wrong, so the end user must also understand when a wrong piece of information was output.

I would absolutely love to help someone who tried to do something, and who explains their reasoning, shows the code (with or without AI parts), and details the different thought processes they’ve been through.

I would certainly hate to help people who would just post the AI code, unedited, with no context, no reasoning, nothing.

So at the end of the day : who is going to learn out of my reply post?

The problem has been around even before AI, albeit less frequent and at a different level. All those people who are doing tutorials and just tried to copy and paste the content of a video without even trying to understand, would correspond to those AI users I would not help. But users who watch tutorials, rewrite the code, listen to explanations, try to tweak things, and remake similar systems applied to other parts of their games, are those who are going to thrive.

I learnt that way quite a while ago. Now I’m a computer science major, graduating soon enough :tada: ! And people back then were skeptical about my self learning methods, saying I wouldn’t succeed and that watching tutorials is a dumb way to learn. It does have its flaws of course, but it’s a starting point. As long as you start something, and are willing to progress, there is no reason why you wouldn’t succeed.

Eventually, I believe a little reminder must be made. When people are seeking help, they would love to get some reply for sure, but you aren’t forced to answer. They want some help, not specifically yours. That means if you believe you don’t want to help them whatsoever, just don’t ! It will be better that way than you forcing yourself to help them, even though you didn’t want to do so in the first place.

********

TL;DR

It all boils down to whether the user who is seeking help is willing to learn or not. Do as you wish as a helper and, remember to keep your calm. Users in need of help want some help, not specifically yours. Don’t force yourself in helping people you don’t want to help

2 Likes

During the lifetime of this thread, I got “radicalized”. Now I’m abstaining from posting any “solution” code in most cases, regardless of question containing “ai” code or not.

3 Likes

Just to bring another perspective to the table:

When I’m replying to help posts here, I sometimes find myself thinking: “How would I solve the problem / what kind of answer would have helped me in that situation”.

Maybe, instead of directly giving a solution to a question (e.g. by writing the corrected code for them), we could try to guide the beginners so they could solve the problems themselves (“what happens if you put a breakpoint here?”).

I know this might be more time consuming and does not work with every kind of problem - but it also might help people actually learn something and promote problem-solving strategies instead of reliance on (AI) tooling. If replicated in an AI answer, it could also make the AI a better tool for learning

4 Likes

This is a great approach, because handing out the entirety of the solution would just be spoonfeeding at some point, and people would definitely take advantage of that. I would personally never do that in the context of help regarding an issue.

I sometimes write some example code to illustrate what I’m saying still ! E.g illustrating how signals work with a simple yet effective example. It has the advantage of removing all the unecessary clutter their code may induce. In other words it emphasizes the key concept, making it easier for someone to understand it. And when they understand it, it’s their job to transpose the knewly acquired knowledge into their project !

Those who want learn should have no problem going through that kind of help, and it’s actually more benefic because they take the time to actually discover new concepts, paradigms, designs, … whereas other people may want to rush and directly get the solution without moving a single finger. Those will hardly get a working solution at the end of the day

1 Like

Related to the topic, about AI slop in godot, and how the devs are overwhelmed.

2 Likes

OMG this was so funny/sad/scary at the same time. It really makes me want to make blog posts on my site providing nonsensical solutions to problems just to see if I can get those solutions to propagate into questions on here.

@paintsimmon @normalized It would be amusing to see some blog posts about how the code golf answers are the best new way to write Godot with some BS about why it’s better and see if the LLMs pick them up.

Agreed. TBH, lately I’ve been skipping answering a lot more questions than usual. Even if I have the answers. I also pay attention to repeat posters who need too much hand holding and stay out of their subsequent threads.

This makes a lot of sense.

A number of us do that on here. We try to help them get there. But, it also does depend on the difficulty of their question. I’m a big fan of having people step back and telling us what they are actually trying to accomplish with their broken code, because a lot of people make things WAY more complicated than they need to be.

I used to do this a lot, but as @normalized has mentioned, I do this a lot less frequently.

Here’s the article mentioned in the video. It’s a short read, and faster than listening to this guy read it to you for 5 minutes.

I get why Rémi says that more money for code reviewers feels like the only solution. Sadly, I don’t think it’s scalable. LLMs can push out slop way faster than people can. Perhaps the ability to limit who can make PRs will help, but it’s another gate that has to be maintained by someone and a hoop that new contributors have to jump through.

Godot already has contribution guidelines that specifically state LLM contributions are not allowed and users must understand the code they are contributing. @athousandships mentioned in this thread that too few people don’t read the guidelines. What would be nice would be if GitHub created a “Doesn’t accept LLM contributions” options and then the major LLMs were to respect that. Much like meta tags in webpages to reject webcrawlers.

3 Likes

I don’t post solution code, not because I don’t want people to copy it instead of learn things, but because it’s too hard to type it out on mobile :joy::skull:

2 Likes

Like the slop generators care about this at all. I read a story once about a github project that committed changes that didn’t break tests (or something like that) automatically and a tutorial suggested adding a pr which just added a comment like “submitted by whoever” and add ‘contributor to so and so project’ to their cv. The project ended up with thousands of lines of comments from different people :slight_smile:

Trolls will be trolls.

PS - That PC Gamer link is a good example of a company that has destroyed its website with advertising. I simply cannot bear those sorts of websites. The ad sales team has taken control. I worked for a company once as a digital content strategy manager, but had to leave as they simply did not accept stuffing more and more ads on a page was not a great idea, chasing that ad revenue as bounce rates increased and repeat visitors dropped. They sent out 135 badly segmented separate emails in one month! Imagine being a customer, some got 4 a day - how long would you stay subscribed? I cannot imagine what they might be churning out now with the help of AI.

3 Likes

I can only agree with you on that one :joy:

1 Like

Emilio is talking about it in the godot tomorrow stream, too.
https://www.youtube.com/watch?v=iR3E7RAL2vU&t=1468s

2 Likes

Godot should get the hell away from github, at the least. I think this was already suggested by numerous people. No serious open source project deserves to be hosted on this spurious platform. It just leeches out code and feeds it to llms.

On the other hand, promptards are known to have ever-shortening attention spans and this now aggressive wave of fake PRs may just dwindle over time, especially if the bubble pops at some point and llm usage becomes expensive.

1 Like

I’m not a fan of Microsoft owning GitHub, but no matter where the repo is, it’ll be public and therefore scannable by LLMs.

1 Like

Didn’t know he was still doing them. The thread stopped getting updated. Thanks for the link.

1 Like