Thoughts on answering/fixing AI LLM-created garbage code?

I do not have a problem with that. In fact, I think that’s a really good use of LLMs.

I believe you are projecting that thought onto me. I’m not trying to judge you for using an LLM in this post. You are probably unaware of this, but I knew when I linked to your post (and the others), that the link would show up at the bottom of your original post. I wasn’t trying to hide anything here.

Fair enough from your point of view. I think the answer to that personally is, I have no interest in making LLM models better through my time and effort solving their problems. I have better things to do with my time. However, I do like teaching, and helping people learn how to program. It brings me a lot of joy. I feel that fixing an AI’s code only helps the AI become more prolific, and does nothing to actually educate the person asking the question. Keep in mind, no human here owes you an answer. We are here as volunteers trying to help one another.

Having said that, I did, in fact, answer your question completely and fully in #6 of my answer. Not only did I tell you that the AI was giving you false information, I told you how to actually make it work. I can’t help it if you missed that.

Now I admit, I typically answer questions with step-by-step instructions (sometimes including screen shots), but in your case I gave you enough information to feed into your LLM, because I did not want to take a bunch of time doing its job.

But if you have questions about my answer, I’m happy to answer them.

We do. I’ve started using Claude.ai recently because it’s been in the news the past two weeks about how good it’s gotten and I wanted to test it out for myself. I find it quite helpful in certain situations. Like writing batch files for me. Or playing around with complex shader math. But I also know how to read the code it outputs, and decide whether it’s good or not. I also know how to test it’s output, find issues, and tell it how to fix it. I also know how to call it out when it makes up functions that do not exist. I have the knowledge to know when it’s wrong, and the vocabulary to correct it.

Again, I feel that you are projecting the idea that I distrust AI onto me. My post is not about people using it, or posting their questions. It’s about getting feedback on the best way to reply to them in such a way that is helpful, rather than dismissive.

If your post has started with, “AI told me to post this”, you would have gotten different responses, at least in tone if not in content. Sure, I was snarky, but I did still try to help you. I apologize for the snark. But 4.4 (Dev/Beta) is not a version. The version number is shown at the bottom of your editor.

And let’s be clear, your anger at AI for giving you made up information isn’t a reason IMO to have a crappy post or project your frustration onto other people. We are people with lives and games of our own to create. We do not owe you anything. Which is why the majority of responses in this thread so far has been “just ignore them”.

I appreciate that. LLMs are programmed to be nice to you and make you feel good. Us humans are human. Hopefully we can be helpful, but we do have feelings and baggage that LLMs do not.

4 Likes