
Every time I test and LLM solution and am pleased with how well it works, and I look at the code and it looks reasonable, it’s a lie. It may work, and even look okay, but unless the change was minuscule it’s always doing weird things when I look closely. By the time I’m done fixing the code I could have done it significantly faster myself.
Edit: in case anyone is wondering I only ever use frontier models (the anthropic and openAI ones), I have unlimited access to them from work and mandates to use them.

I do agree it’s pretty helpful for remembering things I don’t use often or finding APIs for things I haven’t done before. Also not a bad rubber duck. Not worth burning the planet for, but smaller local models that can handle this job I’d be happy to have in my workflow