Even within that bias though...it's kind of not that good, but they assumed it would get really really good because it started off kind of okay. This is where all of it "it will replace all of the coders!" stuff came from, where all it's been able to replace professionally is a small percentage of juniors.
The claims that the models are good at coding largely comes from the coding competitions they've created to put it up against human coders that they have to game the shit out of the rules to benefit the AI models in. The models win, but in most/all cases, the rules were designed in a way that benefits a system that can iterate 1000's of times in the time it takes a human to do it the right way once. Oh, the model got it right on it's 500th attempt faster than it took the human to do it right once? Amazing!!! I think most people can pretty quickly imagine how shit a process that would be to design a business around.
The other criticism I've seen from professionals is that the code is often bloated, inelegant, and shit even when it works so isn't suitable for a lot professional applications without having human coders go back over it and trim it significantly. Which is a problem that tracks with issues it has outside of coding. It's not that it can't do stuff, it just can't do it reliably with autonomy, and requires as much human input to correct it as it would have taken to do it without it in the first place.
Where it seems like it's really good at code is to non and novice coders who can use it to do shit that they would be unable to do it without the assistance of an LLM. It's legit amazing for that because bad code that works is infinitely better than no code. I use it to create bad python scripts that help my workflow pretty regularly now. The scripts work after some fucking about and that's all I give a shit about, but I did quiz up a subreddit with the script it gave me when trying to fix something that wasn't working and the consensus was that it was twice as long as it needed to be and made errors that any trained coder wouldn't.