It's not misogynistic if we're concerned about what the word actually means. It's probably somewhat sexist, though.
I don't think women golfers are lesser than men. They're incredible. But they don't hit the ball as far as men and that was the angle...the distance off the tee.
He could've gone with an old man jab and gotten the same point across. So it's kind of shitty but probably not as bad as Brennan made it out to be re: misogyny.
IMO these things become "problematic" when they start to promote stereotypes and negative images that just make things worse for people more than they provide entertainment via artistic speech. Since this was intended as a private joke and isn't really inventing anything nefarious I see it as more eavesdropping on a raunchy conversation, which we ALL have, than intentionally broadcasting sexism.
I'm sure some people are extremely offended, though.