I think it's naive to think fans have an understanding of the actual statistics teams use to put together their rosters.
Derrick Lalonde all but admitted to using statistics and video review together in helping shape their d zone coverage when they won cups in Tampa. no need to be afraid of math its all around you and if teams can use it to further their advantage then they should invest in it. Statistical analysis in a luck based sport is not perfect but it is 100% helpful. I know you think you got some kind of Gotcha with Justin Holl on me but you don't considering he actually was not a bad number 4 in the regular season.
Absolutely, and another example of lacking context for those stats too.
Which is the main reason why there is hesitancy with +/- as a stat. I personally think there is some value to it, but of course you need context on it.
Holl was on the ice for 70% of the goals against. That is factual. Usually, not a good thing. Certainly a correlation worth exploring. The thing is, and this is why I really question people's eye tests, is that when you do dig deeper, you see that on more than a few of those goals, he is far from the reason why it went in the net. Forwards were missing assignments. Samsonov let some really soft goals in the net. Some really poor play from his partners. Sure Holl messed up too on some of them, and he, like many of the other defensemen on our team, had a rough playoffs at times.
Since I feel as though people will get too caught up in the biases of using names, I will just use a very simple to understand (and likely unrealistic) example: *
Disclaimer, I am in no way saying that this applies to Justin Holl specifically and I do not want to suggest this is how it is when Holl is on the ice.
Say there is a defense pairing. We'll call them Pairing A. They play 25 minutes a night against tough competition. Never gives up anything more than a couple unscreened, undeflected floaters from the blue line... In other words, shots that the goalie should be making close to 100% of the time. But the goalie, for whatever reason, can't save it for crap. Goes in every time, 2 or 3 times a game. For the other 35 minutes, he is the best ice hockey goalie to ever grace this earth even though the other two pairings are complete tire fires and shouldn't even be in the NHL. Rarely gives up a goal, regardless of it being a Grade A one-timer or a breakaway.
Pairing A is probably on the ice for let's say 90% of the GA. So statistically, or at least in that statistic, they obviously suck. However, looking at their other statistics or even just watching them on the ice, anyone would see that clearly it is not their fault as much as the goalie on the ice. The goalie would have a brutal xGSA with Pairing A on the ice. They'd probably have the best underlying metrics in NHL history (and yes, even those require context).
Meanwhile, the other two pairings would be the polar opposites. Terrible underlying numbers but their actual numbers are great.
If Pairing A's goalie makes the saves he is supposed to make, they are likely never on the ice for a goal against for as long as they continue playing like they have. Meanwhile, the other two pairings likely find themselves out of work very fast as soon as the goalie stops bailing them out. Which would you prefer? I would think anyone with eyes would still take Pairing A, but at the same time, there are very few times when it is that obvious of a discrepancy as well.
People who are actually good at statistics and analytics know how to find and understand this context, or when a stat does not tell the entire story about a player, and they know that it does not exclusively come from looking at a spreadsheet... Which is exactly why that is not what they do. Of course, it also does not exclusively come from their eye test either. The good ones are able to find the best associations between statistics and know how to apply statistics to reality; for example:
- Is there a relationship between xGA and GA? Spoiler: A fairly strong positive correlation between the two.
- Do we care about a lot of chances or just having a few good ones?
- Is there anything supporting a player continuing to have a 20% shooting percentage long term, or is he just on a hot streak?
- Is Pairing A really as bad as their GA numbers suggest, or is there something else involved?
These are easier questions an NHL analytics department would be able to answer, with numbers alone, but there would never be a decision made without getting a scout or even an analytics person themselves (since believe it or not, people who work in NHL analytics departments often know more about hockey than a typical fan) to confirm the numbers. And the best teams are able to leverage both of those perspectives harmonically to be able to make the best, or at least most informed, decisions possible. And the more informed decisions you make, the better chance you are to make the decisions which lead to good results.
But I think the main lesson to glean from what I said is that analytics people do not just look at spreadsheets. At least not the good ones. I do not work for the Leafs, but I would be willing to bet that they are not only looking at spreadsheets either. As for Justin Holl, it has been proven time and again that most people's eye-tests on him are extremely biased at best or downright faulty at worst... And he is a lot better than the scrub they think he is.