Sorry, part of that was me assuming you are only basing this off of things like Corsi etc.. There are a lot of in depth information that can be found on twitter pages like Stephen Burtch's.
It doesn't take 3-5 years to figure out if they are effective. You can see them today with the Leafs and you can see them today with other teams around the league. We have the ability to go back and monitor how other teams have performed and use them to test the hypothesis' they have.
A ton of information has been collected, people can put it together and test it asap. Its not like it all started fresh when Dubas was hired. He also likely has brought in some of his own ideas that he was worked on in junior too.
Babs/Det built/coached puck possession teams long before these so called possession stats were around so why should i give credit for Babs coaching to our stats guys ? I have no idea what stats teams value or don't but in our case the stats guys haven't been around long enough to gauge whether they've been effective at there job or not imo .
That is blatantly false. He says you need to be aware of cognitive bias, and that to rely on the eye test alone isn't enough. He never said anything remotely close to saying that scouting players is irrelevant.
But to your original question of what has he done - aside from running one of the most successful AHL eams, he oversees the Leafs analytics department - which helps to inform the decision making process of the team - which as impacted both the pro and amateurs scouting.
So sure, it can be difficult to point to what exactly has he done - but I'd argue it's pretty hard to seperate with the Leafs current management team who has specifically done what. You could say the same for Lou, or even Hunter too (ie the Leafs draft selections are likely also guided by statistical analysis as well as the eye test).
Again Dubas wasn't even around when most of these guys were even acquired so stop acting like he built this team overnight and has full control over the roster . Also if we graduate a large number of players and the team plummets in the standings are you going to say he's to blame for the teams performance ?
It's difficult to know exactly who was behind every decision but this i do know
Shanny - is at the top of the food chain and over sees operations but it seems he doesn't micromanage any aspect of operations and is there mainly to make sure the ship is pointed in the right direction
LL - he said he was hired to run hockey club and there's no reason believe otherwise , sure he gets input from his underlings but at the end of the day he has the final say
Hunter - built/runs the scouting dept and LL/Shanny have both come out and said as much and while i'm sure he gets information from the stats guys which he may or may not use he isn't "guided" by them which infers they're dictating who and who not to draft . His performance will be easy to gauge in the coming years .
Babs - no explanation needed
Dubas - Ass't GM Head of stats department and gm of Marlies , his performance is the most difficult to gauge as well as his influence in the decision making process . He may or may not have much influence and maybe the only way to evaluate his impact on the club is if he takes over from LL down the road .