For the soundness of the debate, I don't think the "You said!", "No, I didn't!", "He said!", "No, he didn't!" way of discussing is very fruitful. So I'll just let my previous written words stand, just like you let your stand, and try to focus on what I mean.
If attempting to calculate an "environment and era adjusted career +/-", for me it would be natural to think:
1. Adjust all seasonal ESGF, ESGA, +/-, time units for each player so that different seasons are comparable.
2. Calculate seasonal "without" ESGF, ESGA, +/-, time units for each player. Adjust them so that they are based on the same minutes on ice as the player.
3. (We now have the seasonal "with" and "without", both in the same "unit".)
4. Aggregate season by season. Handle time units wisely.
5. (We now have career "with" and "without".)
6. Combine "with" and "without" to produce an "environment adjusted" +/-.
We then show our results to the reader:
Raw +/- with | adj +/- with | adj +/- without | environment adjusted +/- | Diff | Diff %
||||
(Difference is between "environment adjusted" and "non-environment adjusted". For example it may differ by -40, or by + 140 %, or -25 %.)
If readers would be curious about instead/also see at ESGF (or ESGA), it would be easy to do so. One just instead shows:
Raw ESGF with | adj ESGF with | adj ESGF without | environment adjusted ESGF | Diff | Diff %
||||
My list of steps above does not detail everything about each step.
Now, I'll turn to R-On and R-Off, and my objections regarding them.
Instead of looking at them at something almost "divine" that one trusts more or less "blindly" ("because overpass knows what he's doing"), it should be OK to question them. They may be great, if so it might soon be showed.
I would say that R-On and R-Off should be attempted to be calculated
after steps 1-6 above.
What they turn out to be, depends on how we use "adj +/- with" and "adj +/- without". Considering all the different ways they can be combined in to give the "environment adjusted +/-", I would consider the results (R-On and R-Off) very arbitrary.
R-On is an arbitrary calculated equivalent of my "adj +/- with".
R-Off is an arbitrary calculated equivalent of my "adj +/-" without".
Overpass environment adjusted +/- is a result of an arbitrary calculation using those two arbitrary values adjusted by an arbitrary exponent.
One might look upon R-On and R-Off as the "diff %" column above. It should be calculated last, and is the result of our arbitrary tweaking of "adj +/- with".
I admit it may look appealing show "with" and "without" as two ratios (R-On and R-Off).
But in reality, all we know is that R-On above 1 is basically "better than average" while R-On below 1 is "worse than average". The rest appears very unreliable. 1.2, 1.6, 1.1, 1.4 are all just numbers saying "above average", we can't really rank them saying one is better than the other. Same with R-Off, we only can see if above, at, or below average, not really say much more.
The same thing can be decided just by looking at the "adj +/- with" and "adj +/- without".
Actually, I think looking at them instead would be more telling.
Now I'll continue to try to explain more about why using adjusted +/-.
I think instead of showing those R-On and R-Off (which I consider unreliable, arbitrary and flawed), why not instead show "adj +/-" divided by the time unit.
It would be similar to those "per 60 min" stats that are around on the Internet. In this case, one can adjust it to "per season".
Get rid of R-On and R-Off.
Instead show "adj +/- with per season" and "adj +/- without per season".
Then we'll have an even clearer picture:
Raw +/- with | adj +/- with | adj +/- without | env adjusted +/- | Diff | Diff % | adj +/- with /seas | adj +/- without /seas | env adjusted +/- /seas
|||||||
The "/seas" columns will be the equivalents of the ratios. Instead of showing values from say "2.0 to 0.1", we will show +/- in the range of say "+60 to -60". It will be as easy for the reader to see how players compare to average (which is 0 now, instead of 1 as in the case of the ratios). The difference is that instead of showing ESGF divided by ESGA, we show something based on ESGF-ESGA (+/-).
If I haven't already said it, I see no need to divide ESGF by ESGA.
Example (both players having same ice time):
ESGF=10, ESGA=6, ES+/- = +4. Quota = 1.667
ESGF=4, ESGA=2, ES+/- = +2. Quota = 2.000
I think +4 is better than +2. I think using quotas should be avoided.
I have done these things myself previously, for NHL mostly in 2002-03. One can very well argue that just comparing "with" and "without" makes for comparing apples with oranges.
One just can look at stats for single seasons. What would different players "environment adjusted +/-" look like? A simple assumpion might be that ideally player's tadj+/- would look pretty similar from year to year. Does it look similar from year to year based on overpass' method?
(I know aggregating seasons might make bias become lesser, but anyway.)
It was just an example.
Why take the .65 exponent like Overpass does? (I know he explained his reasons.)
It may depend on how ones does things, including in which order.
I would say what we start with is the raw data.