There are many things we have brought up about his testing. The lack of repetition of testing on multiple knives of the same steel, the lack of a control knife retested on each run, the lack of retests after measuring equipment was changed and test method was altered. What you are talking about is no more important, and no better handled by Ankerson. Fact is, it is uncontrolled in both Vassili and Ankerson's cases. A pretty bevel does not mean anything. What angles are Ankerson's edges, what is the bevel thickness, how old and how often was the ZDP Endura sharpened? Without any of this recorded, without any of it compared to other parameters, in other knives, other profiles, or with other heat treats, you can't say anything about the steels alone.
That is probably the biggest hole in Vassili's testing. What is his worst rated steel? D2. What is his best rated steel? D2. The difference? Probably who made it. Well then, how well do any of Vassili's other rankings/results hold? They don't. Neither do Ankerson's, or unit's, or So-Lo's, or mine, or sodak's, or Thom's, or anybody's. It takes what Sal talked about in testing variations with controls in place.
Does the edge striking the wood matter? If it happens to all tested edges, and you do enough runs, then probably not. Does the change in edge thickness matter on one knife? No more than the change in edge thickness from one knife to another. That does matter in force required to cut, in how that can influence loading on the edge, twisting and harder impacts into the wood from fatigue or sloppiness. But we are too inconsistent from the outset to measure this alone.
The title of this thread is spot on, this stuff is informal and inconclusive. Once you get into the classes we group steels into, like the specific examples given by Phil, the differences require hundreds of cuts into abrasive media, with consistent test media, cut method, and measuring criteria. What is 10 or 20% longer edge life on manila rope without measurement on cardboard, or measurement in corrosion resistance, or differences in impact resistance on multiple axes, or ability to handle prying & torquing? And what does any of that mean if we don't know what angle the edges were formed at, what angle the primary is set at, how thin the blade was ground before sharpening, or what finish was applied to the edge? What steel is better? For what knife? For what task? From which company?
The CATRA test is consistent, the submitted blades are not. I have seen two test results that showed one blade out cut the other by nearly two to one. If I didn't tell you what steel each one was, we would possibly assume one alloy was clearly better. But, it's the same alloy. A proprietary one only produced at one foundry. Same people made the same steel, so obviously there is a lot more to performance than that. Here we have random people making random cuts with random knives in random test media and measuring degradation against random thread, random paper, and random scales. What is the test winner? Impossible to say.
Does any of this testing tell us if we want M390, ZDP-189, S110V, 8Cr13MoV, etc? Or does it tell us if we want Benchmade, Spyderco, Kershaw, etc? Or does it tell us if we want a Military, and Endura, a Police, a Stretch, etc? It doesn't tell us anything because it is talking about everything all at once.