All please keep in mind that the largest difference here is the tests themselves. Even if the testers were to exchange equipment, attempt to mimic the other's procedure and sharpening, and report environmental conditions for each test - the two test procedures themselves are completely different. If Vassili started cutting on a scale, and Ankerson started cutting thread at regular intervals, their results still don't correspond to the results of each of their original tests.
When during the course of his testing does Vassili reach 20 lbs of force to cut through the rope? When is there contact with wood? I agree that since all of Ankerson's cutting involves wood contact that it does not compromise the results - but what it does is makes the test that much more differentiated from Vassili's. When does Ankerson push cut through thread? When does he stop at a predetermined number of rope cuts? They are doing two completely different things with their knives, the only thing in common is that they are using some type of manila rope. For Vassili, it doesn't matter how much force it takes to cut the rope, while that is the performance measure Ankerson grades on. For Ankerson, it doesn't matter how well the edge push cuts thread, while this force is what Vassili grades from.
They would probably have to combine the tests to possibly make a meaningful comparison. Cut the same size rope under as similar as possible conditions, measuring the push cutting force on the same thread with the same scale at the same intervals, while also tracking the force needed to cut the rope on the same scale as well. Push cutting sharpness up to 200 cuts and total number of cuts up to 20 lbs of force would need to both be recorded. The same sharpening system would need to be used, to the same finish and angle, with the same measured sharpness at the start of each test.
That is if you want to compare the tests. They are fine as they are for looking at independently, but you cannot say one is better than the other, since they are different things. Variability exists in both, and it makes repeatable results difficult for a very high level of precision.
Now, for me an issue has always been just how finely must we differentiate the steels themselves? If you control as best you can all the factors you can think of, and the steels score so closely that a change in the weather reverses the ranking - then does it matter that much at that point? I think that you are then dealing with steels too close to bother with worrying about terminal performance differences. Availability, cost, and other factors outside of edge life then become even more important in deciding. Vassili makes very definite decisions about what steel is superior, but many of them are terribly close in measured force, and they aren't tested/evaluated for other factors. Ankerson chooses not to disclose raw data, so we don't know just how different the steels are. He has also told us that the same alloy can more than double the performance by being used in a different knife (geometry and heat treat) They are doing a lot of work, and providing results to the community-but I don't think the results should be used to criticize others. Nothing is perfect, but there is a lot of effort put forth.
It is very difficult (well, impossible) to precisely evaluate alloying when you are actually evaluating a lot more than that all at the same time.