hardheart said:
The knife rags do very similar tests on knives, but I haven't noticed them doing the same set of tests consistently. On one knife test or comparison, they'll slice cardboard, on another they'll forego the cardboard and use rope, on yet another they go for rubber hoses, etc. The reviewer will cut rope with more knives on more tests, but he might not do it for every knife he tests.
Sure, that's what the knife rags do. And, speaking frankly, I think this type of review is only a half-step beyond a review that only consists of a visual inspection and report. A knife "test" in a vacuum doesn't tell me anything. Knowing that "I made 50 cuts of hemp rope and it still shaved!" tells me almost nothing about what I should expect of that knife's performance. Of course, for the magazines, this makes perfect sense: by always testing knives against each other, they always risk irritating whichever knife "loses" in testing, and that means risking advertising dollars.
But, just because it doesn't make sense for a magazine, doesn't mean we here on the internet shouldn't be doing it. In fact, the situation is almost reversed: there's almost no reason for us to go through the work of giving a knife a workout by itself (resulting in nearly-irrelevant, context-free data), when a tiny bit more marginal work of testing a benchmark knife will yield really interesting, useful data. It's why I sometimes get frustrated when a well-meaning knife enthusiast puts a
ton of thought and effort into his testing, and misses the simple step of testing another knife along with it -- all that effort for context-less data that's only as fraction as useful as it could be.
One other thing, I don't think everyone has to use the same benchmark (or set of benchmark) knives. The important thing it provide a basis for comparison, in my opinion... not everyone has to use the same benchmark in order for some valid extrapolation to be done.
Not trying to discourage you here, BTW! A set of core tests we all do seems like a reasonable enough goal, though again the tests will have to be supplemented for different knives ... I can't imagine it would make sense to put a Calypso Jr through anything close to the tests you'd want to put, say, an SMF through, or to have the same tests for a Battle Mistress and Deerhunter. But it doesn't make sense to go through all this effort, without coming to some guidance on a testing methodology (obviously, I favor using a set of benchmark knives versus the test knife) ... in fact, I think the methodology may be important than the core tests!
Joe
PS A good example of what I'm saying: over on the Spyderco forum, we've known for a long time about how the Yojimbo and Ronin perform in slicing through meat (simulating a defensive slash). But one guy took it upon himself to re-do these tests with 5 or 6 other knives ... all of a sudden, we had a basis of comparison on what the Yojimbo's tests results are. Suddenly, the results were fascinating, because we could see what kinds of results are really special.