Roger Smith :
I don't understand why anyone would have an issue w/ Cliff's tests. What's the story or am I asking a sensitive question?
Essentially, there are a few main arguments
1) They are not scientific, but are promoted as such either because I don't understand what science is, don't understand how to do proper numerical analysis, or intentionally ignore it
2) They are biased, meaning the results are distorted (intentionally or subconsciously) based on feeling towards various makers / manufacturers
3) I am don't know what I am doing because of a lack of "real life / field" experience
4) The knives are not used in the manner that they are intended to be used, which is probably because of three
5) The tests are too abusive and the results meaningless because you can't conclude anything from such extreme work
There is merit to most of above, to some extent. I mention such factors from time to time in the reviews, and have looked at some of them in detail to see just how much influence they have. For example, thanks to Ray Kirk I had four identical unmarked blades (different steels and hardness) to work with which allowed me to see if I was without knowing it, projecting my expectations of blade performance onto the knives, I wasn't.
The biggest problem with interpreting the results in general, is dealing with two main factors :
1) the quality control of the blades, how much one you buy will be similar to mine
2) the effect of my method and physical abilities, for example if your chopping technique is better than mine, you will experience better edge durability and edge retention with the exact same blade
You get around one by simply asking the maker or manufacturer if they will support the results. You get around two by looking at the relative performance as well as dropping me an email to discuss your own experience so we can compare and project. Of course you also spend time discussing knives with other people to round out the perspective, there are dozens in this very forum alone. Finally, you get blade experience any way you can. if all you can do is chop some 2x4's in your basement, that is *much* better than nothing.
The real problem with the reviews is quite simple, some knives do very poorly in comparison to others and I do a lot of direct comparison work. Secondly I have called a lot of makers on hyping performance without backing it up, this doesn't tend to make a positive impression on them. Finally a lot of nonsense has been spread by people who have been put off by the first two effects, for example that I am paid by Jerry Busse to say positive things about his knives, that I set out to ruin knifemakers who don't give me knives etc. . This by the way is the source of the whole "I am Jerry Busse" thing you will see referenced on occasion. That was another rumor.
I don't pay any of that much heed, I know who I am and what I do. If you want to actually discuss knives, based on experience or knowledge of materials or geometry, then by all means drop me an email or make a post. I have learned a lot from such interactions and will continue to do so. And when I realize that I was mistaken about something either through a lack of experience or knowledge, I'll make a post to address it. But in general, you can't please everyone, and I realized a long time ago that if I was going to speak about performance in an unbiased way I was not going to please the people behind the blades who didn't rate very strongly. So be it. I would much rather have the respect of experienced users and makers of quality blades.
-Cliff