As I recall they went through some tough times about that too and even posted about the frustration of repeatedly having to defend their findings also.
Those types of ad hominem attacks are common simply because the enviroments permits them. If a maker/manufacturer took the same approach to work done as noted in the above, quite frankly, they would look idiotic. It would be absurd to imply that a large group of individuals were involved in a mass conspiracy to defame them when the individuals didn't even know the details of the knife evaluated.
You have already said you can't do anything about it also.
I can't stop misinformation and hype from manufacturers/makers and quite frankly I would not argue that any individual should have that authority. However what I can do is try to create a source of objective information for people who are so interested.
Would the information about what the steel was and who got the duds ever get out?
Yes, once the evaluations were completed for exactly the reasons you noted.
How many people are you looking for? Will you (Cliff) pay for all the test knives or will the members of the test group all put in something?
There isn't a limit, not everyone will be interested in every knife and many knives will be evaluated at the same time. No there is no cost to you besides the small shipping cost.
To only see the performance of steels and primary grinds overlooks one of the most important features.
Individuals are free to set their preference on criteria, if aesthetics are yours then that is fine. Each reviewer is likely to have his own.
That 's why i think it's a good idea. I would have liked to participate but shipping to the other shore and understand my "english" would be a serious issue for you.
Shipping isn't a concern as long as it is legal for you to recieve/own the knives. Your english isn't a concern either, I can understand what you say and I am sure we can work out any details.
[post]
Have you seen this to be a problem?
I have had one package lost, folders are a real issue because any inertial opening can be seized if the inspector decides he like it because the law is really vague.
If you're shipping knives out that have deliberately bad heat-treatment make absolutely SURE that your testers know that they might get a knife that will shatter and send razor-sharp bits of steel flying about the room if they break it.
In general you should always take care when using a knife,as it is never known when a steel could have a hidden defect that the maker didn't even know about. However the type of problems I am talking about are not of that class and they are inherent on a random basis in all knives.
The main reason I will be intentionally having less than optimal knives is to prevent the universal glowing reviews where everything is excellent. You should go into this with a critical eye and be looking for problems. This is in fact how you should approach any evaluation.
As noted, the purpose here is not to promote some knife or steel, which is a common problem with many reviews. The purpose here is to learn, not only about knives and steels but how to evaluate them in a meaningful manner.
Oh, and are you planning on double-blinding it somehow, so the person sending the knives (or communicating with the testers) isn't the same person that labelled them and knows the maker, heat treat, steel, etc?
Yes. There are some issues with this but they will be worked out in process. I am also looking into getting specifical materials testing done on the blades at the end of the review. But as with any experiment, perfection isn't the goal of the first iteration.
-Cliff