Cliff Stamp

Originally posted by Gollnick



Unfortunately, right now the knife industry does not have an accepted set of tests. There is no accepted scientific protocol for testing knives. Until such a protocol is developed, there can be nothing but subjective reviews.


That is a brilliant idea! Wouldn't it be great if we could have the equivalent of 0-60mph, 1/4mile, top speed, braking distance from 80mph etc. in the knife industry? Or what about something like Chronometer certification by the COSC (wristwatches) for knives?? Of course, this would mainly apply to production knives since no two customs are exactly alike (theoretically).

Originally posted by Gollnick

And, as long as there are nothing but subjective reviews, there will be arguments about the validity of those reviews.

Well, in fairness, I think that there would be issues with "true" scientific tests as well. For example, look at the way crash tests are conducted...how often do real world factors replicate the lab tests? Look at the Cold Steel (or Busse) videos...how often are they criticized?? People will always have issues with tests that show their favourite products in a negative light. Medusaoblongata raised an excellent point "If someone says that a certain knife can take 32.423 kg of weight at 2.984 inches from the pivot at an angle of 19.47 degrees without damage"...what the Hell does that mean? (to paraphrase :) )

As for Cliff...I like his tests (and he has always been helpful to me)...sure they might be a bit extreme at times...so what? Didn't Saab drive a car at top speed for 48 hours straight to simulate 19 years of driving??

The bottom line is that I agree with all the comments that suggest Cliff's dissenters should focus on doing their own testing rather than criticizing.

RL
 
I don't think it makes much sense to tell people that they can't criticize tests if they aren't performing their own tests.

Don't any of you ever criticize the president? How often do you have to perform his duties?

For that matter, have any of you ever criticized anyone that was different than you? Of course you have.

Criticism is needed: it is the voice of the people. If no one ever criticized the government, where would we be? What if you guys didn't criticize knife makers for crappy designs or QC? Well you can criticize a knife maker without making knives, can't you?

If everyone criticized Cliff for his tests, I bet he'd give up soon. After all, why publish tests if no one wants them and everyone is telling you to piss off? In the same vein, if no one criticizes Cliff, he doesn't know what's being rejected by the community. As it stands now, he can choose to accept or reject criticisms and he can choose what advice to integrate into his tests. I think that's healthy: it's called "discussion."
 
Exactly. The problem I have with Mr. Stamp's "testing" is that it's not quantitiative and it is not repeatable. It's totally subjective. There is no way that someone else could verify his results by duplicating his tests and achieving the same results. That's part of definition of science, that the results can be duplicated independently.
Cliff tells us what he does, so there is nothing to stop others from trying the same things and seeing what results they get. I'm not saying what Cliff does and how he reports makes for "exact science", but it isn't "totally subjective" either. Other people trying the same thing should (if Cliff is being honest with us) get results that approximate what Cliff gets, even if they aren't exactly the same. Two knives whose performance is a "close call" on one of Cliff's tests might come out reversed, but still close for another tester, while knives that are miles apart in performance for Cliff, should still show the same relationship if a different magnitude of difference in someone else's hands, etc.

Like the man said, since no one else is doing this work, we just don't know how "objective" or "subjective" Cliff's results really are. His method alone however, being published, is more-or-less repeatable at least...

As for the propriety of some of the tests, that's up to the reader to decide for him/herself, and the makers really shouldn't worry about it unless they are making unrealistic claims as regards indestructability. If I buy a knife that is supposed to let me leverage up a 175lb rock slab with the last 1" of its tip, then I am indeed interested to learn how that tip performs when clamped in a vice and bent over with a pipe around the handle! On the other hand, if Cliff tells me that one skinner broke when he jammed it 1/4" into oak and slapped it sideways, while another didn't, I would still buy the first knife if it SKINS better cause I don't expect to be trying to pry joints apart with the tip. I hope you see what I'm trying to get at here...

To some degree, Cliff is not just testing KNIVES, but also manufacturer CLAIMS about knives. I also agree that Cliff is in a position to damage reputations or make/break <i>some</i> sales. If he is being dishonest with us, then we only think we have learned something from his work, it isn't real at all. OTOH, if he is really doing all this hacking on wood and reporting what he finds accurately about his hacking tools, then we do indeed learn something, and I would also expect a certain percentage of the woody growth in a certain part of North America (the Continent) to be considerably thinned out over the next few years...
 
Originally posted by ThinkOfTheChildren
I don't think it makes much sense to tell people that they can't criticize tests if they aren't performing their own tests.

Don't any of you ever criticize the president? How often do you have to perform his duties?


I'm not sure whether that was directed at me...but I'll take the liberty of responding anyway :)

From my perspective, I am not saying that people can't criticize, I just think that it would be more productive to focus their energy elsewhere (like doing their own tests)...As Ron@SOG sais, "Almost no manufacturer will publish the kind of data everyone wants."

As for the President...what is more productive, to sit around the dinner table and criticize him or to ACT by voting for someone else, writing editorials, or raising awareness through other means???

RL
 
Originally posted by Ron@SOG
Much of Cliff's data doesn't count because it is both unscientific
and hints of biased. The argument that "since no one else is doing it......" I'm sorry, if the reseach isn't good, it is still bad research.

Even if it is unscientific, every report we read here is unscientific. Should we stop reading them all? Unscientific results are not scientific, that does not make them meaningless. Science is not the only way we can learn from or understand things. Many of my purchases have been informed by what people have posted about various knives, much of what I've read about knives is true and useful, even if it is unscientific. Virtually all of the information we have is unscientific, that doesn't make it meaningless.

Cliff isn't god, nor is he the god of knife testing. He's just one guy who writes about knives. Every person here is just another guy (or girl) who writes about knives. We each choose to ignore some people's posts and study those of others. Each claim must be taken in context and in perspective. If you read all of what I've written in 1752 posts so far, none of it is scientific, does that mean that none of it counts? Should my posts be ignored entirely specifically and solely because that which I have posted is not scientific and therefore doesn't count? No (at least I hope not :)), it shouldn't be ignored, it should be taken in perspective and people should read my posts for what they are: one guy's experience. I read Cliff's posts the same way, as one guy's experience with certain knives. We do see that certain knives perform very differently for different people, and we have to take that into account when interpreting that information, but if only one guy's talking about the limitations of certain knives, then we have nothing to compare it to and nothing with which to balance it out. If six (or even better, sixty) other people did similar (i.e., not scientificly identical) tests with the same knife, we could compare their results and make informed decisions accordingly, but, unfortunately, we don't have that type of information...

If the research isn't good (enough), then we need better research. If that's the best, or only, research we have, what else do we have to go on? It doesn't have to be scientific to be useful.
 
RL,
Not directly at you, but you are part of the group I was addressing, I guess.
Yes, voting is more productive than sitting in private and bitching. But by posting here, publicly, people are in a sense voting (on both sides). They are making their voices heard and drawing lines in the sand.
Not everyone has the time to do the stuff that Cliff does. By taking five minutes out of their day, however, maybe they can persuade him to change something about what he does. So while some people might spend a whole lot of time bitching without actually doing something, other people chime in just once, say their peace, and get on with their business. So I guess I will partially agree with you. I.E. some people could better spend their time (I'm not implicating anyone here, rather making a general statement) while some people are spending their time best by participating in threads like these.
 
To those who say that there is no one doing real world tests on knives, you are wrong. Jeff Randall takes knives out into the wilderness and into jungles and uses them for weeks on end doing everything to the knives he takes that they were designed to do. He puts them through their paces and then reports on what he found. I respect what Jeff has to say very much, but his tests are not repeatable either. They are also not scientific, but they sure tell me one heck of a lot about knives.

I get a lot of useful information from Cliff as well, but I can understand why manufacturers and knife makers don't like the tests that Cliff performs. These test reports can be very harmful to a company or maker and I do think that Cliff should understand the damage he can do. In my opinion, he should put knives through tests that will show how well they will do the jobs they were intended to do. Not tests that are meaningless because no knife is ever likely to have to do what he is putting them through. Tests such as beating a knife to death by hitting it on the side of the blade with a pipe do not tell anyone how well a knife will stand up to even the worst abuse it is likely to encounter.
 
Jason, that was an EXCELLENT post (although I have not tested it scientifically :) )...you said everything I wanted to say!

RL
 
Originally posted by ThinkOfTheChildren
I don't think it makes much sense to tell people that they can't criticize tests if they aren't performing their own tests.

Criticism is needed: it is the voice of the people. If no one ever criticized the government, where would we be? What if you guys didn't criticize knife makers for crappy designs or QC? Well you can criticize a knife maker without making knives, can't you?

if no one criticizes Cliff, he doesn't know what's being rejected by the community. As it stands now, he can choose to accept or reject criticisms and he can choose what advice to integrate into his tests. I think that's healthy: it's called "discussion."

Discussion and constructive criticism, suggestions, requests for clarification and further testing, etc., are all helpful. What is not helpful is when people say, "Cliff Stamp is full of #%#." Specific criticisms are very helpful and Cliff welcomes them. The type of criticism I find useless is blanket rejection that neither provides nor suggests improved methods of testing. If you want us to throw all Cliff's tests out the window, you're gonna have to provide something better with which to replace them. If you want to try to help Cliff improve his tests, I don't think anyone will complain. You don't have to be a better knife tester to offer comments or criticisms, but those who want to call Cliff's tests worthless without offering anything else in their place aren't helping anything at all.
 
I've been reading Cliffs reviews for a few years now and I find them helpful to a certain extent.However I think any comparisons between knives are very difficult to make,particularly since the personalities of testers and knifemakers inevitably influence the results.As do the personal technique,and preferences of the tester.What works for Cliff doesn't always work for me,and what works for me,Cliff breaks.
 
Somewhat off topic but this damaging sales point of view has been coming up during this discussion.

Some say that Cliffs Tests may damage/ruin some companys business. I have hard time in believing in it. Bad marketing and bad products do it. To put his works impact into a perspective this forum has 16000 members and I don't belive that ten times this amount of people has read one/some of Cliffs tests AND rejected certain knife/knife company because of his tests (I don't belive that even all of us 16000 has read one of his tests). Even this wouldn't have lovered sale of a particular knife but a few thousands (I belive that really only some tens). There are 300M people in states...

Another comparison that may not be informative at all:
I am working in field of nuclear safety and compare Cliffs harmfullness to a population (of knife sales) in terms of my work field: manSv is measure that tells how much radiationenergy has absorbed to whole population. There are scientifically accepted statistical approximations how many deaths a manSv causes during a certain time. Still it is generally not possible to say what caused the cancer that a certain person died for. Chernobyl should cause 50000 deaths in a population of 100M people during 50 years. So a person could die because of Chernobyl caused cancer in 0,05% propability while that same person dies because of cancer in 20% propability any way. I dare to say that Cliff is very much less dangerous to a knife sale and thus to a knife company than Chernobyl to me (living in Europe). To me it looks that fraction of fraction of percent scale sale loss should be invisible in a companys financial state when I see how book-keeping is handeled in states... ;)

I belive that Cliff has damaged someones business when I see a published ;) consumer raport where randomly chosen citizens that have bought a knife mention Cliff as one of top ten reasons not to buy a knife by a certain company.

If Cliff had complains about some custom makers knives (maker that has significant sales based on BF members) then he could damage someones business but a companys???

BTW I don't buy same knives that Cliff do but I like to read his tests. If some test doesn't make sense to me I try to think what he wants to learn doing that test and if it is relevant to me. I have altered my ways to evaluate knives because of this thinking.
 
I'm not sure about the claims that Cliff's results aren't reproducible. He not only says what his test is, he often describes exactly what he's done with the edge first. And because he usually includes a comparison knife in the tests, if you tried to reproduce the results, you could gauge your results against his not just in absolute terms, but as relative results between the knives. In my view, Cliff's tests are more reproducible than most. I also don't necessarily buy into the claim that because the tests aren't done precisely -- as in, by machine -- they aren't applicable. Tests of many products have human components; if you read of a car not handling well in a slalom test, do you automatically reject the results because it's a human driving the course? The person doing the test just needs to take care to make the tests precise enough to draw conclusions from -- the more slop, the weaker the conclusion he should draw.

Even when Cliff designs a test that I believe is more robust than is applicable to that particular knife, I can learn something from the results. Note, I didn't say that I necessarily then apply the results to my opinion of the knife, just that I can learn something.

Ron, I do understand why you're irritated, and from what I recall, testing of one SOG knife (a fixed blade maybe) seemed particularly over the top. Again, I ignore much of that particular review, though you obviously can't.

Joe
 
...but when he, Joe Talmadge, or Steve Harvey (most of the time, Steve's about crazy as $hit too ;)) have ever posted anything in regard to knife performance, I've set my watch by it and have never been disappointed.

These fellas are what I consider to be some of the "founding fathers" of knife testing and written review on these forums, and while maybe not necessarily 100% scientific in terms of method, more important to me, I believe what they are saying. I always envision myself subjecting things to utter torture as I'm reading their posts. It's somewhat therapeutic...

Sorry that they may have rubbed some makers/manufacturers the wrong way over the years, but that's the nature of the beast. Somebody's gotta do it! It should be viewed as an opportunity to improve, but it's not hard to see the difficulty with that in regard to a knife in mass production already.

Keep doin' what you do fellas!

Professor.
 
I've read Cliff's reviews and found them useful - to an extent. I doubt I will ever stress my blades the way he tests. And so what if they aren't cutting edge (pun) science - that's what he does. Other can do their own testing if they please. That being said I find the makers reactions most interesting. The flames that erupt over a broken knife (or two) and the counterclaims make me question the maker more than Cliff - see the MD encouter. Any knife can be broken if abused - and let's face it Cliff pushes many knives to failure through what most can agree is abuse for a knife. Perhaps makers should just fess up and say their blade failed and move on - I think most can tell Cliff tortured their knife. I tend to agree that Cliff isn't going to have much impact on the sales of most makers (SOG included). Decent products and customer service make or break the manufactures. Yes, Ron - I like SOG, have several and plan to buy several more.
 
Joe :

Sometimes Cliff's test results are different from what I experience in the real world, e.g., his Ontario machetes falling apart in testing ...

The Ontario's broke during the worst kind of wood working, limbing dead branches in sweeping cuts, which is one of the worst things you can do with a knife period. They handled lots of other wood work fine, and can handle dead branch trimming when done in a less stressful manner, this is where skill and power come into play. I am at odds on how to handle such issues. It isn't something that I would ever do task wise (I would rate it as far more abusive than chopping into a concrete block) but it is common technique now. To clarify, my problem with the Ontario machetes isn't that they failed, any knife should have problems with that task, unless they are vastly overbuilt for wood working. Its the way in which they failed, huge edge blow outs. The machetes don't have the toughness of something like the Martindales which will just see edge rippling under the same work. However, I had QC problems with Ontario, some were too hard and others too soft. My two machetes may have just been over hardened.

Medusaoblongata :

That guy has made more enemies in the knife world than just about anyone else, and it doesn't seem to phase him at all.

The vast majority is from people selling over hyped products. It is the expected behaviour so it doesn't bother me. Of course it doesn't happen in every case, on occasion people will admit there is a problem. For example, recently on rec.knives Kyocera was blasted by Steve Bottorff :

... the incorrect and misleading information about ceramic knives found on your websites (and copied without modification on many of your dealer's websites) is tarnishing your image.

Now, how do you think Ron would react if I used this line on him (check past posts for the answer as I have said similar things), or see how Randall reacted when I commented that his webpage on the RTAK was misleading. I supported Steves comments as did several others. Mark Murphy from Kyocera came into the discussion and kept it to a debate on the issues (not on the people), and in the end was discussing how to rewrite the info on the website to be more accurate.

In regards to the Recondo, yes, some of the work done was fairly extreme, though at the limits of what has been suggested by many to be in line for "tactical" knives (weapon vs weapon impacts), and it was only a part of the review. In perspective, the usage of the the Basic from Busse Combat was more extreme, as are aspects of other reviews (chain impacts on khukuris for example). The Recondo review is actually one of the ones I send to makers/manufactures when they ask about work that I do. Not because I think it is one of the better ones, I think the newer ones have improved, however it allows me to see if they can see past the extreme parts and discuss the review in a practical, and unemotional, manner. Some can, and some can't. As long as there are those that can, there really isn't any need to be concerned about those that can't. The manufactures that do extensive R&D have seen piles of broken and mauled blades. Unlike Ron who commented
(recondo review thread ) :

It's never settling seeing a knife in that condition ...

to them its just another piece of data, not something to get emotional about. And again, this is just one aspect of the reviews, and in fact, is not even close to being the majority of the work done.

I have read allegations that Cliff gets paid to do some of his tests. I haven't seen any evidence one way or the other. I would like to see some evidence or at least to hear Cliff respond to this allegation ...

No, I don't, in fact I am usually out more money in paying for duty and shipping than I actually spend on knives (about 1000$ US last year). Some makers/manufactures will send me knives to look at free of charge, which could of course be seen as payment. This is one of the reasons that I started breaking knives in the beginning. It prevented me from going too light on a knife because I wanted either to keep it, give it as a gift, or sell. If I knew in the end it would always be destroyed I was never concerned about keeping it in pristine condition or reluctant to do anything with it. It is also a good way to keep a certain class of makers/manufactures away.

As of late I have backed off on intentional failure testing on some products (beyond normal use for me) and am developing a network of extended users which will allow a multi-perspective review which I think is more beneficial. The intentional destructive testing will eventually be performed, but it will take a lot longer. I started this a few years ago (some of the older reviews were collaborations with two or more people), but only seriously started it again recently. The Martindale machete project will be the first large group effort. It should be interesting, there are still some problems to be worked out, mainly concerning modifications to the blades and restricted use which I know may be a serious problem based on past experience.

Keith :

Cliff not only studies knives, he studies knives by using them. Maybe he tends to do most of his using while he is testing knives, but he hacks up more lumber, clears more brush and limbs more trees than anybody else I know of.

This is one of the more ironic arguments that crops up - "its all just lab testing, I want real world results.". This is solid in theory as if you didn't actually use a knife for regular work, you could have some very odd impressions about what is necessary for quality and thus do some very odd controlled tests. This is actually the case for a lot of manufacturer tests. The lock strength ones being one of the worst examples as they don't correlate at all to actual lock stress when a person is using a knife. But they do generate some really high numbers which are great for promotion.

Some people are under the impression that all I do is controlled testing, mainly because I don't post about the regular work I do very often. For every hour of controlled testing that the reviews describe, there is about 10 hours of just regular knife work done by me (and repeated by friends) to see how it correlates to normal use, making sure I didn't overlook something significant. For example, in regards to large blade use, so far this year, I have cut down about 15 truck loads of wood, all with hand tools (axe, large blades). Here is a shot of the first pile :

http://www.physics.mun.ca/~sstamp/images/wood_front.jpg

When the weather is fine, I spend about 20-40 hours in the woods a week. Until the next years wood is cut, this is just all just felling, no real comparative cutting just using the best blades I have. Once I get enough cut, I relax and do a lot of stock testing. Usually I take the rotted and/or infested wood and buck it up with various saws or blades to examine the relative performance. It is usually either burned on site to keep the bugs away, or I split and cut it up very fine, again looking at relative blade performance and just experimenting with fire burn rates and heat and smoke production (and as of late thanks to Jimbo primitive stove experiments).

In regards to repeatability, this is another myth, usually taught in an introduction to science in elementary school and never meant to be used at anything beyond this very basic level - "It is fundamental to science that an experiment be able to be repeated in any place by any individual and get the same results". This is false for many reasons. The best take on this I have seen was by Feynmann in "Six Easy Pieces" where he vigerously tears into this myth, and the people who push it. This myth actually violates many principles of science and statistics and is a gross oversimplification of reality (again the ironic part). Like all myths, there is some basic truth to it, which is why it is introduced (like you can't take the square root of a negative number) and many of the finer points can be ignored on the scale of which we are talking about here (knife use).

There are two broad classes of people who make such complaints. Those that do so to complain, and those that actually want to learn and thus want to figure out how to deal with such problems. For example I was discussing tip testing on wood with an individual awhile back and he could not figure out how to compare his results to mine (we didn't have any of the same blades to use as benchmarks) and factor out the influence of the wood used. I bought a few lengths of 2x6, cut them into sections, kept a dozen selected at random and X-pressed him a dozen. As for the work in general, I can bound all the results and have done so in the past when this information was desired. It was of course ignored as it is red herring argument anyway. For example, for all Ron's complaints about the unscientific nature of the extreme testing, he has also stated quite clearly that no such testing which would cause a warranty concern should be performed regardless of method. Thus his argument isn't coherent, just negative along any lines possible even contradictory ones.

As for criticism, factual or personal, by all means fire away, though I would prefer factual as the other part has no information content, and no you don't need to do any knife work to voice a complaint though it generally makes for a more useful one. The only problem is with the personal attacks which can generate the reaction that stjames described. We lose valuable information that way. The above tip work won't be presented publically for that reason. This of course is one of the goals of the attacks from the makers/manufacturers. The other is to simply muddle the facts with personal arguments to cloud the issue and hopefully prevent further discussion.

-Cliff
 
If there is one argument that I have come to loath in my short time on Bladeforums it is this one. I'm not going to choose sides on this but I am going to say this: Cliff's testing is just as valuable (or just as unvaluable) as everyone else's subjective testing.
People have stated that there is no accepted knife testing standards. I have to disagree. Knives are produced from materials that are used in many other industries. I personally know of no materials that are "knife specific." So, in a the interest of scientific testing I present this:

http://www.astm.org/cgi-bin/SoftCart.exe/index.shtml?E+mystore

and this specifically:

http://www.astm.org/cgi-bin/SoftCart.exe/DATABASE.CART/MARKETINGCODES/MT4.htm?U+mystore+awwy0991

A joint effort by knife manufacturers and Guilds could fund the developement of an accepted set of tests and standards for knife testing. I know the Guilds have their own standards already. It's time for standards to be accepted by the industry so that these fruitless arguments can finally end.
Sorry for the rant...
-SB
 
I think if more people quit worrying about all the "testing" and just used their knives for what they actually needed them for, they would be better off.
Nobody's testing is useful if all it does is lead you to do things with your knife that you have no need to do, all in the name of "comparison testing"..

When I got my first Busse, first thing I did was chop a 2X4 in half, for no reason. Unfortunately for me, one of my co-workers happened to see me doing it, and I just ended up looking like some hard core knife user wannabe or some such nonsense.
At the time, I did not realize it, but I do now...Have I come "full circle"? No, I have come to my senses.

Sure, I do need a somewhat tough knife, because if all I used my knife for was cutting, I would not get to use it very much..that's the truth. But, because I have no point of reference, Cliff's or anyone else's testing does not mean anything at all to me, in any meaningful way.
Same thing with the cinder block cut/chop/whatever...If I need actually needed to cut through a cinder block, a review would not encourage or stop me from doing it..I either need to or I don't...And never mind that I can't relate the cinder block to other uses, so it's even more pointless, for me.

Same thing for actual, repeatable, scientific testing...I still don't know what it really means, as it relates to real world knife use, so again, it's still pointless.

I have finally come to realize that I will best be served by using my knife for what I need or want it to do, and understand that someone else's "tests", or even my own, don't mean a damn thing. If I think I might actually need to use my knife for something that might make it fail, then I need to make sure I have a second knife available to replace the first one.

Thankfully, it's all pretty simple so that even I can underastand it.
 
Back
Top