Another "testing" format?

H

Hoodoo

Joined
Aug 18, 1999
Messages
2,355
How about testing knives by survey? This is a good way to get a large sample size for a particular knife.

Things that could be asked might be:

Approx. date of purchase.

How often is it used?

Primary use?

Light, medium, or heavy cutting ability?

Edge durability (this can be phrased in a variety of ways).

Ease of sharpening?

Overall durability?

Problems in function?
(this could be broken down into parts)

Sheath quality?

Fit and finish?

Any factory repairs?

Quality of factory service.

How would you compare it to _____ ?

etc etc.

This is just a rough sketch. I'm sure that a more detailed survey could be designed that could collect some useful information that we could use.


------------------
Hoodoo

Doubt grows with knowledge.
--Goethe
 
Well, I personally don't think that would be a great idea. Too much variations of opinions on what is good, bad and average. Whats heavy cutting work for someone might only be normal cutting for another guy. Plus most people change the cutting angle when they sharpen it. So results would vary even more.

Thats my take on it

Sincerely,
Adam

------------------
Self improvement is a hobby of mine :).

 
I guess I am largely with Adam on this one. The test should be scientific rather than subjective. There are some some subjective elements such as astectics and handle feel for which your method would be ideal. But, the rest of the evaluation should be based on measurable repeatable standard testing.
 
Your absolutely right. Surveys are typically filled with subjective information. But we share subjective information all the time on this web site. A survey would just compile the range of subjective information. A survey would allow you to quantitatively analyze subjective information statistically for mean, range and variance in responses. That makes the survey a step (or several steps) up from absorbing random bits of anecdotal information.

For instance, rumor has it that knife x has a bad reputation for liner lock failure. If you survey 40 people, and only 2 report such failures, then perhaps it's not a problem. Or suppose 20 people report the failure but they all purchased their knives before date x and no incidents were reported after date x.

In other words, there are many ways to analyze survey data and these are entirely statistically and scientifically valid. Data like this gets published in scientific and other journals all the time. For instance, consumer reports frequently uses this kind of information to evaluate products.

Anyway, it's just a thought.
smile.gif


------------------
Hoodoo

Doubt grows with knowledge.
--Goethe


[This message has been edited by Hoodoo (edited 07 November 1999).]
 
I think the survey is a good idea. Surveys usually are subjective, but that doesn't mean they can't contain usefull information. A problem though would be just taking the time to put it together.
 
I dunno. The trouble with adding up the opinions of a lot of people who don't know what they're talking about is you don't get anywhere adding zeros.... Of course some of the people surveyed would know what they're talking about, but I'm afraid they'll be so outnumbered they'll be overwhelmed.

When somebody says a knife is great at edge-holding, it's often because it's the first knife he's ever owned that he didn't buy at K-Mart. When somebody else says a knife cuts three times as much cardboard as a SAK and 1.25 times as much as a Ka-bar before it loses the ability to shave, that means something ... but if we take a survey, I'm afraid the winner in the edge-holding category will be the knife owned by the largest number of people who don't own anything better.

The winner in the toughness category will be the knife that the largest number of those surveyed have tried opening a can with ... they've never tried that with any other knife, so they were surprised that the knife wasn't damaged ... pretty tough, huh? Duh.... (Any knife will open a can.)

The winner in the most reliable liner lock category will be the knife that the most people own and have never really tested or put any real strain on. They gave it a desultory push straight on the spine and it didn't close -- no failure there....

Of course I have nothing against the idea of taking a survey; I'll even participate, but I won't take the results as gospel truth.

-Cougar Allen :{)
 
CA has nailed the survey idea on the head. We don’t need a Peoples Choice Award for favorite fixed and folder.

------------------
James Segura
San Francisco, CA


 
I agree with you that there are problems with surveys but--and I don't want to beat a dead horse here--the issues you raise can and often are controlled statistically using what is called covariate analysis.

However, I realize that this is probably more sophisticated that we want to get but it's often the only way to handle survey data. Using covariate analysis you can control for confounding factors such as the background experience of the person taking the survey. You do this by creating categories that the reader uses to rank him or herself for a particular skill level, "first time buyer," knowledge level, years of overall experience, experience with similar knives, etc.

You can also used regression analysis to remove unwanted variables as well by regressing the trait of interest on the confounding variable and then analyzing the residuals.

Another way to handle confounding variables is to use what is called "blocking" where you group your survey takers into blocks and subtract off block variance from the overall variance of the data.

Now I realize that this all may sound like gibberish but it's actually just common statistical practices for analyzing complex data sets.

This may sound a little overboard but it's a pretty typical way of dealing with data. And the data that comes out of these types of analyses can be revealing. Anyway, this is likely a lot more work than anyone wants to undertake but I still maintain that the data that comes out of a survey--if the survey is properly designed and properly analyzed--would be useful and revealing.



------------------
Hoodoo

Doubt grows with knowledge.
--Goethe
 
Let's make it K.I.S.S simple:
How about...."On scale of 1 to 10...."
wink.gif


------------------
I can see how it might be possible for a man to look down upon the earth and be and atheist, but I cannot conceive how a man could look up into the heavens and say there is no God.
*Abraham Lincoln

Romans 1:20-22

 
You must log in or register to reply here.
Back
Top