There are differences between testing material properties and comparing user experience. For example, you wouldn’t ask a group of office workers if they can tell that the new building has higher strength steel in it. And if you had a 10% improvement in edge retention with some new steel or heat treatment the best way of finding an improvement would not be handing knives to 100 people and asking them to cut things.
I agree with you. Of course there is a difference in measuring component material properties and measuring the real life performance of the end-product. It goes without saying that you can't guarantee a better or longer lasting building just because you put higher strength steel in it. There are too many other variables involved in the end performance of that building.
If one wants to evaluate building "performance", and the part played by steel strength in it, by asking people sitting in those buildings, fine. But yeah, I'd probably choose another endpoint in that particular case..
Likewise a pharmaceutical company can't claim to prolong and increase the quality of peoples' lives, just because they make an anti-hypertensive agent that lower's blood pressure in a laboratory setting. We need a clinical (real life) trial for that.
It's all about what you're interested in measuring. I do think that the end user's actual experienced performance is a fair "end point" in such a study of knives, but I am open to better suggestions.
If one wants to evaluate building "performance", and the part played by steel strength in it, by asking people sitting in those buildings, fine. But yeah, I'd probably choose another endpoint in that particular case..
Likewise a pharmaceutical company can't claim to prolong and increase the quality of peoples' lives, just because they make an anti-hypertensive agent that lower's blood pressure in a laboratory setting. We need a clinical (real life) trial for that.
It's all about what you're interested in measuring. I do think that the end user's actual experienced performance is a fair "end point" in such a study of knives, but I am open to better suggestions.