QUOTE(Axon @ Dec 13 2004, 11:50 AM)
It's a little subtler than that. It's theoretically possible that somebody did in fact tell a difference while everybody else didn't, but his "more positive" results got lost in the noise. But those percentage scores by listener sure seem bell curve shaped to me, and since nobody scored better than 60%.... I suspect this could be diced around a bit to yield an equivalence result with a low but meaningful significance. Also 10 responses per listener is rather low, and the cable switching time was very long, so those things do affect the power of this test.
Remember kids, nonrejectance of the null hypothesis does not mean equivalence.
It's true that it would be better to have more tests per listener, and then (if one listener appears to hear something) re-test that listener.
But what I was really picking up on were the people who honestly believed they could hear a differences (and presumably believed they were accurately reporting that difference) but who scored ~50%.
OK, that doesn't "prove that they didn't hear a difference", but it
does prove that they didn't hear the difference that they believed they heard.
Here is a daft example for you: If I look at ten pieces of paper, and say "OK, that one is red, that one is blue, that one is blue, that one is red, that one is blue" etc etc honestly believing and convinced of what I'm saying - but then it turns out I've only got 50% right - what are you going to conclude? Probably than I'm red/blue colour blind! However, more importantly you'd conclude that (for some strange reason) I'm imagining differences that I am not actually perceiving, because most
normal people would score 100%, and most
colour blind people would say "I can't tell a difference" - what you've uncovered here is a third type of person - a person who claims to perceive a difference, but doesn't.
Then this person defines themselves with a helpful label: "audiophile".
I rest my case.

Cheers,
David.
(In full knowledge that
some "audiophiles" know exactly what they're doing and hearing)
P.S. What is more, anyone who has taken an ABX test will know that you can pass it when detecting a difference which you find is on the very edge of your perception: you would never say you could confidently hear a difference, and yet you can just detect
something and score a very significant score, e.g. 15/16. Whereas here we have people saying they can definitely hear and report a difference, and they score 5/10! Then people have the cheek to say that ABX is insensitive!