QUOTE
Yes, I understand that. My point (I'm sure you know!) is that, even if the power cables were delivering results, and your listeners were detecting them, your experimental methods don't allow you or me or anyone else to differentiate the results from chance. The tossing a coin example shows that I hope.
Expand this idea a little further. In a test such as this what is the cause of chance? Is it the listeners recorded their results based on tossing a coin? Of course not. Did any of the listeners think to themselves ‘sod it, I can’t hear a difference but I’ll take a chance and guess which I think the aftermarket power cable is’. Possibly.
To account for this a control test was included in the session to ‘catch’ this behaviour and, as stated in the test results, the results are best considered against the control. So the method does give the reader some opportunity to differentiate the results from chance or positive bias on the part of the listener. That was the very purpose of its inclusion. Ideally a second and separate control group would have been used but this was outside of what could be practicably done.
The method does not in any way preclude statistical analysis to estimate the outcome based on pure chance. Not at all.
QUOTE
I don't understand what resources were not available to you
If you begin with the assumption the audible consequences of aftermarket power cables (if indeed such does exist outside of psychoacoustics) are rather subtle then you need to design a test with a high resolving ability. The results of this test and of the previous, more comprehensive, Secrets test show this.
As a mere starting point; a listening room that is treated to reduce comb-filtering effects, a system that is accurately calibrated to ensure a relatively flat frequency response, and most importantly stringent prior assessment of the hearing acuity of the judges. All this before you even get to method.
As it happens I don’t think any of this is necessary unless you wish to pass the results of as demonstrative of fact. And then there’s publication in an appropriate peer-reviewed journal.
