What about a more selection-/cheatproof ABXer? Options

[Porcus]

For public listening tests, what about:

- publickey.txt that fb2k can read (hey, could even be installed as a component)
- write ABX results to file, encrypted with the public key

?

Reason: Bringing the procedure closer to double-blind.
As of today, ABXing with voluntary submission of results, is like first blinding patient and doctor, and then showing the result to the patient with the question of whether this should be submitted. (Would a patient who has had positive effects of something that turns out to be placebo, be equally likely to submit?)

For listening tests, it might be that people are less likely to submit results with negative findings. Especially if they score less than 50%. Indeed, people might just think the latter is nonsense and discard. Could very well be due to ignorance and neglect, not to deliberate cheating.

Suggestion might guard against those selection biases. (Although, not against deliberate manipulation, where you (i) ABX the normal way, and then for the more-doubleblind-test (ii) choose to test only those where you previously did well.)

[skamp]

The owner of the private key would need to be trusted with all the results, and we should require them to publish them all after they've stopped taking submissions (or, automatically upon submission, if there's no date limit).