Public AAC Listening Test @ ~96 kbps [July 2011]: Results, Results and post-test discussion Options

[IgorC]

After the long time of preparations, discussions and realization of the test the results are finally here.

http://listening-tests.hydrogenaudio.org/i...-a/results.html

Summary: Apple won, FhG is the second, Coding Technologies is the third and Nero is the last

I appreciate all people who has supported the test and participated in it.

This post has been edited by IgorC: Aug 23 2011, 20:12

[Gecko]

Thank you IgorC and Garf for answering my questions!

In the output of bootstrap, is there any semantic difference between "a is better than b" and "b is worse than a"?

During the test I had the feeling that one (regular) sample was often worse and one often a tad better. Only the former assumption seems to be backed by my data (using the adjusted p-values): ffmpeg < Nero < All other

Given the high level of quality, I'm surprised that such a strong ranking could be established. I would have expected more ties.

[IgorC]

Given the high level of quality, I'm surprised that such a strong ranking could be established. I would have expected more ties.

That's actually how bootstraps works.
While it's the same for chunky if one particular sample has 1 or 100 results. It will throw away all particular data and will work only with average score per samples (only 20 average scores. Because there were 20 samples)

Bootstrap in change performs analysis on whole set of data (280 results for this test.) That permits to get more important statistical differences.
Literally every single result is useful.

This post has been edited by IgorC: Aug 26 2011, 11:35