Seems to be a blind listening test done with high end audoi gear in an audio studio:
http://www.download.com/Audio-Codec-Shoot-...20-5146271.htmlResults that Microsoft might be very happy with.
QUOTE(spoon @ Jun 5 2005, 11:53 AM)
Seems to be a blind listening test done with high end audoi gear in an audio studio:
http://www.download.com/Audio-Codec-Shoot-...20-5146271.htmlResults that Microsoft might be very happy with.
The fact that 128 encodes were very often considered to better than 192 ones makes me very sceptical of this test. WMA 128 better than Ogg 192? Come on...

I am not especially sensitive concerning compression artefacts, but the metallic ringing of a typical WMA@128 really hurts my ears...
they should also have used LAME instead of iTunes to encode their MP3s
...and of course an up to date version of Vorbis, instead of "Xiph.Org libVorbis I 20030909" ^^
Busemann
Jun 5 2005, 15:22
That the higher bitrate clips do worse seems to indicate that this is a test to find the codec "which sounds best to you". Not most true to the original.
Bring in another crowd an the results could be the complete opposite.
HotshotGG
Jun 5 2005, 16:16
QUOTE
The fact that 128 encodes were very often considered to better than 192 ones makes me very sceptical of this test. WMA 128 better than Ogg 192? Come on... tongue.gif I am not especially sensitive concerning compression artefacts, but the metallic ringing of a typical WMA@128 really hurts my ears.
This is the stuff that pisses me off right here. I say we all petition and send them a nasty e-mail or something pathetic

. Who did they hire a Johnny Nothing off the street to do this? It says the test is "non-scientific" how would you expect anyone to take you seriously?
QUOTE(HotshotGG @ Jun 5 2005, 02:16 PM)
... I say we all petition and send them a nasty e-mail or something pathetic

. Who did they hire a Johnny Nothing off the street to do this? It says the test is "non-scientific" how would you expect anyone to take you seriously?
Got my vote!
Digisurfer
Jun 5 2005, 17:42
Wonderful. You work your butt off sometimes (at least it feels that way) just to try an help folks you encounter around the net in understanding what lossy compression is really all about and why >proper< testing is important when deciding quality. There is already tons of misinformation floating around out there as it is, and I would say greater than 60% of the netizens out there have it completely wrong thanks to that fact. Then a totally irresponsible article like this one comes out and sets the world back even more, negating any progress we've clawed our way through. Personally I think this has nothing to do with which is better, or sounds more pleasant either, but a shady attempt and pusing more people to use Microsoft "product". It's feels like being pushed back into the dark ages. Oh well (heavy sigh) at least the good people of HA.org won't be fooled... right?

Edit: Fixed bad typo some might find offensive lol.
westgroveg
Jun 5 2005, 17:52
Weird that in "Cherub Rock," Smashing Pumpkins, WMA@128kbps scored higher than WMA@192kbps.
And I would have thought OGG@Q6 would be transparent in most cases, much better than WMA@128kbps too.
This
thread has already mentioned that wierd listening test.
guruboolez
Jun 6 2005, 04:01
QUOTE(Busemann @ Jun 5 2005, 10:22 PM)
That the higher bitrate clips do worse seems to indicate that this is a test to find the codec "which sounds best to you". Not most true to the original.
Bring in another crowd an the results could be the complete opposite.
Apparently, no:
QUOTE
He also periodically played the WAV file for reference anytime a juror requested.
http://www.download.com/Audio-Codec-Shoot-...20-5146328.html
If they couldn't differentiate between 128 and 192, then obviously 128 wins.
Pio2001
Jun 6 2005, 04:58
There was no mathematical analysis.
They probably did not hear any artifact in any file, and just thew random marks... Which explains why all codecs get nearly the same mark at all bitrates after summing up the results.
128 kbps got a better mark than 192 kbps 8 times, and 192 a better one than 128 12 times.
It probabbly goes to show for anything > 128 Kbps 'normal' people are rubbish at listening tests.
Pio2001
Jun 7 2005, 04:41
QUOTE(spoon @ Jun 6 2005, 01:20 PM)
It probabbly goes to show for anything > 128 Kbps 'normal' people are rubbish at listening tests.
They were no "normal people", they were selected as "folks with audio expertise and high standards ", from Download.com and MP3.com crews.
krabapple
Jun 10 2005, 05:03
For a test like this I'd really want some further descriptive statistics than just the average scores.
Also, I wonder how they enforced independence of listeners (who musnn't be allowed to influence each other) .
At least they say right up front that it wasn't scientific.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please
click here.