IPB

Welcome Guest ( Log In | Register )

Multiformat Listening Test @ 128 kbps - FINISHED
Sebastian Mares
post Jan 14 2006, 22:01
Post #1





Group: Members
Posts: 3629
Joined: 14-May 03
From: Bad Herrenalb
Member No.: 6613



The much awaited results of the Public, Multiformat Listening Test @ 128 kbps are ready.

Here is the results page: http://www.maresweb.de/listening-tests/mf-128-1/results.htm



Edit 1: A description of the mentioned Nero problem can be found here: http://www.maresweb.de/nero-problem

Edit 2: For people who want to decrypt their results, here are the encoder IDs:

1 = iTunes
2 = LAME
3 = Nero
4 = Shine
5 = AoTuV
6 = WMA Professiona

This post has been edited by Sebastian Mares: Jan 14 2006, 23:57


--------------------
http://listening-tests.hydrogenaudio.org/sebastian/
Go to the top of the page
+Quote Post
 
Start new topic
Replies
guruboolez
post Jan 15 2006, 13:00
Post #2





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



It may be interesting to observe the performance's evolution of various formats according to the collective tests already performed. A rigorous comparison wouldn't make sense (samples and listeners aren't the same), but some tendency may appear.

Summer 2003:




Spring 2004:




Beginning 2006:





AAC (iTunes): it was always excellent, but not systematically on top. After the second test, it appeared that iTunes was definitely inferior to the young aoTuV encoder for the group of listeners. Now iTunes is back on top. iTunes really progressed between the 2nd and the 3rd listening test.

MP3 (LAME): by far the most noticeable progress. On the first test, MP3 (3.90.3 ABR) appeared as definitely outdated. Well, it's MP3 and it can't compete with other formats. Like many people on this board, I also thought that. On the second test, LAME (3.95 VBR) made the big jump and sounded competitive with iTunes but worse than aoTuV. Now LAME (3.97 VBR) sound competitive with all other competitors, not only for quality but also for speed (I recall that --vbr-new was tested for the first time). LAME highly progressed between the 1st and the 2nd test, and continued to fill the gap with other competitors between the 2nd and the 3rd.

Vorbis: half-disappointing on 2003 with the official and stagnant encoder, this format appeared as a big champion once resurrected by Aoyumi, but also by QuantumKnot and Nyaochi. The beginning of the year 2004 was very fertile for the format. Now Vorbis is still on top. Vorbis shows the biggest progression after the first test.

WMAPro: this format wasn't tested once (2nd test). On 2003 WMAPro (9.0 ABR) was on top, with the same mark as Vorbis and a slightly lower one than iTunes. On 2006, 9.1 VBR appears as fully competitive with both iTunes and aoTuV - and of course also LAME MP3. WMAPro silentely progressed with all other competitors.


It's usually very hard to detect audible improvement when a new encoder is released: they are often very subtle thus not really enjoying nor even convincing. But version after version, little progress after little progress, the difference becomes more obvious. The listening tests evolution is apparently illustrating this very well. Progress are not only made at ultra-low bitrate but also occurs at higher one. At ~130 kbps quality has reached a new level we never heard in the past. I must also confess that I'm amazed by the perceived quality of this encoders. They're reaching transparency on more and more material (count the total number of 5.0 in my full test... dry.gif ) and for more and more people. When HA.org was found in 2001, such quality at this bitrate was only a dream; four years later it becomes our reality. I take my hat off to all developers wub.gif

This post has been edited by guruboolez: Jan 15 2006, 16:50
Go to the top of the page
+Quote Post

Posts in this topic
- Sebastian Mares   Multiformat Listening Test @ 128 kbps - FINISHED   Jan 14 2006, 22:01
- - minisu   Great job! *goes decrypting*   Jan 14 2006, 22:05
- - Ivan Dimkovic   Just a quick info regarding the Nero bug - unfortu...   Jan 14 2006, 22:11
- - skelly831   Wow! awesome results, it's interesting to ...   Jan 14 2006, 22:18
- - ff123   How about making a hyperlink to the page describin...   Jan 14 2006, 22:21
- - Sebastian Mares   By the way, results that were invalid (didn't ...   Jan 14 2006, 22:22
|- - sehested   QUOTE (Sebastian Mares @ Jan 14 2006, 01:22 P...   Jan 15 2006, 04:22
- - guruboolez   Great job to everyone who participated to the test...   Jan 14 2006, 22:32
|- - Shade[ST]   The URL in the image is incorrect (www.maresweb.de...   Jan 14 2006, 22:38
|- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:3...   Jan 14 2006, 22:41
|- - Shade[ST]   QUOTE (Sebastian Mares @ Jan 14 2006, 03:41 P...   Jan 14 2006, 22:45
|- - fpi   QUOTE (Sebastian Mares @ Jan 14 2006, 03:41 P...   Jan 14 2006, 23:26
|- - sehested   QUOTE (Sebastian Mares @ Jan 14 2006, 01:41 P...   Jan 15 2006, 02:26
- - Sebastian Mares   By the way, Francis noticed another problem. The s...   Jan 14 2006, 22:37
- - Lyx   Pointing out an old issue with listening-test pres...   Jan 14 2006, 22:38
|- - Shade[ST]   Also a question / comment. Is Itunes' encoder...   Jan 14 2006, 22:42
- - minisu   Ok, so this is one of my decrypted results... http...   Jan 14 2006, 22:45
|- - Shade[ST]   More comments : http://www.maresweb.de/listening-t...   Jan 14 2006, 22:49
|- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:4...   Jan 14 2006, 22:51
- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:4...   Jan 14 2006, 22:50
|- - Shade[ST]   QUOTE (Sebastian Mares @ Jan 14 2006, 03:50 P...   Jan 14 2006, 23:31
- - IgorC   First of all great test. Thanks, Sebastian. Howev...   Jan 14 2006, 23:29
|- - guruboolez   QUOTE (IgorC @ Jan 14 2006, 11:29 PM)I've...   Jan 14 2006, 23:45
|- - IgorC   QUOTE (guruboolez @ Jan 14 2006, 02:45 PM)the...   Jan 14 2006, 23:49
- - Sebastian Mares   Ah, damn, you're right. Now I see what you guy...   Jan 14 2006, 23:30
- - JeanLuc   Damn ... looking at the bitrate table and regardin...   Jan 14 2006, 23:46
- - Sebastian Mares   QUOTE (fpi @ Jan 14 2006, 11:26 PM)QUOTE (Seb...   Jan 14 2006, 23:56
|- - kwanbis   QUOTE (Sebastian Mares @ Jan 14 2006, 10:56 P...   Jan 15 2006, 00:18
|- - Sebastian Mares   QUOTE (kwanbis @ Jan 15 2006, 12:18 AM)i agre...   Jan 15 2006, 00:26
|- - kwanbis   QUOTE (Sebastian Mares @ Jan 14 2006, 11:26 P...   Jan 15 2006, 00:54
- - kwanbis   could a ranking based on rating and bitrate be mad...   Jan 15 2006, 00:13
- - mdmuir   When are we reaching the point that further tests ...   Jan 15 2006, 00:13
|- - kwanbis   QUOTE (mdmuir @ Jan 14 2006, 11:13 PM)When ar...   Jan 15 2006, 00:15
|- - guruboolez   QUOTE (mdmuir @ Jan 15 2006, 12:13 AM)When ar...   Jan 15 2006, 00:23
|- - Halcyon   Thanks for the results and work everyone! I c...   Jan 15 2006, 00:35
- - vinnie97   Vorbis' place at the top correlates with it be...   Jan 15 2006, 01:00
- - richard123   Do these results help answer the question: Are the...   Jan 15 2006, 02:50
- - westgroveg   Does the results page state what settings where us...   Jan 15 2006, 03:13
|- - Serge Smirnoff   SoundExpert preliminary results on the same conten...   Jan 15 2006, 03:24
- - Pio2001   Thank you for the results. I was Anon08. Here are ...   Jan 15 2006, 05:47
- - plonk420   i only got thru 10 of the tracks.... but i could o...   Jan 15 2006, 08:27
- - Raptus   Pio, have you automated somehow the process of com...   Jan 15 2006, 08:43
|- - Pio2001   QUOTE (Raptus @ Jan 15 2006, 09:43 AM)Pio, ha...   Jan 15 2006, 11:53
- - Raptus   As I stated in the other topic, I was not very hap...   Jan 15 2006, 09:35
- - Sebastian Mares   QUOTE (westgroveg @ Jan 15 2006, 03:13 AM)Doe...   Jan 15 2006, 10:00
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 01:00 A...   Jan 15 2006, 10:06
- - Garf   On the total results: how much % of the gradings g...   Jan 15 2006, 10:28
- - sehested   Is there a way to see your own results, including ...   Jan 15 2006, 10:31
- - Sebastian Mares   QUOTE (Garf @ Jan 15 2006, 10:28 AM)On the to...   Jan 15 2006, 10:58
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 01:58 A...   Jan 15 2006, 11:10
||- - Sebastian Mares   QUOTE (sehested @ Jan 15 2006, 11:10 AM)QUOTE...   Jan 15 2006, 11:29
|- - Garf   QUOTE (Sebastian Mares @ Jan 15 2006, 11:58 A...   Jan 15 2006, 15:29
- - Sebastian Mares   I received a total of 467 results. Since only 403 ...   Jan 15 2006, 12:25
- - Sebastian Mares   BTW, could someone post the results to Doom9?   Jan 15 2006, 12:45
- - halb27   Wonderful results!   Jan 15 2006, 12:48
- - guruboolez   It may be interesting to observe the performance...   Jan 15 2006, 13:00
- - sehested   Managed to decode my own results: CODE ...   Jan 15 2006, 13:15
- - Sebastian Mares   What was the mail address you used for testing (yo...   Jan 15 2006, 13:47
- - SirGrey   Thanks for working on the test, Sebastian. As for ...   Jan 15 2006, 13:48
- - Sebastian Mares   sehested, you are anon10. I used your results fo...   Jan 15 2006, 13:55
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 04:55 A...   Jan 15 2006, 14:18
- - Sebastian Mares   By the way... People who did not enter their (nick...   Jan 15 2006, 14:00
- - bond   thx again for this interesting test, sebastian...   Jan 15 2006, 14:52
|- - minisu   QUOTE (bond @ Jan 15 2006, 03:52 PM)thx again...   Jan 15 2006, 15:05
|- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 02:52 PM)thx again...   Jan 15 2006, 15:12
- - bond   your statement doesnt make any sense for me. what ...   Jan 15 2006, 15:13
|- - guruboolez   QUOTE (bond @ Jan 15 2006, 03:13 PM)your stat...   Jan 15 2006, 15:42
|- - bond   QUOTE (guruboolez @ Jan 15 2006, 04:42 PM)QUO...   Jan 15 2006, 15:46
|- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 03:46 PM)QUOTE (gu...   Jan 15 2006, 15:57
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 04:57 P...   Jan 15 2006, 16:00
- - yulyo!   When can we see the final version of Nero's ne...   Jan 15 2006, 15:35
|- - bond   QUOTE (yulyo! @ Jan 15 2006, 04:35 PM)I a...   Jan 15 2006, 15:40
- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 03:13 PM)well ok, ...   Jan 15 2006, 15:51
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 04:51 P...   Jan 15 2006, 15:55
- - Sebastian Mares   OK, results page now contains 3 final graphs: non-...   Jan 15 2006, 16:09
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 05:09 P...   Jan 15 2006, 16:13
- - yulyo!   Yes bond, it seems you're right. every time so...   Jan 15 2006, 16:11
|- - IgorC   QUOTE (yulyo! @ Jan 15 2006, 07:11 AM)Yes...   Jan 15 2006, 17:03
|- - guruboolez   QUOTE (IgorC @ Jan 15 2006, 05:03 PM)AAC is t...   Jan 15 2006, 17:27
||- - IgorC   QUOTE (guruboolez @ Jan 15 2006, 08:27 AM)QUO...   Jan 15 2006, 17:33
|||- - guruboolez   For HD-DVD or/and blu ray players AAC will be wis...   Jan 15 2006, 17:43
||- - Busemann   QUOTE (guruboolez @ Jan 15 2006, 08:27 AM)Tha...   Jan 15 2006, 17:59
||- - Mo0zOoH   QUOTE (Busemann @ Jan 15 2006, 07:59 PM)I wou...   Jan 15 2006, 18:07
|||- - Busemann   QUOTE (Mo0zOoH @ Jan 15 2006, 09:07 AM)And an...   Jan 15 2006, 18:21
|||- - guruboolez   QUOTE (Busemann @ Jan 15 2006, 06:21 PM)First...   Jan 15 2006, 18:28
|||- - Busemann   QUOTE (guruboolez @ Jan 15 2006, 09:28 AM)The...   Jan 15 2006, 18:30
||- - guruboolez   QUOTE (Busemann @ Jan 15 2006, 05:59 PM)QUOTE...   Jan 15 2006, 18:07
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 07:03 PM)Maybe so...   Jan 15 2006, 17:30
|- - IgorC   QUOTE (Mo0zOoH @ Jan 15 2006, 08:30 AM)How ma...   Jan 15 2006, 17:36
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 07:36 PM)I didn...   Jan 15 2006, 17:58
- - Alex B   I too would like to thank everyone who contributed...   Jan 15 2006, 16:56
- - yulyo!   IgorC: "I think it's not good idea for ci...   Jan 15 2006, 17:46
|- - bond   QUOTE (guruboolez @ Jan 15 2006, 06:43 PM)For...   Jan 15 2006, 17:51
|- - guruboolez   QUOTE (bond @ Jan 15 2006, 05:51 PM)aac isnt ...   Jan 15 2006, 17:58
|- - IgorC   QUOTE (guruboolez @ Jan 15 2006, 08:58 AM)So ...   Jan 15 2006, 18:09
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 08:09 PM)That...   Jan 15 2006, 18:11
|- - guruboolez   QUOTE (IgorC @ Jan 15 2006, 06:09 PM)QUOTE (g...   Jan 15 2006, 18:14
- - guruboolez   I just finished to download the Blu-Ray PDF. Suppo...   Jan 15 2006, 17:51
- - minisu   I don't like WMA, and not many players support...   Jan 15 2006, 17:55
- - bond   well it still shouldnt be forgotten that the ipod ...   Jan 15 2006, 18:07
2 Pages V   1 2 >


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 16th April 2014 - 15:33