IPB

Welcome Guest ( Log In | Register )

Multiformat Listening Test @ 128 kbps - FINISHED
Sebastian Mares
post Jan 14 2006, 22:01
Post #1





Group: Members
Posts: 3629
Joined: 14-May 03
From: Bad Herrenalb
Member No.: 6613



The much awaited results of the Public, Multiformat Listening Test @ 128 kbps are ready.

Here is the results page: http://www.maresweb.de/listening-tests/mf-128-1/results.htm



Edit 1: A description of the mentioned Nero problem can be found here: http://www.maresweb.de/nero-problem

Edit 2: For people who want to decrypt their results, here are the encoder IDs:

1 = iTunes
2 = LAME
3 = Nero
4 = Shine
5 = AoTuV
6 = WMA Professiona

This post has been edited by Sebastian Mares: Jan 14 2006, 23:57


--------------------
http://listening-tests.hydrogenaudio.org/sebastian/
Go to the top of the page
+Quote Post
 
Start new topic
Replies
Sebastian Mares
post Jan 14 2006, 22:37
Post #2





Group: Members
Posts: 3629
Joined: 14-May 03
From: Bad Herrenalb
Member No.: 6613



By the way, Francis noticed another problem. The sample "Yello" submitted by Alex B was not lossless. By mistake, Alex B uploaded a file transcoded from a high bitrate MP3.

Guru noticed that the reference file he was listening to sounded too much like an encoded file. After looking at the spectral view of the track with CE, he noticed what he calls "an adaptive lowpass with some spectral 'holes'" which is typical to lossy encoders. I contacted Alex B about the problem and received the following mail today:

QUOTE
Hi again!

Here's what I found. It is a long story, but explains how accidents can happen when dealing with a large number of test files, even if you try to [be] careful.

I checked the reference and compared it with my ripped CD archive file, which is in Monkey's Audio disc image file & cue format and noticed that there really is a difference.

However, at first I couldn't understand why. It could not be the WMA 2-pass version I made for testing the bitrates. WMA 128 kbps has a lower lowpass. I have also a Musepack Q8 version on my home audio server, but that does not have such a lowpass.

Then I remembered that I cut the sample from the 25 files bitrate test archive I have stored. I have the separated track already there so it was faster than converting the big disc image ape file.

I selected these 25 files originally for testing LAME 3.97 VBR bitrates in September. When I made the different VBR sets I had the original cue files loaded in foobar and I converted each VBR set from the same playlist. Later when I cleaned the resulting 500 MP3 files I converted the 25 original cue tracks to separate lossless tracks for future use.

It appears that I have somehow accidentally loaded a high bitrate MP3 file instead of the cue to a foobar playlist and converted it to Monkey's Audio. The other 24 Monkey's Audio tracks seem to be fine, only this one is unfortunately different.

When I made this particular sample for testing WMA 2-pass in November I converted that ape file to wave and cut it. By looking the lowpass I believe the MP3 file was encoded at -V0. There is no way to tell if it was VBR new or old.

I am sorry about the mistake.

I think this sample will accidentally show that these new encoders are not bad transcoders, at least when the source is this kind of loud track. It is a different thing if you like to publish this information. It could be only meaningless clutter. It was never exactly mentioned how the source files were obtained. The test compared these reference files and the encoded versions.


This post has been edited by Sebastian Mares: Jan 14 2006, 22:38


--------------------
http://listening-tests.hydrogenaudio.org/sebastian/
Go to the top of the page
+Quote Post

Posts in this topic
- Sebastian Mares   Multiformat Listening Test @ 128 kbps - FINISHED   Jan 14 2006, 22:01
- - minisu   Great job! *goes decrypting*   Jan 14 2006, 22:05
- - Ivan Dimkovic   Just a quick info regarding the Nero bug - unfortu...   Jan 14 2006, 22:11
- - skelly831   Wow! awesome results, it's interesting to ...   Jan 14 2006, 22:18
- - ff123   How about making a hyperlink to the page describin...   Jan 14 2006, 22:21
- - Sebastian Mares   By the way, results that were invalid (didn't ...   Jan 14 2006, 22:22
|- - sehested   QUOTE (Sebastian Mares @ Jan 14 2006, 01:22 P...   Jan 15 2006, 04:22
- - guruboolez   Great job to everyone who participated to the test...   Jan 14 2006, 22:32
|- - Shade[ST]   The URL in the image is incorrect (www.maresweb.de...   Jan 14 2006, 22:38
|- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:3...   Jan 14 2006, 22:41
|- - Shade[ST]   QUOTE (Sebastian Mares @ Jan 14 2006, 03:41 P...   Jan 14 2006, 22:45
|- - fpi   QUOTE (Sebastian Mares @ Jan 14 2006, 03:41 P...   Jan 14 2006, 23:26
|- - sehested   QUOTE (Sebastian Mares @ Jan 14 2006, 01:41 P...   Jan 15 2006, 02:26
- - Sebastian Mares   By the way, Francis noticed another problem. The s...   Jan 14 2006, 22:37
- - Lyx   Pointing out an old issue with listening-test pres...   Jan 14 2006, 22:38
|- - Shade[ST]   Also a question / comment. Is Itunes' encoder...   Jan 14 2006, 22:42
- - minisu   Ok, so this is one of my decrypted results... http...   Jan 14 2006, 22:45
|- - Shade[ST]   More comments : http://www.maresweb.de/listening-t...   Jan 14 2006, 22:49
|- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:4...   Jan 14 2006, 22:51
- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:4...   Jan 14 2006, 22:50
|- - Shade[ST]   QUOTE (Sebastian Mares @ Jan 14 2006, 03:50 P...   Jan 14 2006, 23:31
- - IgorC   First of all great test. Thanks, Sebastian. Howev...   Jan 14 2006, 23:29
|- - guruboolez   QUOTE (IgorC @ Jan 14 2006, 11:29 PM)I've...   Jan 14 2006, 23:45
|- - IgorC   QUOTE (guruboolez @ Jan 14 2006, 02:45 PM)the...   Jan 14 2006, 23:49
- - Sebastian Mares   Ah, damn, you're right. Now I see what you guy...   Jan 14 2006, 23:30
- - JeanLuc   Damn ... looking at the bitrate table and regardin...   Jan 14 2006, 23:46
- - Sebastian Mares   QUOTE (fpi @ Jan 14 2006, 11:26 PM)QUOTE (Seb...   Jan 14 2006, 23:56
|- - kwanbis   QUOTE (Sebastian Mares @ Jan 14 2006, 10:56 P...   Jan 15 2006, 00:18
|- - Sebastian Mares   QUOTE (kwanbis @ Jan 15 2006, 12:18 AM)i agre...   Jan 15 2006, 00:26
|- - kwanbis   QUOTE (Sebastian Mares @ Jan 14 2006, 11:26 P...   Jan 15 2006, 00:54
- - kwanbis   could a ranking based on rating and bitrate be mad...   Jan 15 2006, 00:13
- - mdmuir   When are we reaching the point that further tests ...   Jan 15 2006, 00:13
|- - kwanbis   QUOTE (mdmuir @ Jan 14 2006, 11:13 PM)When ar...   Jan 15 2006, 00:15
|- - guruboolez   QUOTE (mdmuir @ Jan 15 2006, 12:13 AM)When ar...   Jan 15 2006, 00:23
|- - Halcyon   Thanks for the results and work everyone! I c...   Jan 15 2006, 00:35
- - vinnie97   Vorbis' place at the top correlates with it be...   Jan 15 2006, 01:00
- - richard123   Do these results help answer the question: Are the...   Jan 15 2006, 02:50
- - westgroveg   Does the results page state what settings where us...   Jan 15 2006, 03:13
|- - Serge Smirnoff   SoundExpert preliminary results on the same conten...   Jan 15 2006, 03:24
- - Pio2001   Thank you for the results. I was Anon08. Here are ...   Jan 15 2006, 05:47
- - plonk420   i only got thru 10 of the tracks.... but i could o...   Jan 15 2006, 08:27
- - Raptus   Pio, have you automated somehow the process of com...   Jan 15 2006, 08:43
|- - Pio2001   QUOTE (Raptus @ Jan 15 2006, 09:43 AM)Pio, ha...   Jan 15 2006, 11:53
- - Raptus   As I stated in the other topic, I was not very hap...   Jan 15 2006, 09:35
- - Sebastian Mares   QUOTE (westgroveg @ Jan 15 2006, 03:13 AM)Doe...   Jan 15 2006, 10:00
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 01:00 A...   Jan 15 2006, 10:06
- - Garf   On the total results: how much % of the gradings g...   Jan 15 2006, 10:28
- - sehested   Is there a way to see your own results, including ...   Jan 15 2006, 10:31
- - Sebastian Mares   QUOTE (Garf @ Jan 15 2006, 10:28 AM)On the to...   Jan 15 2006, 10:58
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 01:58 A...   Jan 15 2006, 11:10
||- - Sebastian Mares   QUOTE (sehested @ Jan 15 2006, 11:10 AM)QUOTE...   Jan 15 2006, 11:29
|- - Garf   QUOTE (Sebastian Mares @ Jan 15 2006, 11:58 A...   Jan 15 2006, 15:29
- - Sebastian Mares   I received a total of 467 results. Since only 403 ...   Jan 15 2006, 12:25
- - Sebastian Mares   BTW, could someone post the results to Doom9?   Jan 15 2006, 12:45
- - halb27   Wonderful results!   Jan 15 2006, 12:48
- - guruboolez   It may be interesting to observe the performance...   Jan 15 2006, 13:00
- - sehested   Managed to decode my own results: CODE           ...   Jan 15 2006, 13:15
- - Sebastian Mares   What was the mail address you used for testing (yo...   Jan 15 2006, 13:47
- - SirGrey   Thanks for working on the test, Sebastian. As for ...   Jan 15 2006, 13:48
- - Sebastian Mares   sehested, you are anon10. I used your results fo...   Jan 15 2006, 13:55
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 04:55 A...   Jan 15 2006, 14:18
- - Sebastian Mares   By the way... People who did not enter their (nick...   Jan 15 2006, 14:00
- - bond   thx again for this interesting test, sebastian...   Jan 15 2006, 14:52
|- - minisu   QUOTE (bond @ Jan 15 2006, 03:52 PM)thx again...   Jan 15 2006, 15:05
|- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 02:52 PM)thx again...   Jan 15 2006, 15:12
- - bond   your statement doesnt make any sense for me. what ...   Jan 15 2006, 15:13
|- - guruboolez   QUOTE (bond @ Jan 15 2006, 03:13 PM)your stat...   Jan 15 2006, 15:42
|- - bond   QUOTE (guruboolez @ Jan 15 2006, 04:42 PM)QUO...   Jan 15 2006, 15:46
|- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 03:46 PM)QUOTE (gu...   Jan 15 2006, 15:57
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 04:57 P...   Jan 15 2006, 16:00
- - yulyo!   When can we see the final version of Nero's ne...   Jan 15 2006, 15:35
|- - bond   QUOTE (yulyo! @ Jan 15 2006, 04:35 PM)I a...   Jan 15 2006, 15:40
- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 03:13 PM)well ok, ...   Jan 15 2006, 15:51
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 04:51 P...   Jan 15 2006, 15:55
- - Sebastian Mares   OK, results page now contains 3 final graphs: non-...   Jan 15 2006, 16:09
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 05:09 P...   Jan 15 2006, 16:13
- - yulyo!   Yes bond, it seems you're right. every time so...   Jan 15 2006, 16:11
|- - IgorC   QUOTE (yulyo! @ Jan 15 2006, 07:11 AM)Yes...   Jan 15 2006, 17:03
|- - guruboolez   QUOTE (IgorC @ Jan 15 2006, 05:03 PM)AAC is t...   Jan 15 2006, 17:27
||- - IgorC   QUOTE (guruboolez @ Jan 15 2006, 08:27 AM)QUO...   Jan 15 2006, 17:33
|||- - guruboolez   For HD-DVD or/and blu ray players AAC will be wis...   Jan 15 2006, 17:43
||- - Busemann   QUOTE (guruboolez @ Jan 15 2006, 08:27 AM)Tha...   Jan 15 2006, 17:59
||- - Mo0zOoH   QUOTE (Busemann @ Jan 15 2006, 07:59 PM)I wou...   Jan 15 2006, 18:07
|||- - Busemann   QUOTE (Mo0zOoH @ Jan 15 2006, 09:07 AM)And an...   Jan 15 2006, 18:21
|||- - guruboolez   QUOTE (Busemann @ Jan 15 2006, 06:21 PM)First...   Jan 15 2006, 18:28
|||- - Busemann   QUOTE (guruboolez @ Jan 15 2006, 09:28 AM)The...   Jan 15 2006, 18:30
||- - guruboolez   QUOTE (Busemann @ Jan 15 2006, 05:59 PM)QUOTE...   Jan 15 2006, 18:07
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 07:03 PM)Maybe so...   Jan 15 2006, 17:30
|- - IgorC   QUOTE (Mo0zOoH @ Jan 15 2006, 08:30 AM)How ma...   Jan 15 2006, 17:36
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 07:36 PM)I didn...   Jan 15 2006, 17:58
- - Alex B   I too would like to thank everyone who contributed...   Jan 15 2006, 16:56
- - yulyo!   IgorC: "I think it's not good idea for ci...   Jan 15 2006, 17:46
|- - bond   QUOTE (guruboolez @ Jan 15 2006, 06:43 PM)For...   Jan 15 2006, 17:51
|- - guruboolez   QUOTE (bond @ Jan 15 2006, 05:51 PM)aac isnt ...   Jan 15 2006, 17:58
|- - IgorC   QUOTE (guruboolez @ Jan 15 2006, 08:58 AM)So ...   Jan 15 2006, 18:09
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 08:09 PM)That...   Jan 15 2006, 18:11
|- - guruboolez   QUOTE (IgorC @ Jan 15 2006, 06:09 PM)QUOTE (g...   Jan 15 2006, 18:14
- - guruboolez   I just finished to download the Blu-Ray PDF. Suppo...   Jan 15 2006, 17:51
- - minisu   I don't like WMA, and not many players support...   Jan 15 2006, 17:55
- - bond   well it still shouldnt be forgotten that the ipod ...   Jan 15 2006, 18:07
2 Pages V   1 2 >


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 18th April 2014 - 15:16