QUOTE (Shade[ST] @ Sep 23 2005, 01:50 PM)
QUOTE (singaiya @ Sep 23 2005, 01:30 PM)
I tried to answer this question for myself last week by using ABC/HR Java between
3.90.3 --alt-preset standard
3.96.1 -V 2
3.97b1 -V 2 --vbr-new
And I was highly surprised to see in the logs that I ranked 3.90.3 slightly above the others both times. I'll post the details when I get home. Still not sure that I did everything correctly as this was my first time using the ABC software. And IIRC I only tried it on a few "killers" because it's hard for me to ABX much of anything at this bitrate level, but I have successful ABX logs on the files in question. Again, will post those when I'm at home.
What was your reference when testing?
Well, after looking at my logs I see that I indeed made some errors -- I guess it's to be expected with a first time

. Just learning to set up ABC/HR took longer than I expected

The reference file (for the only valid test I did) was castanets.
In short, what I found was that my previous successful ABX sessions on 3.97 samples of fatboy and kraftwerk were at -V 2, not -V 2 --vbr-new. Tonight I tried ABXing 3.97 -V 2 --vbr-new and failed on both those samples (but I did succeed with castanets). I also failed to ABX 3.90.3 --aps with fatboy, and once with castanets (but once I passed 8/8).
It's my understanding that an ABC/HR session is valid when all ABCs have successful ABX's to match. So with that criterion, then my only valid one is with castanets, where twice I ranked 3.90.3 highest. My ABC tests ranking 3.90.3 higher on the other samples are invalid because I could not ABX them against 3.97 -V2 --vbr-new, the new vbr being the reason for the ABC test in the first place.
In conclusion, 3.90.3 sounds slightly better on castanets *to me*. But they were all ranked with good marks, ie, not annoying. And on the other samples, I could not ABX 3.97 -V 2 --vbr-new (though I did with --old).
Here's the logs:
CODE
ABC/HR for Java, Version 0.5b, 23 September 2005
Testname: castanets2
Tester: lame versions castanets2
1L = C:\My Documents\Min\test files\castanets_3.90.3.mp3
2L = C:\My Documents\Min\test files\castanets_3.96.1.mp3
3R = C:\My Documents\Min\test files\castanets_3.97b1.mp3
---------------------------------------
General Comments:
---------------------------------------
1L File: C:\My Documents\Min\test files\castanets_3.90.3.mp3
1L Rating: 4.5
1L Comment:
---------------------------------------
2L File: C:\My Documents\Min\test files\castanets_3.96.1.mp3
2L Rating: 4.3
2L Comment:
---------------------------------------
3R File: C:\My Documents\Min\test files\castanets_3.97b1.mp3
3R Rating: 4.0
3R Comment:
---------------------------------------
ABX Results:
Original vs C:\My Documents\Min\test files\castanets_3.97b1.mp3
8 out of 8, pval = 0.0030
Original vs C:\My Documents\Min\test files\castanets_3.96.1.mp3
8 out of 8, pval = 0.0030
Original vs C:\My Documents\Min\test files\castanets_3.90.3.mp3
8 out of 8, pval = 0.0030
---- Detailed ABX results ----
Original vs C:\My Documents\Min\test files\castanets_3.97b1.mp3
Playback Range: 00.000 to 06.144
8:00:19 PM p 1/1 pval = 0.5
8:00:24 PM p 2/2 pval = 0.25
8:00:28 PM p 3/3 pval = 0.125
8:00:30 PM p 4/4 pval = 0.062
8:00:37 PM p 5/5 pval = 0.031
8:00:41 PM p 6/6 pval = 0.015
8:00:44 PM p 7/7 pval = 0.0070
8:00:48 PM p 8/8 pval = 0.0030
Original vs C:\My Documents\Min\test files\castanets_3.96.1.mp3
Playback Range: 00.000 to 06.144
7:58:49 PM p 1/1 pval = 0.5
7:58:53 PM p 2/2 pval = 0.25
7:58:59 PM p 3/3 pval = 0.125
7:59:09 PM p 4/4 pval = 0.062
7:59:12 PM p 5/5 pval = 0.031
7:59:20 PM p 6/6 pval = 0.015
7:59:29 PM p 7/7 pval = 0.0070
7:59:38 PM p 8/8 pval = 0.0030
Original vs C:\My Documents\Min\test files\castanets_3.90.3.mp3
Playback Range: 00.000 to 06.144
7:57:15 PM p 1/1 pval = 0.5
7:57:23 PM p 2/2 pval = 0.25
7:57:30 PM p 3/3 pval = 0.125
7:57:44 PM p 4/4 pval = 0.062
7:57:47 PM p 5/5 pval = 0.031
7:57:53 PM p 6/6 pval = 0.015
7:57:59 PM p 7/7 pval = 0.0070
7:58:04 PM p 8/8 pval = 0.0030
earlier ABC session without ABXing on same clip:
CODE
ABC/HR for Java, Version 0.5b, 17 September 2005
Testname: lame versions
Tester: lame versions castanets
1L = C:\My Documents\Min\test files\castanets_3.97b1.mp3
2R = C:\My Documents\Min\test files\castanets_3.90.3.mp3
3L = C:\My Documents\Min\test files\castanets_3.96.1.mp3
---------------------------------------
General Comments:
---------------------------------------
1L File: C:\My Documents\Min\test files\castanets_3.97b1.mp3
1L Rating: 3.0
1L Comment: slightly smeared sounding
---------------------------------------
2R File: C:\My Documents\Min\test files\castanets_3.90.3.mp3
2R Rating: 4.0
2R Comment: harder to tell, barely perceived and not annoying
---------------------------------------
3L File: C:\My Documents\Min\test files\castanets_3.96.1.mp3
3L Rating: 3.5
3L Comment:
---------------------------------------
ABX Results: