IPB

Welcome Guest ( Log In | Register )

lame 3.97 alpha 6 testing thread
Gabriel
post Jan 14 2005, 10:56
Post #1


LAME developer


Group: Developer
Posts: 2950
Joined: 1-October 01
From: Nanterre, France
Member No.: 138



Compared to 3.97a5, cbr/abr modes are adjusted. Vbr modes are not yet changed compared to pevious alpha.

Results from 3.97a5:
http://www.hydrogenaudio.org/forums/index....showtopic=30547

edit: the former X10 mode is now remapped to X9 and used by default on abr/cbr.

This post has been edited by Gabriel: Jan 14 2005, 16:38
Go to the top of the page
+Quote Post
 
Start new topic
Replies
guruboolez
post Jan 17 2005, 10:08
Post #2





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



TEST #3: 128 kbps ABR with classical music only

Samples:
• the 15 classical music samples I’ve already used for my multiformat listening tests and more recently for my Nero AAC vs QuickTime AAC and also for the Nero AAC vs Vorbis aoTuV beta 3 listening tests.
Samples are momentary available here (11.8 MB).


Encoders and settings:
• lame 3.90.3 --preset 128
• lame 3.97a6 --preset 128
• lame 3.97a6 --preset 128 --athlower 10


RESULTS

CODE
                       3.90.3  3.97a6  3.97a6_ATH10
Bayle                    3.0     2.5     3.5
Beethoven                3.5     3.0     4.0
Mozart                   4.0     3.5     4.0
Rinaldo                  3.2     3.7     4.5
Track01 – Avison         2.0     3.0     3.0
Track04 – Hercules       4.0     3.5     5.0
Track06 – Mahler         3.0     2.5     2.5
Track07 – BWV 1034       2.0     2.0     2.5
Track08 – Brahms         3.0     2.5     4.0
Track09 – Compostelle    3.0     2.0     1.5    [WARBLING]
Track10 – Bruhns         1.5     1.0     2.0
Track11 – Mozart         3.5     3.5     3.5
Track12 – Couperin       1.0     2.5     1.8
Track13 – Van Wilder     2.5     3.2     4.0
Track14 – Barriere       2.0     3.0     3.0
                MEANS  2.75    2.76    3.25

Click here for log files



COMMENTS:

• lame 3.90.3 and lame 3.97a6 are apparently very similar with this kind of music and with --preset 128. Differences are most often very limited, and without ABX confirmation, I can’t be sure they all really exist.

• the --athlower 10 switch has a real and positive impact on quality with the tested samples. I’ve noticed two exceptions only:
- compostelle.wav sample: lame 3.97a6 amplifies a strange warbling, slightly audible with lame 3.90.3 and now really annoying. The --athlower switch doesn’t help to reduce it, and it apparently adds slight distortions on female voices (it nevertheless had to be confirmed).
- Couperin.wav solo harpsichord sample: quality is slightly worse with –athlower, which increase smearing and maybe (hard to explain some feelings) level of distortions. Anyway, 3.90.3 was clearly worse.
With all other samples, quality between defaulted --preset 128 and --athlower 10 additional switch was at least identical, most often better, and sometimes clearly improved.


STATISTICS:

If some people would play with statistic tool, just copy and paste the following table:
CODE
3.90.3    3.97a6    3.97a6_ATH10
3.0    2.5    3.5
3.5    3.0    4.0
4.0    3.5    4.0
3.2    3.7    4.5
2.0    3.0    3.0
4.0    3.5    5.0
3.0    2.5    2.5
2.0    2.0    2.5
3.0    2.5    4.0
3.0    2.0    1.5
1.5    1.0    2.0
3.5    3.5    3.5
1.0    2.5    1.8
2.5    3.2    4.0
2.0    3.0    3.0


ANOVA analysis of results
3.97a6_ATH10 is better than 3.97a6, 3.90.3

TUKEY PARAMETRIC analysis of results
3.97a6_ATH10 is better than 3.97a6, 3.90.3



NOTA BENE
Mixing both tests (20 general samples + 15 classical only samples):

MIXED RESULTS (35 samples):
lame 3.90.3 = 2.81
lame 3.97a6 = 3.19
lame 3.97a6 --ahtlower 10 = 3.37

ANALYSIS (anova & tukey parametric):
3.97a6_ATH10 is better than 3.90.3
3.97a6 is better than 3.90


EDIT: wrong analysis reports corrected.

This post has been edited by guruboolez: Dec 29 2005, 23:05
Go to the top of the page
+Quote Post

Posts in this topic
- Gabriel   lame 3.97 alpha 6 testing thread   Jan 14 2005, 10:56
- - john33   In case you haven't found it yet, alpha 6 is a...   Jan 14 2005, 11:39
- - westgroveg   Actually alpha 5 not 6: QUOTE ABC/HR Version 1.0, ...   Jan 14 2005, 13:30
- - john33   For anyone who has downloaded the alpha 6 from Rar...   Jan 14 2005, 14:27
|- - westgroveg   QUOTE (john33 @ Jan 15 2005, 01:27 AM)For any...   Jan 14 2005, 14:32
- - whcanilang   Nice! The results of 3.97a testing look promi...   Jan 14 2005, 22:08
- - mithrandir   This is my hunch on vbr-new. As guruboolez mentio...   Jan 14 2005, 22:25
- - westgroveg   QUOTE ABC/HR Version 1.0, 6 May 2004 Testname: 1...   Jan 15 2005, 12:20
- - LoFiYo   I have a sample where 3.97a6 generates a blip nois...   Jan 15 2005, 17:48
|- - LoFiYo   QUOTE (LoFiYo @ Jan 15 2005, 12:48 PM)I have ...   Jan 16 2005, 19:15
- - [proxima]   LAME CBR 128 kbps ringing test This test includes...   Jan 16 2005, 20:45
- - guruboolez   TEST #1: 128 kbps ABR: ringing and --athlower swit...   Jan 17 2005, 10:06
- - guruboolez   TEST #2: 128 kbps ABR Samples: • all ff123...   Jan 17 2005, 10:07
- - guruboolez   TEST #3: 128 kbps ABR with classical music only S...   Jan 17 2005, 10:08
- - Gabriel   Explanations regarding the current ATH status: It...   Jan 17 2005, 10:41
|- - [proxima]   QUOTE (Gabriel @ Jan 17 2005, 10:41 AM)The sh...   Jan 17 2005, 13:05
|- - guruboolez   QUOTE (Gabriel @ Jan 17 2005, 10:41 AM)note: ...   Jan 18 2005, 15:11
- - Gabriel   My mistake, the switch is --athcurve xxx. xxx is a...   Jan 17 2005, 13:54
- - Gabriel   Regarding vbr presets: I will adjust presets up to...   Jan 18 2005, 13:43
- - sony666   HI, foobar ABX plugin with replaygain, medicore So...   Jan 20 2005, 01:17
- - sony666   nasty (CODE) tag problem, please delete   Jan 20 2005, 01:20
- - sony666   CODEVELVET (11.878s) ------ CBR 128 -96...   Jan 20 2005, 01:21
- - guruboolez   TEST #4: --preset standard listening test This te...   Jan 20 2005, 09:34
- - guruboolez   TEST #5: -q0 switch In addition, I’ve just tried ...   Jan 20 2005, 09:36
- - Gabriel   Thank you very much for those results. *preset st...   Jan 20 2005, 10:10
|- - guruboolez   QUOTE (Gabriel @ Jan 20 2005, 10:10 AM)I am w...   Jan 20 2005, 10:19
|- - guruboolez   APPENDIX TO TEST#4: --preset standard QUOTE (Gabr...   Jan 24 2005, 08:41
- - uart   QUOTE I could check it (quickly) but I fear that I...   Jan 21 2005, 14:01
- - Gabriel   The q1 and q0 problem has now been identified and ...   Jan 22 2005, 19:11
- - Jebus   I know this is just one listening test, but would ...   Jan 26 2005, 00:11
|- - dev0   QUOTE (Jebus @ Jan 26 2005, 12:11 AM)I know t...   Feb 1 2005, 08:06
|- - [proxima]   guruboolez results about the new VBR mode are real...   Feb 1 2005, 22:49
|- - Jechdery   I am using 3.96.1 -V 2 rather than 3.90.3 aps for ...   Feb 2 2005, 23:27
- - ezra2323   Its been over a week with no news of any developme...   Feb 1 2005, 02:14
- - Wombat   After some reading it seems i finally found the th...   Nov 28 2005, 19:01
- - Wombat   I donīt know where to post this and i am waiting f...   Dec 1 2005, 00:55
- - robert   @wombat could you check 3.98a2 with the velvet.wav...   Dec 1 2005, 11:02
- - Wombat   Sure i will! As soon as i am home tonight.   Dec 1 2005, 11:17


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 17th April 2014 - 11:09