Help - Search - Members - Calendar
Full Version: 64 kbps listening test 2005
Hydrogenaudio Forums > Hydrogenaudio Forum > Listening Tests
Pages: 1, 2, 3, 4
Sebastian Mares
I think it'd be better to conduce an 128 kbps test once LAME 3.97 and Nero AAC are out.
Sagittaire
I vote for WMA9 Pro and Sdt because:
1) Not the same codec
2) wma9 pro was never tested to 64 Kbps
3) hardware compatibility is not a problem : HE-AAC or MP3Pro are not compatible with hardware
4) wma9 sdt vs wma9 pro fight is very interessing

WMA9 Standard setting
I think that for very bitrate the best setting could be that:
cscript.exe wmcmd.vbs -a_codec WMA9STD -a_mode 4 -a_setting 64_44_2 -a_peakbitrate 96000 -a_peakbuffer 5000 -input C:\Audio -output C:\Audio

-> Max bitrate is 96 Kbps : lower variability
-> Max buffer = 5 sec : lower variability
In fact with these setting wma9 is between real VBR and real CBR and IMO it's better for overall quality at very low bitrate

WMA9 Pro sample
In theory it's impossible to make WMA9Pro with exact bitrate at 64Kbps (no profil for 64 Kbps target bitrate) but if you want I can make these encoding with exactly 64 Kbps for each sample in two pass mode.
rjamorim
QUOTE(Sagittaire @ Aug 11 2005, 08:07 PM)
2) wma9 pro was never tested to 64 Kbps


It is not even meant to be used at 64kbps.

QUOTE
3) hardware compatibility is not a problem : HE-AAC or MP3Pro are not compatible with hardware


HE AAC is actually playable on some cell phones. And MP3pro is playable on several Thomson/RCA devices, among other brands.

QUOTE
4) wma9 sdt vs wma9 pro fight is very interessing


It is not a fight. Not even Microsoft is interested in that fight! For them, WMA Std is the consumer codec, meant to be used for CDDA resolution at 64kbps. WMA Pro is the professional codec meant to be used at high resolutions, multichannel streams, at bitrates higher than 128kbps.

QUOTE
WMA9 Standard setting
I think that for very bitrate the best setting could be that:
cscript.exe wmcmd.vbs -a_codec WMA9STD -a_mode 4 -a_setting 64_44_2 -a_peakbitrate 96000 -a_peakbuffer 5000 -input C:\Audio -output C:\Audio

-> Max bitrate is 96 Kbps : lower variability
-> Max buffer = 5 sec : lower variability
In fact with these setting wma9 is between real VBR and real CBR and IMO it's better for overall quality at very low bitrate


Settings tweaking IST EVUL.

QUOTE
WMA9 Pro sample
In theory it's impossible to make WMA9Pro with exact bitrate at 64Kbps (no profil for 64 Kbps target bitrate)
*


There you go. WMA Pro is not meant to be encoded at 64kbps.
pieroxy
QUOTE(Sebastian Mares @ Apr 1 2005, 07:19 PM)
Regarding samples, I have enough now, thank you. It's a bit hard to decide which ones to use, since almost all of them are more or less killer samples.
*



Beware of the bias of testing only killer samples. Comparing codecs on killer samples will only give you a hint on how they perform... on killer samples. Not on regular music. See here for a thread on the subject.
level
QUOTE(pieroxy @ Aug 12 2005, 02:03 AM)
Beware of the bias of testing only killer samples. Comparing codecs on killer samples will only give you a hint on how they perform... on killer samples. Not on regular music. See here for a thread on the subject.
*


Not necessarily. You remember that many killer samples (in particular here in this thread) are only regular music. In other words, are situations of the real life. Tuning any encoder with "difficult parts of music" (killer samples) in order to do it more robust is the way as HA has managed to improve the performance of the encoders.
xmixahlx
QUOTE(pieroxy @ Aug 12 2005, 01:03 AM)
Beware of the bias of testing only killer samples. Comparing codecs on killer samples will only give you a hint on how they perform... on killer samples. Not on regular music. See here for a thread on the subject.
*


keep your ridiculous ideas on conducting listening tests to your own thread.


later
echo
QUOTE(pieroxy @ Aug 12 2005, 12:03 AM)
QUOTE(Sebastian Mares @ Apr 1 2005, 07:19 PM)
Regarding samples, I have enough now, thank you. It's a bit hard to decide which ones to use, since almost all of them are more or less killer samples.
*



Beware of the bias of testing only killer samples. Comparing codecs on killer samples will only give you a hint on how they perform... on killer samples. Not on regular music. See here for a thread on the subject.
*


Heh, now this has become a fact? wink.gif

QUOTE(Sebastian Mares @ Jul 9 2005, 09:13 AM)
I think it'd be better to conduce an 128 kbps test once LAME 3.97 and Nero AAC are out.

I think that would be more interesting for everyone...
Sebastian Mares
QUOTE(echo @ Aug 12 2005, 09:29 PM)
I think that would be more interesting for everyone...
*



I bet the two encoders will be released right after my summer vaction is over. tongue.gif Hope not.
rjamorim
QUOTE(Sebastian Mares @ Aug 12 2005, 04:55 PM)
I bet the two encoders will be released right after my summer vaction is over. tongue.gif Hope not.
*


You might have LAME 3.97 beta before your vacation is over, but you'll hardly have final!
Sebastian Mares
Would you test with a beta or a final?
rjamorim
QUOTE(Sebastian Mares @ Aug 12 2005, 05:51 PM)
Would you test with a beta or a final?
*


Wise words from Roberto:

Ask the Developers opinion. That way, you save your face and don't get cornered in case everything blows up. smile.gif
Sagittaire
QUOTE(rjamorim @ Aug 12 2005, 01:11 PM)
Settings tweaking IST EVUL.


arghhhhhh .... smile.gif
then 2 pass streaming mode with default setting : it's an usual mode in WMEnc
cscript.exe wmcmd.vbs -a_codec WMA9STD -a_mode 4 -a_setting 64_44_2 -input C:\Audio -output C:\Audio

default are:
- 1.5*bitrate for maxbitrate
- 3 sec for maxbuffer

QUOTE(rjamorim @ Aug 12 2005, 01:11 PM)
There you go. WMA Pro is not meant to be encoded at 64kbps.


In fact q10 quality is perhabs this mode ... but it's just impossible for you to obtain the good target bitrate for your specific samples tests ...
guruboolez
QUOTE(xmixahlx @ Aug 12 2005, 07:21 PM)
QUOTE(pieroxy @ Aug 12 2005, 01:03 AM)
Beware of the bias of testing only killer samples. Comparing codecs on killer samples will only give you a hint on how they perform... on killer samples. Not on regular music. See here for a thread on the subject.
*


keep your ridiculous ideas on conducting listening tests to your own thread.
*


Pieroxy's ideas have nothing ridiculous. He was very clear: a listening test involving VBR and CBR encoders should include low-bitrate encodings, mid-bitrate encodings and high-bitrate encodings.
I'm quoting Pieroxy:
QUOTE
So in an ideal test, you would have 160kbps, 130kbps and 90kbps samples. THAT would be representative, not merely 128kbps.


Now I'm quoting someone who's not used to post "ridiculous ideas" about listening tests, ff123:
QUOTE
Ideally, you'd like the bitrate distribution to look somewhat like a bell curve with its mean at 128 kbit/s.

=> Exactly the same "ridiculous" idea about the "ideal" test.

And ff123 followed:
QUOTE
For the 48 kbit/s test, if there are VBR codecs, I think we should strive to have about an equal number of bitrates above and below the average bitrate (which should work out to be 48 kbit/s on average across the sample set).

Would you also say that ff123 has ridiculous ideas about listening test organisation? I'd really like to see that...



I posted the bitrate distribution curve of VBR encoders involved in my latest 80 kbps listening test:
http://foobar2000.net/divers/tests/2005.07...UTION_WMA80.png
http://foobar2000.net/divers/tests/2005.07...ION_aoTuV80.png

For both encoders, ~50% of the total samples were encoded with a bitrate lower to the targeted bitrate, and the ~50 remaining percent were encoded with a bitrate superior to the targeted bitrate. The distribution is close to the perfect curve for WMA and classical music (150 samples), with both mean and median at exactly 80 kbps. The curve is perfectible for aoTuV (median is 75 kbps), but distribution is also near-symetrical from both side of the median value.
It was maybe luck - I don't know - or maybe a consequence of the huge number of samples involved in my test (150+35) which maybe help to get a good distribution.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2008 Invision Power Services, Inc.