Help - Search - Members - Calendar
Full Version: 32kbps public listening test - OPEN
Hydrogenaudio Forums > Hydrogenaudio Forum > Validated News
Pages: 1, 2, 3
rjamorim
Hello.
I'd like to announce the launch of my 32kbps dial-up bitrate listening test

The formats featured are Nero Digital Audio (HE-AAC+PS), Ogg Vorbis, WMA9 Std., MP3pro, Real Audio and QDesign Music Codec.
Lame MP3 is being used as low anchor, and a lowpass at 7kHz is being used as high anchor.

For further information on how to participate, visit the test announcement page:
http://www.rjamorim.com/test/32kbps/presentation.html

The test is scheduled to end at July 11th.

Thank-you very much.
Best regards;
Roberto Amorim.
loophole
the faad version for OS X on rarewares appears to decode the HE-AAC samples to mono files. Well I only tested the new york one but it was the case there.
Svante
QUOTE(loophole @ Jun 30 2004, 11:44 AM)
the faad version for OS X on rarewares appears to decode the HE-AAC samples to mono files. Well I only tested the new york one but it was the case there.

Isn't mono the best alternative for such low bitrates?
loophole
Maybe, but the test was HE-AAC+PS, and PS is useless on a mono file by definition, so I doubt the samples were mono.
Garf
Please make sure the files are decoded with recent FAAD2 on all platforms as there have been updates/bugfixes to HE-AAC decoding.

No recent version of FAAD2 should give mono output on *any* file BTW.
rjamorim
Hrm... I guess RareWares needs an updated compile of Faad.

Can any Mac user contribute one?
Mac
The torrents seem to be flowing well smile.gif Are you going to bother sending the word out to the unwashed masses at Slashdot et al? 50gbs of bandwith leeched for ~0 participants seemed futile last time round smile.gif
rjamorim
QUOTE(Mac @ Jun 30 2004, 09:36 PM)
Are you going to bother sending the word out to the unwashed masses at Slashdot et al?  50gbs of bandwith leeched for ~0 participants seemed futile last time round smile.gif

Might be worth it. But I don't think they would be interested in a 32kbps test. And, of course, we would se hundreds of posts there claiming such low bitrates are useless, yadda yadda.

Atill, it could bring some participants. I would be grateful if someone could post the news there.
HotShot~
(off topic ?)
As a newcomer to listening tests (my first ! unsure.gif), I fear my comments will miss some technical vocabulary - what about a library of audio artifacts with 'technical' terms associated ? laugh.gif
Anyway such a test seems interesting and promising. Thx !
analogy
For that matter, is full 44 khz stereo necessary at 32 kbps? If I were streaming 32 kbps, in the interest of quality I would probably downsample to 22khz mono, or even 11 khz mono.
rjamorim
QUOTE(analogy @ Jul 1 2004, 12:11 AM)
For that matter, is full 44 khz stereo necessary at 32 kbps? If I were streaming 32 kbps, in the interest of quality I would probably downsample to 22khz mono, or even 11 khz mono.

Only Nero AAC uses full 44.1kHz

All other codecs had the samples downsampled for encoding, and later upsampled for comparision on ABC/HR

The reason of upsampling is working around crappy sound card resamplers, that would bias the test.
mithrandir
I did 4 samples tonight. They are rather easy to do because you don't have to strain to differentiate between the sample and the reference. The results should be very interesting.
DreamTactix291
Downloaded everything and have it all unzipped an ready to go, but I'm holding off on it right now because I'm sleepy smile.gif I'll be pretty worried though if I can't tell 32kbps files from the source lol. Seriously I am looking forward to the testing.
rjamorim
I shouldn't be surprised, but harashin again finished the entire sample set first. This time in less than 12 hours after the test start.
Sebastian Mares
He sure needs real life then. laugh.gif
westgroveg
I haven't been keeping up with this test but can someone tell me why HE-AAC with PS is being used, MP3 Pro but only WMA standard is being used not Pro? doesn't seem fair to me
S_O
QUOTE
but only WMA standard is being used not Pro? doesn't seem fair to me
Because the Pro-codec doesn´t work with low bitrates, AFAIK only >= 128 kbps.
Roynux
For the Unix enthusiasts, create theses scripts in the bin directory of the test (!! case sensitive !!):

Samplexx.sh
CODE

flac -d -o $1.wav $1.flac

oggdec $1_2.ogg
mv $1_2.wav $1_2a.wav

faad -o $1_5.wav $1_5.mp4
madplay --output=wave:$1_1a.wav $1_1.mp3

flac -d -o $1_3.wav $1_3.flac
flac -d -o $1_6.wav $1_6.flac
flac -d -o $1_7.wav $1_7.flac
flac -d -o $1_8.wav $1_8.flac

sox $1.wav $1_4.wav filter 0-7000

ssrc --rate 44100 --twopass $1_1a.wav $1_1.wav
ssrc --rate 44100 --twopass $1_2a.wav $1_2.wav

# Cleanup
rm $1.flac
rm $1_1.mp3
rm $1_2.ogg
rm $1_3.flac
rm $1_5.mp4
rm $1_6.flac
rm $1_7.flac
rm $1_8.flac
rm $1_1a.wav
rm $1_2a.wav


Sample.sh
CODE

sh Samplexx.sh ../Sample01/Bartok_strings2
sh Samplexx.sh ../Sample02/chanchan
sh Samplexx.sh ../Sample03/Debussy
sh Samplexx.sh ../Sample04/female_speech
sh Samplexx.sh ../Sample05/getiton
sh Samplexx.sh ../Sample06/Hongroise
sh Samplexx.sh ../Sample07/kraftwerk
sh Samplexx.sh ../Sample08/Leahy
sh Samplexx.sh ../Sample09/male_speech
sh Samplexx.sh ../Sample10/Mama
sh Samplexx.sh ../Sample11/NewYorkCity
sh Samplexx.sh ../Sample13/rosemary
sh Samplexx.sh ../Sample12/OrdinaryWorld
sh Samplexx.sh ../Sample14/SinceAlways
sh Samplexx.sh ../Sample15/TomsDiner
sh Samplexx.sh ../Sample16/trust
sh Samplexx.sh ../Sample17/Twelve
sh Samplexx.sh ../Sample18/Waiting


And run with
CODE

sh Sample.sh
Ivan Dimkovic
Please make sure that for Unix tests you use latest FAAD2 (www.audiocoding.com) - otherwise some strange things could happen smile.gif
Roynux
From my gentoo, the ebuild is "media-libs/faad2".

CODE

$ faad

*********** Ahead Software MPEG-4 AAC Decoder V2.0      ******************

Build: Jun 15 2004
Copyright 2002-2004: Ahead Software AG
http://www.audiocoding.com
Floating point version

This program is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or
(at your option) any later version.

You should have received a copy of the GNU General Public License
along with this program; if not, write to the Free Software
Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA.

**************************************************************************
...
menno
QUOTE(Roynux @ Jul 1 2004, 12:07 PM)
From my gentoo, the ebuild is "media-libs/faad2".

CODE

$ faad

*********** Ahead Software MPEG-4 AAC Decoder V2.0      ******************

Build: Jun 15 2004

....


I prefer if a version build from yesterdays checkin would be used. But this should not give any big problems.

Menno
fileman
To all extra-lazy windows users who downloaded the "all samples" package and don't want to execute those sampleXX.bat files one by one:

I made a batch file for converting all samples at once, just download it to your test/bin directory and execute it (of course all sampleXX.zip files must have been extracted to test/SampleXX before).

download link

Regards, fileman.
ScorLibran
Finished all 18 samples.

Results submitted.

G'night everybody.

smile.gif
vinnie97
likewise and good day/evening. wink.gif
rjamorim
QUOTE(Roynux @ Jul 1 2004, 07:00 AM)
For the Unix enthusiasts, create theses scripts in the bin directory of the test (!! case sensitive !!):

I added your scripts to abc-hr_bin.zip. Hope you don't mind.

Thank-you very much.

Regards;

Roberto.
Roynux
Not at all. smile.gif
rjamorim
Hello.

I would like you to know that, due to an "emergency" (I must go to a $^%!@ cousin's wedding next weekend. My parents and my brothers won't be able to go, so I must go to represent our side of the family), the results won't be published with the usual speed I'm so proud of.

With a little luck, I'll be able to release them on monday afternoon. But don't hold your breath. Anyway, I'll find a way.

Sorry for the incovenience.

Regards;

Roberto.
fileman
Don't worry about that - everybody knows that you're doing a great job with all these tests! Enjoy the wedding, eat some nice food wink.gif
rjamorim
http://slashdot.org/article.pl?sid=04/07/0...tid=141&tid=188

WEEEEEEEEEEEEEEEEE


@fileman: thanks smile.gif
Bongoboy
I'll take the blame for that. I am CaptainCheese! You asked, no-one objected...

I winder if anyone from /. will actually help out...
~*McoreD*~
QUOTE(S_O @ Jul 1 2004, 05:36 PM)
Because the Pro-codec doesn´t work with low bitrates, AFAIK only >= 128 kbps.

Hi,

Not in VBR Quality mode. 10%, 25% and 50% quality are low bit rate profiles for WMA 9 Professional and the average bit rate can be reduced to as low as 45 Kbps.

But we still cannot use WMA9 Pro because it is Quality VBR, the bitrate is highly fluctuating and doesn't stay at 32 Kbps. smile.gif

Cheers,
McoreD
rjamorim
QUOTE(Bongoboy @ Jul 3 2004, 12:24 AM)
I'll take the blame for that. I am CaptainCheese! You asked, no-one objected...

Yes, that's OK. There are probably a handful of /. users that actually participate.

All is fine, as long as I ignore most of the comments... wink.gif

Thanks for announcing it there.
deviantintegral
I'm trying to run the test on OSX. When running Sample.sh, I get this segfault

Samplexx.sh: line 16: 15841 Segmentation fault ssrc --rate 44100 --twopass $1_1a.wav $1_1.wav
Shibatch sampling rate converter version 1.29

Samplexx.sh: line 17: 15844 Segmentation fault ssrc --rate 44100 --twopass $1_2a.wav $1_2.wav

I compiled ssrc from source, using no special options. Any help would be appreciated!

--Andrew
merbanan
Hi, I'm wondering what Real Audio Codec is used in the test? Because they are using different technology. CELP/Subband/Transform

If the codec from Real is CELP based it should win the speaking samples.

Anyway the codecs are in theise groups, maybe some results can be connected to them later:

CELP:
Real (if it is Sipro/Cooker)

Subband:
Lame
Mp3Pro

Transform:
AAC (DCT)
Vorbis (DCT)
QDesign (FFT)
WMA9 (DCT)
Niknak
Tip to x86 unix users. Its much easier to use wine than download and compile a load of software. Just type:

wineconsole Sample01.bat

and so on for each sample. It uses the windows EXEs included with abchr and works pretty well.

Don't do what I did and spend loads of time getting the programs to work with the shell scripts only to discover my faad was not recent enough after taking the test!
AstralStorm
MP3 is a transform format too. smile.gif

Anyway, the speech samples produce good results with one codec, and very bad with another one...
ErikS
Any news on faad for macosx? The one on rarewares is dated 2003 it says, so I guess that's too old for this test...
rjamorim
QUOTE(ErikS @ Jul 8 2004, 02:01 PM)
I guess that's too old for this test...
*



Right. Noone contributed new FAAD though :/
robUx4
So it's officially over now ? I can't wait for the results biggrin.gif
Tang
Someone can give the GMT cloture hour?
i've made the test for on sample (debussy 03) but i've sent my result one hour ago and i don't know if it wan't too late...
SirGrey
QUOTE
Subband:
Lame
Mp3Pro

Hmm ?
I may be wrong, but mpeg layer 3 is a tranform codec.
As for subband codec examples: mpeg layer 2 and mpc...

EDIT: Half of test results I sent were w/o a name, half with it. Sorry for that, Roberto, if it will raise any problems...
robUx4
So ? No news ?
At least that means Roberto is hard working on it wink.gif
Sebastian Mares
QUOTE(rjamorim @ Jul 3 2004, 02:03 AM)
With a little luck, I'll be able to release them on monday afternoon. But don't hold your breath. Anyway, I'll find a way.
*



wink.gif
rjamorim
Wish me luck. It'll still take some time, but hopefully I'll get access to a laptop sick.gif and dial-up sick.gif sick.gif later today at my aunt's home.
rjamorim
QUOTE(Tang @ Jul 11 2004, 04:45 AM)
Someone can give the GMT cloture hour?
i've made the test for on sample (debussy 03) but i've sent my result one hour ago and i don't know if it wan't too late...
*



That's OK. I didn't even grab all results from my Yahoo mail (there are about 40 result e-mails there that need to be fetched, decrypted, renamed, sorted into folders...) so, by all means, results are still being accepted.
robUx4
Good luck then cool.gif
Cygnus X1
QUOTE(rjamorim @ Jul 12 2004, 09:40 AM)
Wish me luck. It'll still take some time, but hopefully I'll get access to a laptop sick.gif and dial-up sick.gif sick.gif later today at my aunt's home.
*



Welcome to my daily internet experience smile.gif

I'm looking forward to the results of this latest test. Good luck getting things together!
Mac
Although it might be a bit late with the test already past its end, could anyone explain what JABCHR is completely failing to do anything on my computer?

The biggest of its problems is that no sound plays, kind of unhelpful for an audio app smile.gif All of the play buttons just do nothing. I don't believe it attempts any playback, from what I can tell the position slider doesn't move at all. I'm not entirely sure as it doesn't display quite correctly, everything has a new found desire to hide from me smile.gif The app loads completely blank, but resizing the window to completely nothing then expanding again makes everything but the slider appear. As other windows obscure it anything that was hidden becomes blank after it is exposed again.

Everything used to work fine, but I have reformatted and changed some hardware - I am now using the onboard AC97 on my Via motherboard, using their latest Vinyl Stylus drivers. Everything else can play sound quite happily, it's just JABCHR that fails. I also downgraded my graphics card a bit, but it is using the drivers Windows assigned it quite happily for every other task.

Eh?!
AstralStorm
QUOTE(Mac @ Jul 12 2004, 09:34 PM)
The biggest of its problems is that no sound plays, kind of unhelpful for an audio app smile.gif  All of the play buttons just do nothing.  I don't believe it attempts any playback, from what I can tell the position slider doesn't move at all.  I'm not entirely sure as it doesn't display quite correctly, everything has a new found desire to hide from me smile.gif  The app loads completely blank, but resizing the window to completely nothing then expanding again makes everything but the slider appear.  As other windows obscure it anything that was hidden becomes blank after it is exposed again. <snip>
*



Well, which version of Java? Below 1.4.2 there will be problems,
as Java Sound still is in development.
Mac
QUOTE(AstralStorm @ Jul 12 2004, 07:40 PM)
Well, which version of Java? Below 1.4.2 there will be problems,
as Java Sound still is in development.

It sais v1.4.2_03 - the same version I was running before.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2008 Invision Power Services, Inc.