Lossless Audio Benchmark |
  |
Lossless Audio Benchmark |
 Jul 13 2006, 12:05
Post
#1
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866  |
Started a lossless audio benchmark:
http://uclc.info/LossLess.ods http://uclc.info/LossLess.pdf The stars after the encoding and decoding speeds mean that there is NO compressor that compresses better AND is faster in encoding or decoding. So it's an indication of optimal compressors and/or parameters. I will include new samples when I have time. Any comments welcome. This post has been edited by JohanDeBock: Jul 14 2006, 18:35 -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
 |
 
|
|
Jul 13 2006, 12:29
Post
#2
|
|
 Group: Members Posts: 29 Joined: 14-April 03 Member No.: 5971 |
Link don't work here but i can download from http://studwww.ugent.be/~jdebock/LossLess.xls
|
|
|
|
|
Jul 13 2006, 14:04
Post
#3
|
|
 Group: Members Posts: 736 Joined: 27-May 02 From: Oslo, Norway Member No.: 2133 |
Perhaps you can share the file in a more universal format, like ex. PDF?
I sure can't be the only one without MS Office around here... 
This post has been edited by krmathis: Jul 13 2006, 14:05 |
|
|
|
|
Jul 13 2006, 14:10
Post
#4
|
|
 Group: Members Posts: 486 Joined: 15-January 02 From: Warwickshire -- England Member No.: 1036 |
thats what NeoOffice or OpenOffice are for
 Kristian |
|
|
|
|
Jul 13 2006, 23:10
Post
#5
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added an OpenOffice version:
http://uclc.info/LossLess.ods -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 14 2006, 00:25
Post
#6
|
|
 Group: Members (Donating) Posts: 811 Joined: 8-November 02 From: Astoria, OR Member No.: 3727 |
QUOTE (kritip @ Jul 13 2006, 06:10)  thats what NeoOffice or OpenOffice are for Kristian No, that's what Adobe PDF files are for, exactly what they are for. 
-------------------- Nov schmoz kapop.
|
|
|
|
|
Jul 14 2006, 01:37
Post
#7
|
|
|
Group: Members Posts: 191 Joined: 6-February 02 From: 310 Member No.: 1273 |
|
|
|
|
|
Jul 14 2006, 03:47
Post
#8
|
|
|
Group: Members Posts: 2478 Joined: 2-September 02 Member No.: 3264 |
QUOTE (krmathis @ Jul 13 2006, 06:04) Perhaps you can share the file in a more universal format, like ex. PDF? I sure can't be the only one without MS Office around here... PDF is a more universal format? It's just Adobe's crappy document format instead of MS. |
|
|
|
|
Jul 14 2006, 04:51
Post
#9
|
|
|
Group: Members Posts: 191 Joined: 6-February 02 From: 310 Member No.: 1273 |
QUOTE (Mike Giacomelli @ Jul 13 2006, 19:47) QUOTE (krmathis @ Jul 13 2006, 06:04) Perhaps you can share the file in a more universal format, like ex. PDF? I sure can't be the only one without MS Office around here... PDF is a more universal format? It's just Adobe's crappy document format instead of MS. i guess pdf is more accessable than MSoffice documents is what he's saying. OSX has built in pdf viewing function and adobe's acrobat reader is freeware so i guess that works. Not sure 'bout *nix tho. |
|
|
|
|
Jul 14 2006, 04:58
Post
#10
|
|
|
Group: Members Posts: 170 Joined: 4-July 02 From: Little Rock, AR Member No.: 2472 |
QUOTE (Mike Giacomelli @ Jul 13 2006, 21:47) QUOTE (krmathis @ Jul 13 2006, 06:04) Perhaps you can share the file in a more universal format, like ex. PDF? I sure can't be the only one without MS Office around here... PDF is a more universal format? It's just Adobe's crappy document format instead of MS. Actually, PDF is an open format. Adobe just happens to have the market almost locked up on the creation side of things. Look around for free PDF tools, they're there. |
|
|
|
|
Jul 14 2006, 08:22
Post
#11
|
|
|
Group: Members Posts: 736 Joined: 27-May 02 From: Oslo, Norway Member No.: 2133 |
QUOTE (edekba @ Jul 14 2006, 02:37) pdf can be seen here http://www.hydrogenaudio.org/forums/index....showtopic=46476 Thank you! QUOTE (Mike Giacomelli @ Jul 14 2006, 04:47) PDF is a more universal format? It's just Adobe's crappy document format instead of MS. Perhaps 'universal' was not the right word, but rather 'accessible' as edekba suggest.PDF is an open standard file format, for which there are several free reader application available. Some OS even have built in PDF support.  Thanks to edekba who understand this and hence uploaded the file.
|
|
|
|
|
Jul 14 2006, 08:36
Post
#12
|
|
|
Group: Members Posts: 573 Joined: 22-February 02 Member No.: 1375 |
Nicely done, thanks
To me "wavpack -h" and "Monkey's -c1000" are the overall winners for actual playback use. |
|
|
|
|
Jul 14 2006, 11:50
Post
#13
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added a very interesting sample: Icyltap. The --experimental switch off OptimFROG is doing it's work here!
BTW: Only the OpenOffice spreadsheet is updated. This post has been edited by JohanDeBock: Jul 14 2006, 17:36 -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 14 2006, 18:47
Post
#14
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
QUOTE (sony666 @ Jul 14 2006, 09:36) Nicely done, thanks To me "wavpack -h" and "Monkey's -c1000" are the overall winners for actual playback use. Monkey's -c1000 doesn't seem to be a winner on the decoding part: Wavpack -x5 and higher all compress better with faster decoding. For encoding Monkey's -c1000 is a winner. This post has been edited by JohanDeBock: Jul 14 2006, 18:56 -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 15 2006, 10:15
Post
#15
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added Apple Lossless, encoding with iTunes, decoding with dBpowerAMP Music Converter.
-------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 16 2006, 17:23
Post
#16
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added WMA Lossless and Real Lossless.
Didn't add Real Lossless decoding times because there is no good automated method to measure them. -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 17 2006, 15:19
Post
#17
|
|
 Group: Members Posts: 1455 Joined: 22-November 05 From: Jakarta Member No.: 25929 |
QUOTE (JohanDeBock @ Jul 13 2006, 18:05) The stars after the encoding and decoding speeds mean that there is NO compressor that compresses better AND is faster in encoding or decoding. So it's an indication of optimal compressors and/or parameters. I don't really understand what you mean... there's a lot of stars in the PDF...
I will include new samples when I have time. -------------------- Nobody is Perfect.
I am Nobody. http://pandu.poluan.info |
|
|
|
|
Jul 17 2006, 15:35
Post
#18
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
QUOTE (pepoluan @ Jul 17 2006, 16:19) QUOTE (JohanDeBock @ Jul 13 2006, 18:05) The stars after the encoding and decoding speeds mean that there is NO compressor that compresses better AND is faster in encoding or decoding. So it's an indication of optimal compressors and/or parameters. I don't really understand what you mean... there's a lot of stars in the PDF...I will include new samples when I have time. The stars are only interesting if you sort the compressors ascending on size. If there is for example a star next to the encoding speed this means that the encoding speeds of all the previous entries (compressors that produce smaller results if you sort on size) are slower. Hope this is clear. -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 17 2006, 15:48
Post
#19
|
|
|
Group: Members Posts: 1455 Joined: 22-November 05 From: Jakarta Member No.: 25929 |
Ahh okay, JohanDeBock. I got you
-------------------- Nobody is Perfect.
I am Nobody. http://pandu.poluan.info |
|
|
|
|
Jul 19 2006, 13:36
Post
#20
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added some more samples. The total test volume is now 1.074.947.156 Bytes, so the benchmark should be fairly trustable.
-------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 19 2006, 16:06
Post
#21
|
|
|
TAK Developer Group: Developer Posts: 887 Joined: 1-April 06 Member No.: 29051 |
Many thanks for your great work!
Your comparison is very helpful for my evaluation and optimization of Yalac. What i really like: - Your test file set is big. (Well, can never be big enough...) - Your test system can even differentiate very high encoding and decoding speeds. - The stars. - The exhaustive evaluation of any encoder preset. First i found it a bit too much, but later very useful for my own evaluation. Keep up the good work! Thomas |
|
|
|
|
Jul 19 2006, 16:45
Post
#22
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
QUOTE (TBeck @ Jul 19 2006, 17:06) - The stars. And YALAC is the king in collecting them! QUOTE (TBeck @ Jul 19 2006, 17:06) - The exhaustive evaluation of any encoder preset. First i found it a bit too much, but later very useful for my own evaluation. In the first version I tested even more presets (like for example for OptimFROG) but that was a bit too much. I think the only important audio coder that is still missing is MP4ALS. I'm now deciding which preset combinations I will test for MP4ALS. QUOTE (TBeck @ Jul 19 2006, 17:06) Keep up the good work! Thanks. This post has been edited by JohanDeBock: Jul 19 2006, 16:48 -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 20 2006, 15:59
Post
#23
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added MPEG-4 ALS. Only manages to get one * in the whole benchmark.
For the most compressable sample, Heard From Telegraph Lines, the parameter combinations -r5 -g5 -b -p -t2, -r5 -b -p and -r5 -b -p -t2 get a * for decoding speed. This post has been edited by JohanDeBock: Jul 20 2006, 18:14 -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 21 2006, 13:18
Post
#24
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Added 3 more samples and changed formatting for easier viewing.
The best compressors size and speedwise are now highlighted in green. This post has been edited by JohanDeBock: Jul 21 2006, 16:58 -------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
Jul 22 2006, 21:35
Post
#25
|
|
|
Group: Developer Posts: 107 Joined: 23-March 05 Member No.: 20866 |
Again some more samples and fixed some errors in formulas I didn't notice before.
-------------------- foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/ |
|
|
|
|
|
Lo-Fi Version | Time is now: 22nd November 2009 - 11:20 |
