IPB

Welcome Guest ( Log In | Register )

 
 Reply to this topicStart new topic
Lossless Audio Benchmark
JohanDeBock
post Jul 13 2006, 12:05
Post #1





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Started a lossless audio benchmark:
http://uclc.info/LossLess.ods
http://uclc.info/LossLess.pdf

The stars after the encoding and decoding speeds mean that there is NO compressor that compresses better AND is faster in encoding or decoding. So it's an indication of optimal compressors and/or parameters.
I will include new samples when I have time.

Any comments welcome.

This post has been edited by JohanDeBock: Jul 14 2006, 18:35


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
Thundik81
post Jul 13 2006, 12:29
Post #2





Group: Members
Posts: 29
Joined: 14-April 03
Member No.: 5971
Link don't work here but i can download from http://studwww.ugent.be/~jdebock/LossLess.xls
Go to the top of the page
 
+Quote Post
krmathis
post Jul 13 2006, 14:04
Post #3





Group: Members
Posts: 736
Joined: 27-May 02
From: Oslo, Norway
Member No.: 2133
Perhaps you can share the file in a more universal format, like ex. PDF?
I sure can't be the only one without MS Office around here... wink.gif

This post has been edited by krmathis: Jul 13 2006, 14:05
Go to the top of the page
 
+Quote Post
kritip
post Jul 13 2006, 14:10
Post #4





Group: Members
Posts: 486
Joined: 15-January 02
From: Warwickshire -- England
Member No.: 1036
thats what NeoOffice or OpenOffice are for biggrin.gif

Kristian
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 13 2006, 23:10
Post #5





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added an OpenOffice version:
http://uclc.info/LossLess.ods


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
boojum
post Jul 14 2006, 00:25
Post #6





Group: Members (Donating)
Posts: 811
Joined: 8-November 02
From: Astoria, OR
Member No.: 3727
QUOTE (kritip @ Jul 13 2006, 06:10) *
thats what NeoOffice or OpenOffice are for biggrin.gif

Kristian



No, that's what Adobe PDF files are for, exactly what they are for. cool.gif


--------------------
Nov schmoz kapop.
Go to the top of the page
 
+Quote Post
edekba
post Jul 14 2006, 01:37
Post #7





Group: Members
Posts: 191
Joined: 6-February 02
From: 310
Member No.: 1273
pdf can be seen here

http://www.hydrogenaudio.org/forums/index....showtopic=46476
Go to the top of the page
 
+Quote Post
Mike Giacomelli
post Jul 14 2006, 03:47
Post #8





Group: Members
Posts: 2476
Joined: 2-September 02
Member No.: 3264
QUOTE (krmathis @ Jul 13 2006, 06:04) *
Perhaps you can share the file in a more universal format, like ex. PDF?
I sure can't be the only one without MS Office around here... wink.gif


PDF is a more universal format? It's just Adobe's crappy document format instead of MS.
Go to the top of the page
 
+Quote Post
edekba
post Jul 14 2006, 04:51
Post #9





Group: Members
Posts: 191
Joined: 6-February 02
From: 310
Member No.: 1273
QUOTE (Mike Giacomelli @ Jul 13 2006, 19:47) *
QUOTE (krmathis @ Jul 13 2006, 06:04) *

Perhaps you can share the file in a more universal format, like ex. PDF?
I sure can't be the only one without MS Office around here... wink.gif


PDF is a more universal format? It's just Adobe's crappy document format instead of MS.



i guess pdf is more accessable than MSoffice documents is what he's saying. OSX has built in pdf viewing function and adobe's acrobat reader is freeware so i guess that works. Not sure 'bout *nix tho.
Go to the top of the page
 
+Quote Post
clintb
post Jul 14 2006, 04:58
Post #10





Group: Members
Posts: 170
Joined: 4-July 02
From: Little Rock, AR
Member No.: 2472
QUOTE (Mike Giacomelli @ Jul 13 2006, 21:47) *
QUOTE (krmathis @ Jul 13 2006, 06:04) *

Perhaps you can share the file in a more universal format, like ex. PDF?
I sure can't be the only one without MS Office around here... wink.gif


PDF is a more universal format? It's just Adobe's crappy document format instead of MS.

Actually, PDF is an open format. Adobe just happens to have the market almost locked up on the creation side of things. Look around for free PDF tools, they're there.
Go to the top of the page
 
+Quote Post
krmathis
post Jul 14 2006, 08:22
Post #11





Group: Members
Posts: 736
Joined: 27-May 02
From: Oslo, Norway
Member No.: 2133
QUOTE (edekba @ Jul 14 2006, 02:37) *
pdf can be seen here
http://www.hydrogenaudio.org/forums/index....showtopic=46476

Thank you!
QUOTE (Mike Giacomelli @ Jul 14 2006, 04:47) *
PDF is a more universal format? It's just Adobe's crappy document format instead of MS.
Perhaps 'universal' was not the right word, but rather 'accessible' as edekba suggest.
PDF is an open standard file format, for which there are several free reader application available. Some OS even have built in PDF support. smile.gif

Thanks to edekba who understand this and hence uploaded the file. smile.gif
Go to the top of the page
 
+Quote Post
sony666
post Jul 14 2006, 08:36
Post #12





Group: Members
Posts: 573
Joined: 22-February 02
Member No.: 1375
Nicely done, thanks smile.gif
To me "wavpack -h" and "Monkey's -c1000" are the overall winners for actual playback use.
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 14 2006, 11:50
Post #13





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added a very interesting sample: Icyltap. The --experimental switch off OptimFROG is doing it's work here!

BTW: Only the OpenOffice spreadsheet is updated.

This post has been edited by JohanDeBock: Jul 14 2006, 17:36


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 14 2006, 18:47
Post #14





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
QUOTE (sony666 @ Jul 14 2006, 09:36) *
Nicely done, thanks smile.gif
To me "wavpack -h" and "Monkey's -c1000" are the overall winners for actual playback use.

Monkey's -c1000 doesn't seem to be a winner on the decoding part:
Wavpack -x5 and higher all compress better with faster decoding.
For encoding Monkey's -c1000 is a winner.

This post has been edited by JohanDeBock: Jul 14 2006, 18:56


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 15 2006, 10:15
Post #15





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added Apple Lossless, encoding with iTunes, decoding with dBpowerAMP Music Converter.


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 16 2006, 17:23
Post #16





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added WMA Lossless and Real Lossless.
Didn't add Real Lossless decoding times because there is no good automated method to measure them.


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
pepoluan
post Jul 17 2006, 15:19
Post #17





Group: Members
Posts: 1455
Joined: 22-November 05
From: Jakarta
Member No.: 25929
QUOTE (JohanDeBock @ Jul 13 2006, 18:05) *
The stars after the encoding and decoding speeds mean that there is NO compressor that compresses better AND is faster in encoding or decoding. So it's an indication of optimal compressors and/or parameters.
I will include new samples when I have time.
I don't really understand what you mean... there's a lot of stars in the PDF...


--------------------
Nobody is Perfect.
I am Nobody.

http://pandu.poluan.info
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 17 2006, 15:35
Post #18





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
QUOTE (pepoluan @ Jul 17 2006, 16:19) *
QUOTE (JohanDeBock @ Jul 13 2006, 18:05) *
The stars after the encoding and decoding speeds mean that there is NO compressor that compresses better AND is faster in encoding or decoding. So it's an indication of optimal compressors and/or parameters.
I will include new samples when I have time.
I don't really understand what you mean... there's a lot of stars in the PDF...


The stars are only interesting if you sort the compressors ascending on size.
If there is for example a star next to the encoding speed this means that the encoding speeds of all the previous entries (compressors that produce smaller results if you sort on size) are slower.
Hope this is clear.


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
pepoluan
post Jul 17 2006, 15:48
Post #19





Group: Members
Posts: 1455
Joined: 22-November 05
From: Jakarta
Member No.: 25929
Ahh okay, JohanDeBock. I got you smile.gif


--------------------
Nobody is Perfect.
I am Nobody.

http://pandu.poluan.info
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 19 2006, 13:36
Post #20





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added some more samples. The total test volume is now 1.074.947.156 Bytes, so the benchmark should be fairly trustable.


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
TBeck
post Jul 19 2006, 16:06
Post #21


TAK Developer


Group: Developer
Posts: 887
Joined: 1-April 06
Member No.: 29051
Many thanks for your great work!

Your comparison is very helpful for my evaluation and optimization of Yalac.

What i really like:

- Your test file set is big. (Well, can never be big enough...)
- Your test system can even differentiate very high encoding and decoding speeds.
- The stars.
- The exhaustive evaluation of any encoder preset. First i found it a bit too much, but later very useful for my own evaluation.

Keep up the good work!

Thomas
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 19 2006, 16:45
Post #22





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
QUOTE (TBeck @ Jul 19 2006, 17:06) *
- The stars.

And YALAC is the king in collecting them!

QUOTE (TBeck @ Jul 19 2006, 17:06) *
- The exhaustive evaluation of any encoder preset. First i found it a bit too much, but later very useful for my own evaluation.

In the first version I tested even more presets (like for example for OptimFROG) but that was a bit too much.
I think the only important audio coder that is still missing is MP4ALS. I'm now deciding which preset combinations I will test for MP4ALS.

QUOTE (TBeck @ Jul 19 2006, 17:06) *
Keep up the good work!

Thanks.

This post has been edited by JohanDeBock: Jul 19 2006, 16:48


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 20 2006, 15:59
Post #23





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added MPEG-4 ALS. Only manages to get one * in the whole benchmark.
For the most compressable sample, Heard From Telegraph Lines, the parameter combinations -r5 -g5 -b -p -t2, -r5 -b -p and -r5 -b -p -t2 get a * for decoding speed.

This post has been edited by JohanDeBock: Jul 20 2006, 18:14


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 21 2006, 13:18
Post #24





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Added 3 more samples and changed formatting for easier viewing.
The best compressors size and speedwise are now highlighted in green.

This post has been edited by JohanDeBock: Jul 21 2006, 16:58


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
JohanDeBock
post Jul 22 2006, 21:35
Post #25





Group: Developer
Posts: 106
Joined: 23-March 05
Member No.: 20866
Again some more samples and fixed some errors in formulas I didn't notice before.


--------------------
foo_softplaylists
http://telin.ugent.be/~jdebock/foobar2000/
Go to the top of the page
 
+Quote Post
« Next Oldest · Lossless / Other Codecs · Next Newest »
 

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 

Display Mode: Standard · Switch to: Linear+ · Switch to: Outline

Track this topic · Email this topic · Print this topic · Subscribe to this forum

RSS Lo-Fi Version Time is now: 21st November 2009 - 14:33
Powered By IP.Board © 2009  IPS, Inc.