Skip to main content

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: MP3 decoders test : MAD isn't so good! (for me...) (Read 93216 times) previous topic - next topic
0 Members and 1 Guest are viewing this topic.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #50
I think that if Vorbis decoder decodes do 16-bit, it will already be 16-bit (constant) stream that will be fed to Peter's DSound SSRC plugin. So I believe it won't mess up with it anymore. Now, if you turn off Dithering on Vorbis decoder but tell it to decode at 16-bit it will truncate the file and the final stream will also be 16-bit, constant, truncaded. I think that if you want to use Pete's dither algorithm you should tell Vorbis decoder to decode to 24-bit non dithered.

I'm not really sure if it is correct. Perhaps someone could make things more clear.
Liberate tutemae ex inferis

MP3 decoders test : MAD isn't so good! (for me...)

Reply #51
What happens if I process my music in Winamp/mpg123 plugin in 24bit/32bit (should be possible, there is an option for it) and downsample it to 16 bit with PP's out_ds using dithering and noiseshaping. Shouldn't the result be the same or very similar (considering  garf's and PPs improvements done to the mpg123 base) as with foobar?

MP3 decoders test : MAD isn't so good! (for me...)

Reply #52
Quote
...
fed to Peter's DSound SSRC plugin.
...

Hi... could someone please tell me something about this DirectSound plugin? I've only just installed Winamp5, and I'm still searching for the best possible audio quality (which is why I read this thread, since I'm using the MAD input...)

I searched the plugins on Winamp's site, but I couldn't find 'peter's dsound ssrc plugin'...

thanks

d. (newbie extraordinaire)
Deekin: "And the sound of doom was nigh! Doom! Doom doom doom! DOOM!!!"


MP3 decoders test : MAD isn't so good! (for me...)

Reply #54
This is another interesting site for winamp 2.x plugs:
http://support.xmplay.com/Plugins_index.html
The installers here will only install to a folder where "XMPlay.exe" is present, but any binary file with that name will do.....
"ONLY THOSE WHO ATTEMPT THE IMPOSSIBLE WILL ACHIEVE THE ABSURD"
        - Oceania Association of Autonomous Astronauts

MP3 decoders test : MAD isn't so good! (for me...)

Reply #55
This is really a great site:
http://www.x-sound.com/index?update=005
To bad I don't understand japanese... but they keep good track of updates for a lot of fiiine 'ole proggys.... 
"ONLY THOSE WHO ATTEMPT THE IMPOSSIBLE WILL ACHIEVE THE ABSURD"
        - Oceania Association of Autonomous Astronauts

 

MP3 decoders test : MAD isn't so good! (for me...)

Reply #56
helpful, thanks!

d.
Deekin: "And the sound of doom was nigh! Doom! Doom doom doom! DOOM!!!"

MP3 decoders test : MAD isn't so good! (for me...)

Reply #57
Quote
I searched the plugins on Winamp's site, but I couldn't find 'peter's dsound ssrc plugin'...

You can get it here (direct link).

MP3 decoders test : MAD isn't so good! (for me...)

Reply #58
Most of above was over my head, but this might be the right thread to ask a question about something I never understood.  What is the effect and interaction of the dithering to get something higher than 16-bit audio quality on a 16-bit CD format and thence to MP3?  I'm thinking about SBM and the JVC K-sumpn or other (which I thought best). 
DMP Records did a re-release using such shaping/dithering technques of some of their earliest DDD recordings, intended to pass through info from the higher sampling rates they had used for Flim & the BBs -- I thought the update Cds super.  As a result, I tried upsampling to 48khz (Shibatch?) many over-16bit Cds as I  encoded them at the highest feasible LAME VBR settings; I thought that made the MP3s sound better, but I'll confess I was frittering to kill time in wee hours of late 2001-early 2002.
Perhaps related is why LAME results from horribly digitized analog-recorded music often improved on the CD; the most noticeable was '70s Tangerine Dream like Phaedra where, once processed by Dibrom, the music seemed clearer -- is that just that Dibrom's codecs knew what was spurious distortion and eliminated it?

MP3 decoders test : MAD isn't so good! (for me...)

Reply #59
Quote
• For this test, I didn't reproduced real listening conditions. Difference are so subtle that I have to increase the level of my amp in order to maximise the audible difference.
• In order to make it possible without being completely deaf in few seconds, I've selected very quiet samples. With classical music, it's not really hard to find such samples (even full tracks are sometimes totally quiet). I didn't evaluate any decoders on pre-instrumental silence, but only when music was playing


Sorry to bring up this over 1 year old thread (it was recently referenced).

On to business, I think this test is flawed...to listen to dither (around 1 bits worth) the volume must be increased by a large factor. The best dither on the planet would be one that kept it's noise just below audible threshold (ok there is some give an take with this, as peoples hearing differs and playback hardware is different, but only to an extent), and by just below I mean right upto the threshold. A dithers strength is proportional to the strength of this inaudible noise, multiplying up the dither noise (and making it audible) proves nothing, just that there is noise that can be heard when multiplied, with such a test only the weakest dither or no dither at all would come out top.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #60
Quote
A dithers strength is proportional to the strength of this inaudible noise, multiplying up the dither noise (and making it audible) proves nothing, just that there is noise that can be heard when multiplied, with such a test only the weakest dither or no dither at all would come out top.
[a href="index.php?act=findpost&pid=351210"][{POST_SNAPBACK}][/a]


You are completely wrong, and apparently misunderstand why dither is used at all.

It's also quite easy to prove this assertion wrong by actually doing what you describe.

As for the test being flawed; I think it's stated several times in this thread the effects of dither are below the audible threshold for any practical purpose. So any comparison will push practicality, and I think guruboolez` stated approach is sensible. But do the results matter? I would say they usually don't, and thats why dither defaults to off in fb2k.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #61
>apparently misunderstand why dither is used at all

I was under the impression it was to increase perceived bit depth, there are other reasons?

I am not questioning that part of the test (ok I will also...an mp3 created from a 16 bit CD? so suddenly there is 20 bits worth of dynamic range? a great test for dither).

Instead generate test sines (uncompressed) on the 16th+n bit and dither down to 16 bit then run listening tests, that would be a good test for dither.

>effects of dither are below the audible threshold for any practical purpose

So it is ok to multiply these up so they can be heard and pass comments on how one has more noise than the other? (I am aware there are many different types of dither, in this test only the ones which push the created noise into the higher frequencies would come out well), AFAIK most strong commercial dithers (as actually used on CDs) are not this type.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #62
Quote
>apparently misunderstand why dither is used at all

I was under the impression it was to increase perceived bit depth, there are other reasons?


"Wrong reason"

There are a lot of threads about dithering and dithering + noiseshaping around here; look for posts by KikeG, 2BDecided etc...

http://www.hydrogenaudio.org/forums/index....showtopic=29912

You dither to decorrelate the quantization error from the input signal.

Quote
I am not questioning that part of the test (ok I will also...an mp3 created from a 16 bit CD? so suddenly there is 20 bits worth of dynamic range?


Sure!

Nobody says there are 20 bits of dynamic range in the mp3 itself. However, if you lower the volume of the MP3 decoded output (in floating point), dither when converting to 16 bits, and up your amplifier, you are certainly going to hear how the sub-16th-bit resolution affects the output.

Quote
Instead generate test sines (uncompressed) on the 16th+n bit and dither down to 16 bit then run listening tests, that would be a good test for dither.


Maybe. But why do this when it can be tested with actual music, too?

Quote
>effects of dither are below the audible threshold for any practical purpose

So it is ok to multiply these up so they can be heard and pass comments on how one has more noise than the other?


Know another method to evaluate differences in something that should not be inaudible?

You can instead go to 10 bit resolution instead of 16 bit or so. Then no amplification is needed - the dither quality will be observable in normal conditions.

I don't know which comparison is more valid. I believe results will be similar if not identical.

Quote
(I am aware there are many different types of dither, in this test only the ones which push the created noise into the higher frequencies would come out well), AFAIK most strong commercial dithers (as actually used on CDs) are not this type.
[a href="index.php?act=findpost&pid=351221"][{POST_SNAPBACK}][/a]


The high end ones most certainly are.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #63
Quote
Quote
(I am aware there are many different types of dither, in this test only the ones which push the created noise into the higher frequencies would come out well), AFAIK most strong commercial dithers (as actually used on CDs) are not this type.
[{POST_SNAPBACK}][/a]


The high end ones most certainly are.
[a href="index.php?act=findpost&pid=351273"][{POST_SNAPBACK}][/a]


See here:

[a href="http://www.hydrogenaudio.org/forums/index.php?showtopic=9192]http://www.hydrogenaudio.org/forums/index.php?showtopic=9192[/url]

MP3 decoders test : MAD isn't so good! (for me...)

Reply #64
Thanks for the links, will research.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #65
Quote
On to business, I think this test is flawed...to listen to dither (around 1 bits worth) the volume must be increased by a large factor. The best dither on the planet would be one that kept it's noise just below audible threshold (ok there is some give an take with this, as peoples hearing differs and playback hardware is different, but only to an extent), and by just below I mean right upto the threshold. A dithers strength is proportional to the strength of this inaudible noise, multiplying up the dither noise (and making it audible) proves nothing, just that there is noise that can be heard when multiplied, with such a test only the weakest dither or no dither at all would come out top.
[a href="index.php?act=findpost&pid=351210"][{POST_SNAPBACK}][/a]

 
I did this test, which included dithered¹ and undithered² decoded files. According to your claim, the undithered decoding should end on top. But according to my results, they end last.
I didn't translate the test in english, so I guess you can't read my detailed results. But the marks are a good indication: undithered and inferior dithering (MAD) produce a more annoying form of distortion than a good dithering (perceptible by a tiny HF noise).
In one case (one Mahler sample), the reference CD (which is undithered) is lower quality than the MP3 encoding decoded with dithering!


¹ MAD and foobar2000
² LAME and Fraunhofer decoders.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #66
Quote
...(less aliasing, less naturel and less synthetic sound)[a href="index.php?act=findpost&pid=174740"][{POST_SNAPBACK}][/a]


What do you mean by "aliasing" here? I'm curious as to how an MP3 decoder could affect the AA filter of a DAC (or SRC)..

MP3 decoders test : MAD isn't so good! (for me...)

Reply #67
Quote
Quote
...(less aliasing, less naturel and less synthetic sound)[{POST_SNAPBACK}][/a]


What do you mean by "aliasing" here? I'm curious as to how an MP3 decoder could affect the AA filter of a DAC (or SRC)..
[a href="index.php?act=findpost&pid=351985"][{POST_SNAPBACK}][/a]

The sample is still online:
[a href="http://foobar2000.net/mp3decoder/files/lossless_mahler3.ofr]http://foobar2000.net/mp3decoder/files/lossless_mahler3.ofr[/url]
Result and comment are here:
http://foobar2000.net/mp3decoder/test7.htm

MP3 decoders test : MAD isn't so good! (for me...)

Reply #68
Quote
The sample is still online:
http://foobar2000.net/mp3decoder/files/lossless_mahler3.ofr
Result and comment are here:
http://foobar2000.net/mp3decoder/test7.htm


I don't doubt that you heard what you heard. My problem is that you used the word "aliasing".

My understanding of aliasing is as follows:

Aliasing in digital audio is a phenomenon that occurs due to the fact that several waveforms can mathematically occupy the same sample points; the illegal waveforms are aliases. All the aliasing waveforms are frequencies > fs/2 --> an oversampling DAC contains a low pass filter to remove those frequencies. A SRC also needs to deal with this issue.

Of course, I could be wrong. In that case, please correct me.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #69
By aliasing I meant a weird form of "geometric" distortion easily audible with resampling (16->8 bits for example).
I defined it (in french) in the beginning of sample-02.

I put online this extreme example to illustrate this phenomenon:
http://foobar2000.net/mp3decoder/files/aliasing.ape


You can see the geometric distortion (something like a wave form) on the middle.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #70
Quote
By aliasing I meant a weird form of "geometric" distortion easily audible with resampling (16->8 bits for example).


Ok, that's not aliasing - in all likelihood it's just dithering noise.

Aliasing has a very specific look in the frequency plane -  the signals are mirrored around fs/2 (22.05 kHz if the source is 44.1 KS/s).

Anyway, this was just a sidetrack. Thank you for your tests.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #71
Btw, it appears that your testing procedure for dither evaluation is flawed. This is what Dan Lavry of Lavry Engineering (famous DAC/ADC maker) has to say:

Quote
Dithered noise shaping technology has been incorporated into a handful of hardware devices. While all are based on the same concepts, some perform better than others. After simulating and listening to all available public domain algorithms, Lavry Engineering came to some conclusions in forming a basis for Acoustic Bit Correction™. The principal conclusions are:

a. The practice of greatly amplifying low level signals to determine triangular flat PDF (probability density function) dither reveals the effectiveness of distortion and noise modulation elimination. This practice yields misleading results when testing unflattened dithers and/or noise shapers. It conflicts directly with L. Fielder’s findings showing completely different threshold delectability curves for quiet and loud levels. Noise shaping listening tests must be done at "reasonable" volume levels.

b. Given the above requirement, our listening tests concluded a strong preference for "triangle high pass" dither (this dither is produced by simultaneously adding a new random number and subtracting the previous value). Such dither is frequency-shaped to carry more high frequency energy (the energy content at low frequencies is minimal).

c. Listening tests revealed a preference for smoothly varying noise-shaping curves. Peaks and notches seem to irritate the listener (admittedly while turning the volume up). In addition, despite the temptation to optimize the noise shaping curve to the average listener’s hearing threshold, given a significant variation from listener to listener requires reasonable compromises in tailoring such a curve. In other words, smooth the curve.
The improvements offered by dither and noise shaping vary with source material and final word length. An A/B/X test at 16-bit level, requires a quiet environment and low level (loudness) audio. The listener must resist the temptation to turn the volume up to unreasonable levels. The practice of truncating to short word length (8-12 bits) should be avoided. The ideal noise-shaping curve may be irritating at loud levels.
Lavry Engineering’s listening tests were based on test tones and repeating loops of quiet passages of various material (mostly classical music) with flat amplifier response. Listening to test tones was straightforward: we used the Model AD122-96 MKIII test tone generator mode switching the Acoustic Bit Correction™ on and off. The frequency and amplitude programmability was very useful.


http://recforums.prosoundweb.com/index.php.../48/0#msg_num_1

MP3 decoders test : MAD isn't so good! (for me...)

Reply #72
...so I am not alone in my thinking. It it like those who dare question that the world is not flat, discussion is good and shouldn't be counted with a 'do the results matter?', of course they matter. It is the basis of all scientific testing, as apposed to theological ideas.

Dither is one of those difficult areas, since my original post I have spent a further 20 hours reading up and still think (70% sure) you cannot mess with the signal as it invalidates the process. I am of the view the best way to test dithers is in the frequency domain, this deternimes if the dither is effective (such as > -100 db dynamic range at certain frequencies) and here is the clincher, as long as the noise added remains inaudible in normal circumstances then the dither is working as should.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #73
Well, if I read the quote, they used low volume music and *did* turn the volume up, just not unreasonably loud.

Again, I don't see any other way to practically test this. You can analyse the dither in other ways, but the actual tuning of the noise shaper is a psychoacoustics process.

Hearing beyond the 15th bit is extremely hard, how are you going to test different dithers for audibility there? You'll have to go a similar way, set up a soundproof room and spend a lot on time on listening tests.

Don't misunderstand me. I fully agree that the most solid test is in the actual playback conditions, 16 bit, volume at a default setting. It's just very hard. Each time you turn the knob, testing gets easier, and you will deviate very slightly. It's not like the hearing curves suddenly turn upside down. I think you are right to criticise the test, but it's not sensible to say the results are completely flawed if you haven't been able to perform a better one - because while the hearing curves do change with loudness, they change smoothtly, it's not like they turn upside down.

It's like saying Newton is wrong because you observed a relativistic effect. Yes, you might be right, but until Einstein comes along Newtons results are certainly very usable

If I get your proposal, you want to evaluate the SNR gain in the frequency domain, and then turn up the dither as loud as possible while still being inaudible.

This sounds great in theory, but you might run into practical issues. You'll end up blasting VERY LOUD HF noise through the reproduction system, and not all of them will like that. Think blown tweeters, so be carefull 

Good luck!

PS. The fact that audibility and masking levels are dependant on loudness and the listener isn't news...You will be able to apply a lot more dither if the person listening is 40 years old and deaf to 13kHz than against a 15 year old that hears 18kHz.

MP3 decoders test : MAD isn't so good! (for me...)

Reply #74
I'm getting a 403 Forbidden response from http://www.foobar2000.net/.

Is this just me, or does Guruboolez need to kick his server administrator?
I'm on a horse.