Skip to main content

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: (Not a) good explanation of jitter in TAS (Read 89252 times) previous topic - next topic
0 Members and 1 Guest are viewing this topic.

(Not a) good explanation of jitter in TAS

Reply #150
Could I, with genuine respect, make a small observation here. People are wanting John_Siau to engage in a debate on audibility thresholds. He has said earlier that he has the [a href='index.php?act=findpost&pid=113']'luxury'[/a] of not having to bother too much about thresholds, he wants to make stuff with a safety factor. This is entirely rational, as a luxury: it would seem that if one used that sort of equipment, one could kick out the jams and play music at unusual, or even unwise, levels and still be sure of not hearing artifacts.

I say that because there's a slight tendency to attribute to him scepticism about ABX tests. That is not at all the case, it's just that, for him, audibility in a blind test is not the design target, but rather the certainty of inaudibility even in extreme cases.

Equally, it's a bit unreasonable to expect him to campaign against audiophile errors. He makes genuinely good stuff, which is advertised with honest information (which in itself has an educational value); that seems not merely ethical, but honorable. OTOH, a lot of his market will be rich people with funny ideas, and it is a bit unreasonable to expect him to go around saying "Hey, f'wits, you believe a load of garbage. Buy my stuff."

Sorry to interfere, but I've seen discussions get unnecessarily heated, and I'm enjoying following this one.

(Not a) good explanation of jitter in TAS

Reply #151
What do you want? Ending the discussion, because luxury must stay exempt from reason? That would be both boring and inconsistent.

A sheik doesn't put golden screws under his rear seat, where nobody would ever be able to see them. He puts them where a difference is visible. Some Porsches can be called over engineered, great cars! But they did not waste a hundred million to increase the rear mirrors' reflectivity from 99.96 to 99.9999999 percent, just because they could.

I own a DAC1 myself for many years, and I have always been very satisfied with it. It's like putting an "end of story" on the question which DAC to choose and wether it matters. Still I couldn't answer, if spending $1000 was necessary. I find the question wether it is the equivalent of an over-engineered rear-view mirror or actually able to make an audible difference highly interesting. I have never actually recommended the DAC1 to anyone for exactly that reason. I can't guarantee that it's not a waste compared to a good, modern sound card.

And I agree, ABX playback levels should not be constrained to only usual cases. Especially when I get intimate with Beethoven at 100-105 db every once in a few years, I don't want to hear any additional hiss from my playback chain. So ABX tests regarding high end DACs should not prohibit unusual levels, only those where it gets pathological (like >106 db for more than 30 minutes).

(Not a) good explanation of jitter in TAS

Reply #152
Indeed, I thought I made very similar points to MichaelW's earlier in the thread...

(Not a) good explanation of jitter in TAS

Reply #153
He has said earlier that he has the [a href='index.php?act=findpost&pid=113']'luxury'[/a] of not having to bother too much about thresholds, he wants to make stuff with a safety factor. This is entirely rational, as a luxury: it would seem that if one used that sort of equipment, one could kick out the jams and play music at unusual, or even unwise, levels and still be sure of not hearing artifacts.

Thank you!

My goal is to design products where all of the artifacts produced by the product fall below the threshold of hearing in a silent room.  In order to guarantee inaudibility, I am consciously ignoring masking effects and designing as if the only sound being played was that of the artifacts.  To me this means keeping the sum total of all artifacts at a level that is at least 110 dB below the peak audio levels.  This goal has been achievable in the analog domain for at least 20 years, and for the last 10 years has been achievable in the digital domain.  Achieving these goals requires more engineering, careful circuit layout, and a few more components.  We deliver products that meet these goals in a price range that may seem extravagant to the average consumer ($1000 to $2000).  But, these are very reasonable prices for professional products that will be used in a recording studio on a regular basis.  The hi-end hi-fi enthusiast looks at our products and says "how can it be any good if it only costs $2000"?

My approach would be entirely different if I were designing perceptual encoders and decoders.  My hat is off, and I take a bow to the engineers who design these systems to ride the hairy edge between audibility and inaudibility.  In may ways their job is much more difficult than mine.  The data that drives their design decisions has been derived from many carefully designed listening tests and ABX tests.  The success of their efforts can and should be evaluated with carefully designed listening tests.  On the other hand, if I achieve my very conservative design goals, and validate them with extensive measurements, the listening tests simply serve as a final check to confirm inaudibly.

If we can show that an artifact is 135 dB below the level of the music, most reasonable people will agree that a listening test is not required to prove inaudibility.  If an artifact is 70 dB below the level of the music, we should consider testing for audibility.  These two numbers -135 dB FS and -70 dB FS represent the level of jitter artifacts in good professional gear and common consumer products respectively.  If we measure noise the numbers are -117 dB FS and -70 to -80 dB FS.  If we measure THD+N the numbers are -110 dB vs -60 to -40 dB.  The large discrepancy in performance between professional and common consumer equipment should make some wonder if the differences are audible!

The average consumer has no idea how bad their CD player or sound card really is.  There often are no published specifications.
John Siau
Vice President
Benchmark Media Systems, Inc.

(Not a) good explanation of jitter in TAS

Reply #154
The average consumer has no idea how bad their CD player or sound card really is.  There often are no published specifications.


Or one could say "The average consumer has no idea how good their CD player or sound card really is.  There often are no published specifications."

As already stated, audibility and safety factor are not the same things.  From what I've seen, the DAC1 does measure better than most (if not all) stuff out there.  But would I be able to pass a blind test between it and a basic (less than $100) CD/DVD player or sound card from an local electronics store?

In my experience with volume controlled tests, no.  Granted, I cannot generalize my findings to the population at large, but I think a number of people on Hydrogen-Audio would side with me regarding how good even entry level stuff is.  Your statement makes it seem like there is a lot of junk out there, but I won't believe such a statement unless some measurements and blind tests results are posted.

(Not a) good explanation of jitter in TAS

Reply #155
The average consumer has no idea how bad their CD player or sound card really is.

How bad can it really be if they don't know? 
elevatorladylevitateme

(Not a) good explanation of jitter in TAS

Reply #156
Your statement makes it seem like there is a lot of junk out there, but I won't believe such a statement unless some measurements and blind tests results are posted.

OK, fair enough.  I like the fact that you need to see evidence.

I can post the measurements and will do so shortly.  I need to put up a web page where interested persons can download PDFs of our tests of CD and DVD players.  I hope to have the page up by the end of the day. 

I will also post tests of computer sound cards within a few days.
John Siau
Vice President
Benchmark Media Systems, Inc.


(Not a) good explanation of jitter in TAS

Reply #158
Could I, with genuine respect, make a small observation here. People are wanting John_Siau to engage in a debate on audibility thresholds. He has said earlier that he has the [a href='index.php?act=findpost&pid=113']'luxury'[/a] of not having to bother too much about thresholds, he wants to make stuff with a safety factor. This is entirely rational, as a luxury: it would seem that if one used that sort of equipment, one could kick out the jams and play music at unusual, or even unwise, levels and still be sure of not hearing artifacts.

I say that because there's a slight tendency to attribute to him scepticism about ABX tests. That is not at all the case, it's just that, for him,
audibility in a blind test is not the design target, but rather the certainty of inaudibility even in extreme cases.


No one would have an issue if he said his design goal was 'bullet proof' performance for its own sake and left it at that.

But he's also the one making claims edging towards *routine* audible difference in CDPs under normal listening conditions (Although whether the conditions cited are 'normal' is also under dispute; I've seen no address yet to this point of Axon's:

Quote
That would seem to suggest a concrete counterexample to Meyer/Moran, except for the fact that 100dB A-weighted slow seems extremely loud to me. You could only play 2 CDs at that loudness a day before exceeding OSHA occupational noise limits.

If used with "uncompressed" music, suggesting a crest factor of 20db, you're looking at peak SPLs in the 120-130dB range. I'm not really sure that is a normal playback level to begin with.
)

There are no free passes, nor should there be.  Free passes for audio claims have done enough damage to the hobby already. As tiptoe eloquently noted on the 'do we need audiophiles' thread:

Quote
There is an entire ecosystem of false information, over-priced products, magazines that pontificate on said information and products, and then tons of forums where the audiophiles all sit around and agree with each other. Once you buy into it, you get constant reinforcement. The more strongly you believe, the more of it you will take in and believe.

(Not a) good explanation of jitter in TAS

Reply #159
But he's also the one making claims edging towards *routine* audible difference in CDPs under normal listening conditions (Although whether the conditions cited are 'normal' is also under dispute; I've seen no address yet to this point of Axon's:

Quote
That would seem to suggest a concrete counterexample to Meyer/Moran, except for the fact that 100dB A-weighted slow seems extremely loud to me. You could only play 2 CDs at that loudness a day before exceeding OSHA occupational noise limits.

If used with "uncompressed" music, suggesting a crest factor of 20db, you're looking at peak SPLs in the 120-130dB range. I'm not really sure that is a normal playback level to begin with.

Movie theaters and movie post-production facilities are calibrated to deliver 85 dBc at -20 dB FS.  At this level, the -93 dB noise floor of a 16-bit system will be reproduced at a level of 12 dBc.  This means that the noise floor of a 16-bit digital system should be audible in these calibrated facilities. We build converters that are used in these applications so it is important for us to occasionally calibrate them to these levels for short intervals of critical listening.  Systems with a 70 to 80 dB SNR are not acceptable in an environment that is calibrated for film.  What constitutes normal levels an acceptable performance in the living room is another matter altogether.  Some home theater systems are calibrated to match the levels of public theaters.  These home theater applications put significant demands on the SNR of the system.

Free passes for audio claims have done enough damage to the hobby already. As tiptoe eloquently noted on the 'do we need audiophiles' thread:

I agree there should not be any free passes!

Quote
There is an entire ecosystem of false information, over-priced products, magazines that pontificate on said information and products, and then tons of forums where the audiophiles all sit around and agree with each other. Once you buy into it, you get constant reinforcement. The more strongly you believe, the more of it you will take in and believe.

I wholeheartedly agree.

John Siau
Vice President
Benchmark Media Systems, Inc.

(Not a) good explanation of jitter in TAS

Reply #160
Remember, if you are going to make claims about audible differences in sound quality, they must be accompanied with double-blind test results.

My test plots will not confirm audibility but they may suggest the need to investigate audibility with the double-blind tests that I proposed earlier in this thread.

John Siau
Vice President
Benchmark Media Systems, Inc.

(Not a) good explanation of jitter in TAS

Reply #161
What do you want? Ending the discussion, because luxury must stay exempt from reason? That would be both boring and inconsistent.

So ABX tests regarding high end DACs should not prohibit unusual levels, only those where it gets pathological (like >106 db for more than 30 minutes).


You really do need to learn to read. I was not saying that ABX tests are in any way wrong. What I am saying is that there is no law in nature or ethics which says it is wrong to overdesign anything, to build to way beyond the threshold of audibility, as long as you know what you're doing, and acknowledge it is a luxury. It's only wrong if you then claim there are clear audible differences.

What I'm worried about is the zealotry, that says it is somehow a betrayal of reason to build anything with a healthy margin. What John_Siau's stuff is doing is the same as someone who knows that they can only ABX LAME V5, but encodes at V2 to be on the safe side, because disk is cheap. Do you see anything immoral in that?

I am NOT wanting to end the discussion. Did you fail to read my statement that I found the discussion interesting? What I did not want was for it to get diverted from the refinements of audibility into yet another bit of audiophile bashing. Yes, they can be fools (satisfied?), but there are other  things to talk about, and when we get someone who both builds extravagant stuff and knows what he's doing, it would be a pity to start bashing him as though he were purveying pixie dust. Which I saw a danger of happening. And your response is just what I'm worried about. See something that on a sloppily careless reading can look like questioning reason, and flame away.

Reading is also to do with thinking, just like mathematics.

(Not a) good explanation of jitter in TAS

Reply #162
But he's also the one making claims edging towards *routine* audible difference in CDPs under normal listening conditions


That, I think, is your suspicion talking. I have not so read him. It is common to acknowledge, here, that a difference is audible between 16-bit and 24-bit when played at unusual (but not fatal) levels. As I said, there may well be people who are prepared to risk a bit of hearing loss to, just occasionally, really crank it up. It might be unwise, but as long as it's their decision, why not include this unusual case in the design targets.

I am NOT questioning the value of all the careful work that has been done on the limits of hearing. (Also, I myself have crappy hearing and don't ever intend to spend real money on audio equipment--I'm more interested in music). But there is a tendency to be really fundamentalist about it. I can not see that it is any kind of crime against reason to design to better than audibility threshold, and to say so. That is what I mean by luxury. Except, of course, that in professional use, it might not be luxury. Not even the fundamentalists question using 24/96 for recording and processing.

Also, a manufacturer of high quality equipment is NOT responsible for the garbage put out by scam artists. Another point that fundamentalists find hard to accept.

(Not a) good explanation of jitter in TAS

Reply #163
That, I think, is your suspicion talking. I have not so read him.


This is a quote from post 113.

"We have a QSC ABX tester that we used to compare consumer CD players to prototypes of our DAC1 converter. It was fairly easy to score perfectly on the ABX tests. The CD players with modulation problems sounded like they had more midrange when played through their internal D/A converters than when played through the external DAC. This was a rather surprising result given that both devices had nearly identical frequency responses."

This is from post 154

"The average consumer has no idea how bad their CD player or sound card really is. There often are no published specifications."

I interpreted all of these as audible differences.  Don't get me wrong, John_Siau hasn't made the blanket "Night and Day" difference comments you hear on many audio forums, but a claim to an audible difference, even a minor one, is still a claim to an audible difference.  If the claim is a difference "at untypically loud volumes" that's fine as that tells me I can still buy my el-cheapo DVD player from a local audio store and get a negative blind tests at subjectively (to me) sane volume levels.

But at this point I'm not sure if these claims are for ear damage inducing volumes or not.

(Not a) good explanation of jitter in TAS

Reply #164
But he's also the one making claims edging towards *routine* audible difference in CDPs under normal listening conditions


It is common to acknowledge, here, that a difference is audible between 16-bit and 24-bit when played at unusual (but not fatal) levels. As I said, there may well be people who are prepared to risk a bit of hearing loss to, just occasionally, really crank it up. It might be unwise, but as long as it's their decision, why not include this unusual case in the design targets.


You need to add another condition. In order to hear a difference beteween 16-bit and 24-bit when played at unusual (but not fatal) levels you need some special program material. Your average orchestral/pop recording has no more than about 65-70 dB dynamic range, which means that no matter whether you listen to a 16 or a 24 bit recording of it, the noise floor is built into the recording, typically at the outputs of the microphones.  The widest dynamic range commercial recording I've ever found had more like 85 dB dynamic range, but that still means that the noise floor is set by the recording, not the CD medium nor the player.



(Not a) good explanation of jitter in TAS

Reply #165
But he's also the one making claims edging towards *routine* audible difference in CDPs under normal listening conditions


That, I think, is your suspicion talking. I have not so read him. It is common to acknowledge, here, that a difference is audible between 16-bit and 24-bit when played at unusual (but not fatal) levels. As I said, there may well be people who are prepared to risk a bit of hearing loss to, just occasionally, really crank it up. It might be unwise, but as long as it's their decision, why not include this unusual case in the design targets.


AIUI, the difference is audible on low-level content , played at a high output level.  There may be people 'cranking up the fadeouts of Metallica songs specifically, but I'd guess more typically they're cranking up the loud parts -- parts where the 16 vs 24 difference is not going to be audible even when 'cranked'.

Quote
I am NOT questioning the value of all the careful work that has been done on the limits of hearing. (Also, I myself have crappy hearing and don't ever intend to spend real money on audio equipment--I'm more interested in music). But there is a tendency to be really fundamentalist about it. I can not see that it is any kind of crime against reason to design to better than audibility threshold, and to say so. That is what I mean by luxury. Except, of course, that in professional use, it might not be luxury. Not even the fundamentalists question using 24/96 for recording and processing.


Actually some 'fundamentalists' do question the 'need' for 96 kHz SR.  It doesn't impart inherently better sound (as audiophiles tend to believe), it just makes it EASIER to get it.  And high-bit recording and production is typically used NOT to 'increase resolution' in the audiophile vernacular parlance, but to increase headroom (during recording) and prevent audible artifacts from being introduced (by production).

The implication: one could 'overbuild' a 44/16 chain, and with carefully monitored recording, and minimal production, make a recording that doesn't 'need' either higher SR or higher bitdepth.


Quote
Also, a manufacturer of high quality equipment is NOT responsible for the garbage put out by scam artists. Another point that fundamentalists find hard to accept.


All the more reason to very, very carefully observe the boundary of 'we do it because we can' versus 'we do it because it makes stuff sound better'.   

Btw, your use of the label 'fundamentalist' is hardly conducive to the amity you're advocating.


(Not a) good explanation of jitter in TAS

Reply #166
Btw, your use of the label 'fundamentalist' is hardly conducive to the amity you're advocating.


Oh, I'd quite got over amity. I was pissed off at the suspicion and hostility that was starting to show towards a rational contributor.

"Fundamentalist" was mostly trolling, but not entirely, because there is a mindset around that says because 44/16 is enough, it's somehow a betrayal to use more (more headroom is a kind of concession to human weakness, or something).

There's even sometimes a suspicion of using measurements. Surely the great achievement of the last 50 years or so is to discover what actually makes a difference to perception, and what instrumental measurements are relevant, and what numbers. Of course, DBT is vital to validate and calibrate this, but surely engineers find it much easier to design and develop to criteria that can be measured instrumentally? Check, if necessary, by DBT at the end. But what some people might want to do (e.g. John_Siau) is to say something like "<defect> may be audible at, say, -70 db, so I'll design to -100, because if I designed to -75, I'd have to run a DBT." And what is fundamentalist is to take a statement like that and challenge it on grounds of suspicion of heresy--"How do you know it might be audible at -75? How dare you act on that untested assumption?".

The problem with fundamentalism is not what is believed, but how it is believed. And I've seen before that someone with a rational and perhaps verifiable point gets attacked because it looks like it challenges the established view. I'm thinking of the thread on the possibility that a cartridge has a compensating error in stereo reproduction which might mean that you can get a better stereo image with vinyl. That idea got flamed because people thought it was just another vinyl-is-better rave. That failure to actually listen, and the manichaean division of the world into the enlightened and the phools, seems reasonable to call fundamentalist.

(Not a) good explanation of jitter in TAS

Reply #167
Btw, your use of the label 'fundamentalist' is hardly conducive to the amity you're advocating.


Oh, I'd quite got over amity. I was pissed off at the suspicion and hostility that was starting to show towards a rational contributor.


Rational?

I'd say somewhat rational.

I'd also say someone who is grasping at straws.

Take for example, this statement:

"The average consumer has no idea how bad their CD player or sound card really is. There often are no published specifications."

Today, the inverse  of that is also true.

The average consumer has no idea how good their CD player or sound card really is. There often are no published specifications. However, if you put even a $39.95 optical disk player or a $29.95 sound card on the test bench, it performs well enough for sonically transparency to be extremely likely. If you listen to it and get past any biases you may have, it usually sounds great.


Quote
"Fundamentalist" was mostly trolling, but not entirely, because there is a mindset around that says because 44/16 is enough, it's somehow a betrayal to use more (more headroom is a kind of concession to human weakness, or something).


It's not a betrayal, its just a waste.

In this day and age, building a DAC with 100 dB dynamic range is almost a slam dunk. But, building a true 24 bit DAC is mission impossible. Why put a ton of effort into doing something that's going to be difficult and costly?

Quote
There's even sometimes a suspicion of using measurements. Surely the great achievement of the last 50 years or so is to discover what actually makes a difference to perception, and what instrumental measurements are relevant, and what numbers. Of course, DBT is vital to validate and calibrate this, but surely engineers find it much easier to design and develop to criteria that can be measured instrumentally? Check, if necessary, by DBT at the end.


OK.

Quote
But what some people might want to do (e.g. John_Siau) is to say something like "<defect> may be audible at, say, -70 db, so I'll design to -100, because if I designed to -75, I'd have to run a DBT."


You are distorting reality. Current reality is that just about the cheapest DAC that's worth the trouble to stick on a circuit board has maybe 90 dB or better dynamic range. Nobody is using 70 dB DACs as their baseline any more, except maybe people building $20 or cheaper portable CD players.


Quote
And what is fundamentalist is to take a statement like that and challenge it on grounds of suspicion of heresy--"How do you know it might be audible at -75? How dare you act on that untested assumption?".


It's 2009, and your argument is off by over 20 dB. That makes it a straw man argument whether you know it or not.

Quote
The problem with fundamentalism is not what is believed, but how it is believed. And I've seen before that someone with a rational and perhaps verifiable point gets attacked because it looks like it challenges the established view. I'm thinking of the thread on the possibility that a cartridge has a compensating error in stereo reproduction which might mean that you can get a better stereo image with vinyl. That idea got flamed because people thought it was just another vinyl-is-better rave. That failure to actually listen, and the manichaean division of the world into the enlightened and the phools, seems reasonable to call fundamentalist.


Yet another straw man argument. The LP format has a ton of grossly audible things wrong with it, poor and variable imaging being just one of them. The *real* situation is that the people who prefer vinyl are using a biased criteria to judge sound quality. They don't want the best possible imaging, they want the sort of garbaged-up imaging that you get from vinyl. They like that classic nasty LP sound, along with the grit, the tics, the other noises, and all the rest. If what they hear has the audible flaws of vinyl, its what they like.

Pursit of purer sound that more closely resembles a live performance has nothing to do with it, their rhetoric notwithstanding.

(Not a) good explanation of jitter in TAS

Reply #168
You are distorting reality. Current reality is that just about the cheapest DAC that's worth the trouble to stick on a circuit board has maybe 90 dB or better dynamic range. Nobody is using 70 dB DACs as their baseline any more, except maybe people building $20 or cheaper portable CD players.

Yes, but are these circuit board delivering 90 dB to the analog outputs?  Do you have measurement data that show that they do?  If so, please provide this information, it would be helpful to this discussion.  If measurements are not available, lets take the first step and make a few measurements.

I will measure the CD, DVD, and sound cards that we happen to have in our facility here.  I will test these devices for SNR, THD+N, and frequency response.  I will also capture an FFT of the output.  These tests may (or may not) show that audible differences could be possible.  If the tests show a possibility of audible differences, it would seem that the next logical step would be to conduct some DBTs.

Quote
Quote
And what is fundamentalist is to take a statement like that and challenge it on grounds of suspicion of heresy--"How do you know it might be audible at -75? How dare you act on that untested assumption?".


It's 2009, and your argument is off by over 20 dB. That makes it a straw man argument whether you know it or not.


OK, how bad does a device need to measure before we should suspect audible differences?  Or, how good does a device need to measure before we can say "there should be no audible differences"?  And how large is that gray area in between?

This forum demands DBTs for all claims of audibility.  I am a firm believer in the need for DBTs and in the need to confirm audibility of measured defects.  The industry is full of ridiculous claims that cannot be verified with DBTs, and those making these claims frown upon DBTs.  I enthusiastically commend this forum for its strong stance on DBTs.

But lets not be so focused on DBTs that we ignore other evidence.  DBTs are not the only tool at our disposal:  We also have a great deal of psychoacoustic data that was generated from well-designed listening tests that give us guidelines for what may be audible or inaudible.  We also have excellent measurement equipment that is widely available.  Surely we cannot ignore what good psychoacoustic data can tell us about the significance of properly executed measurements.  Measurements do have some value when properly interpreted in the light of well-established psychoacoustic data.

44.1 kHz/16 bit PCM was designed to be good enough to be inaudible at normal listening levels.  Is it too much to ask that our CD players and sound cards at least deliver this level of performance?  Is 44.1 kHz 16-bit performance is a luxury in a typical home environment?  If so, is there a lesser standard that we should expect from our equipment?  What is this lesser standard (if someone wishes to propose one and defend it)?

If we agree that "CD quality" is a reasonable expectation wouldn't it be interesting to know where the average home CD or DVD player falls in relationship to this?  If they are usually significantly worse that CD quality, perhaps some DBTs are needed.  If they are significantly better than CD quality, many in this forum may feel that these DBTs would be a waste of time.
John Siau
Vice President
Benchmark Media Systems, Inc.

 

(Not a) good explanation of jitter in TAS

Reply #169
Quote
... there is a mindset around that says because 44/16 is enough, it's somehow a betrayal to use more (more headroom is a kind of concession to human weakness, or something).


It's not a betrayal, its just a waste.

In this day and age, building a DAC with 100 dB dynamic range is almost a slam dunk. But, building a true 24 bit DAC is mission impossible. Why put a ton of effort into doing something that's going to be difficult and costly?

Regarding the issue of "Luxury":

It may be a luxury to drive a 4X4 on the paved roads of suburbia, but a 4X4 is not a luxury for the farmer that needs to drive out to distant fields on his farm to check on crops or livestock.  What is a luxury in the living room may be a necessity in professional audio applications.  Let me give an example:

We build line-level analog to analog audio distribution amplifiers with a 500 kHz bandwidth (they measure 0.1 Hz to 500 kHz +0/-3 dB).  Immediately most sane people would assert that this is "overkill", and a "luxury", and "20 Hz to 20 kHz is more than adequate".  Or they might say "if professional users are willing to pay for this then let them, but what a waste".

Actually the professionals that buy this equipment, specify it because they need it.  They need the extended bandwidth (not because they claim to have golden ears, but because they have a legitimate verifiable need).  These 500 kHz audio devices are used in television broadcast facilities where it is not uncommon to find 50 or more audio stages in the signal chain between the microphone and the TV transmitter.  If each stage was 3 dB down at 20 kHz, we would have 50 cascaded 20 kHz low pass filters which would yield an overall system bandwidth of less than 1 kHz!  With the 500 kHz devices they can achieve 10 to 15 kHz system bandwidths in typical applications.  Believe it or not, it took the television industry a number of years to figure out that they needed 500 kHz audio distribution amplifiers.  Nobody had taken the time to measure the end-to-end performance of the television network, and nobody had done the math.

We have a similar situation:  Nobody has taken the time to measure the end-to-end performance of audio delivery to the home.  We have a significant body of psychoacoustic data that suggests what we can and cannot hear.  What we don't have is a good grasp on how well the delivery quality matches the design goals of the 44.1 kHz 16-bit system.

If we want to deliver a CD product that approaches the limits of the format, we need to do substantially better than this in the recording studio.  Again it took the industry a while to figure this out.  "CD quality" can and is being done, but such recordings are still few and far between.  Each element in the studio chain must significantly outperform the CD system in order to deliver a "CD quality" product.  If you do the math it can be shown that most of the devices in the chain need to be about 12 dB quieter than the noise floor of the CD system.  Likewise bandwidths must exceed that of the CD system if the goal is a product with "CD quality".

The tools that are required to deliver an end product with "CD quality" are now readily available to recording studios.  We are one of the companies that specialize in building these tools for professional applications.  When these professional tools are brought into the home environment, the quality of the recording and the limitations of the CD format become the sole performance limitations.  When consumer grade products are used in the home, the end results may still be limited by the quality of the recording, but in other cases the CDP will be the limiting factor.  Ultimately it would be nice to see CDPs that deliver "CD quality".  I suspect that we are not there yet.  Let's find out where we are!

Are the current CDPs DVDs and sound cards good enough?  It all depends on how they are being used.  Are you driving through suburbia, or through 2 feet of mud?  If you are using a digital volume control that is not set near 100% at normal listening levels, you may be driving through 2 feet of mud!  There are three valid solutions:

1) Stop driving through the mud - (set the digital volume near 100% and turn down an analog volume control - if one exists)
2) Buy the 4x4 - (use a "luxury" D/A converter so that you can enjoy the convenience of a digital volume control and still achieve CD quality playback)
3) Get stuck once in a while - (tolerate the degraded performance introduced by the less-than-ideal gain staging caused by the digital volume control)

All three choices are valid.  Most consumers will pick option 3.  Option 3 is also a very good choice when other factors such as speakers and amplifiers may be limiting the system performance.
John Siau
Vice President
Benchmark Media Systems, Inc.

(Not a) good explanation of jitter in TAS

Reply #170
Has anybody besides John Siau access to a high end ADC? For example from Benchmark or Apogee. I would love to hear some common gear's outputs (Mac minis, Intel HD audio compliant onboard chips, Creative's cards, etc.) recorded at high resolution. It would be interesting to see wether those were ABXable at all vs. the original files, when you play them back through a good DAC.

While I'm looking forward to John Siau's "jitter only" tests, the former would be much easier to conduct and still have much practical relevance for many of us. It would show if and if yes how much of a difference a good DAC can make for (non professional) home use.

Of course, also a regular ADC would work, but it could add its own artifacts to the result and thereby mask a tested DAC's signature.

How about starting with the EBU SQAM Harpsichord sample?

(Not a) good explanation of jitter in TAS

Reply #171
There are a gaggle of people here with Transporters. Certain mid-fi interfaces like the 0404 USB might qualify.

In other news, is anybody able to make actually good use of my jitter simulator, if I packaged it up?

(Not a) good explanation of jitter in TAS

Reply #172
I don't know about CD players, but measurements for onboard and dedicated sound cards are all over the web.

Some onboard chipsets - Bit-tech.net
Some Discrete Cards - Firingsquad
Other Various Cards - Firingsquad

I found all of that in 10 minutes.  If I had specific cards to look for and a few hours...

As you can see, even onboard chipsets exceed 75 db for dynamic range, stereo crosstalk etc.

(Not a) good explanation of jitter in TAS

Reply #173
Edit: The following is inaccurate. Please read my [a href=\'index.php?act=findpost&pid=651262\']follow-up[/a].

Even without access to a good ADC I have just successfully ABXed a Benchmark DAC1 vs. a Macbook Pro's (early 2008) onboard audio (Intel HD audio compliant Realtek codec) - both level matched and time synched!

Procedure (Recording 2x):
  • Connect the MBP's line-out into its line-in with a loopback cable (1. run) / connect the MBP via Toslink to the DAC1 and its outputs to the MBP's line-in (2. run).
  • Set Mac OS X's audio parameters to output 44.1 kHz/24 bit, input 96 kHz/24 bit.
  • Playback fullscale 1 kHz sine wave to adjust input gain to just below clipping.
  • Record while playing back tec_sqam_40a test sample.
  • Normalize recorded sample to -1 db.

Procedure (ABX):
  • Normalize tec_sqam_40a to -1db and convert its sample rate to 96 kHz (Audition 3, highest quality, without pre/post filtering).
  • Synchronize recorded samples' time/offset to tec_sqam_40a's with Synchrotron.
  • Invert/restore phase of DAC1 recording.*
  • Set Mac OS X's output parameters to 96 kHz/24 bit.
  • Plug headphones into DAC1.
  • ABX with Foobar in VMware Fusion virtual machine.

It was quite easy, I focused onto the range 0:07-0:09.

Code: [Select]
foo_abx 1.3.4 report
foobar2000 v0.9.6.8
2009/08/12 00:57:02

File A: Z:\rpp3po\Downloads\rec_dac1_24_inverted.wav
File B: Z:\rpp3po\Downloads\rec_mbp_24.wav

00:57:02 : Test started.
00:58:02 : 01/01  50.0%
00:58:08 : 02/02  25.0%
00:58:21 : 03/03  12.5%
00:58:32 : 04/04  6.3%
00:58:41 : 05/05  3.1%
00:58:50 : 06/06  1.6%
00:58:59 : 07/07  0.8%
00:59:14 : 08/08  0.4%
00:59:26 : 09/09  0.2%
00:59:42 : 10/10  0.1%
00:59:43 : Test finished.

 ----------
Total: 10/10 (0.1%)

The MBP's output fades into noise of a rather awkward type, the DAC1's is of lower volume and has also a more pleasing character.

The DAC1 sample is also still ABXable vs the original file, but how could it have been better than the MBP's ADC? So that was to be expected in the light of the MBP's DAC results.


*One curious thing I have noticed: The DAC1 record comes out with inverted phase. This can either mean that both the MBP's DAC and ADC invert phase or they work correctly and my DAC1 is inverting. For the sake of this ABX test the phase could be corrected/inverted easily with Audition, but I'll open another [a href=\'index.php?showtopic=73999\']thread[/a] to follow up on this.

(Not a) good explanation of jitter in TAS

Reply #174
  • Set Mac OS X's audio parameters to output 44.1 kHz/24 bit, input 96 kHz/24 bit.
AFAIK OSX can't serve two different sample rates at the same time without applying SRC somewhere in the path. Since your rec_mbp_24.wav sample shows some >23kHz components I get the impression that the MBP DAC output wasn't properly low pass (anti-image) filtered.
May I suggest that you redo the test:
-either completely at 24/44.1 or
-at 24/96 by (carefully) converting the test sample to 96kHz first.