Skip to main content ↑ ↓

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: ABX+ a layman (or noob)'s proposal (Read 4151 times) previous topic - next topic
0 Members and 1 Guest are viewing this topic.

ABX+ a layman (or noob)'s proposal

When I see someone post ABX results like:

orig vs sample1 -- 12/12
orig vs sample2 -- 12/12
sample1 vs sample2 -- 12/12

unless there is a comment on the results, you couldn't tell which sample was better or harder to ABX. If there is a program that records how much time it took to reach the sufficient -p value, you can tell how difficult it was to ABX each sample.

For example, if you try to ABX fatboy.wav vs fatboy-cbr-96.mp3 (an mp3 file encoded in CBR96), it is very easy, therefore very quick to ABX the two. It might only take 1 minute to reach p = 0.001, whereas if you are trying to compare a very easy-to-encode sample vs alt-preset insane, it will definitely take much more time if possible at all.

So the correlation I see is, the more time it takes to reach the target p value, the more difficult it is to ABX the difference.

So if orig vs sample1 took 2 minutes to reach p=0.005, and if orig vs sample2 took 15 minutes to reach p=0.005, sample2 would be the clear winner.

If someone could make a quick and dirty prog that does this, people could test it and see if my theory is any good...

edit: for clarify

ABX+ a layman (or noob)'s proposal

Reply #1 –
Aren't there some ABX tools that log each trial with time? (latest fb2k ABX component does IIRC). Besides this, my 2 cent:
- I think ppl who are ready to spend the time necessary for doing valid ABX tests and posting the results, should be able to write one extra line describing the differences they heard and what sounded better/worse. Asking for such information if missing shouldn't be a problem.
- The time spent doesn't tell much generally, because of
-- listening fatigue / training effect can cause additional differences
-- sometimes you take a break or (as I do) ABX two different tracks alternately at the same time to avoid fatigue and save time.
Let's suppose that rain washes out a picnic. Who is feeling negative? The rain? Or YOU? What's causing the negative feeling? The rain or your reaction? - Anthony De Mello

ABX+ a layman (or noob)'s proposal

Reply #3 –
WinABX also logs the times

ff123

ABX+ a layman (or noob)'s proposal

Reply #4 –
I have to agree with tigre here. Nor time nor wrong trials are necessarily index of difficulty. Others motivations are:
-Sometimes i try to abx artifacts more subtle than the most annoying one in the sample, just to be sure they exist.
- I can obtain better results flushing my memory and waiting a little time before listening the other sample, fast switching doesn't help me to concentrate.

@LoFiYo: if you're referring to my abx results, try listening with more attention. The artifacts with rebel.wav are really easy to hear for me. I don't think it's a matter of good/bad ears. My equipment is nothing special (SB128 soundcard and HD 497 headphones). Maybe could be a matter of training.
WavPack 4.3 -mfx5
LAME 3.97 -V5 --vbr-new --athaa-sensitivity 1
 

ABX+ a layman (or noob)'s proposal

Reply #5 –
I see. I almost exclusively use ABC/HR for ABX testing, so I was ignorant of other options... I also ignored the fatigue factor etc. Obviously I have much to learn.

[proxima]: your results and others on this forum only initially made me start thinking about this idea, and I am in no way trying to discredit your results. I respect your spending that much time for the test. If you are any way offended, I am sorry. I will try that sample again later. Maybe I can do better this time.

Thanks

ABX+ a layman (or noob)'s proposal

Reply #6 –
Quote
I am in no way trying to discredit your results. I respect your spending that much time for the test. If you are any way offended, I am sorry.

Offended.. ?? for what ??
Are you joking ??
Really no reasons to excuse.
WavPack 4.3 -mfx5
LAME 3.97 -V5 --vbr-new --athaa-sensitivity 1