IPB

Welcome Guest ( Log In | Register )

 
Reply to this topicStart new topic
ABX Result Calculation : Suggestion
kotrtim
post Nov 24 2004, 07:35
Post #1





Group: Members
Posts: 657
Joined: 4-December 02
Member No.: 3989



Is this way of calculation any good?

this is my suggestion: (to test codec's transparency)

at high bitrate such as 192kbps and above, its pretty hard to rate it!
so why not just use A , B & X test (which is available in foobar2000)

Formula = no. of wrong trials divided by no. right trials

Fix the trial to 10

if the result is 9/10, that means 1/9=0.11111, the codec is NOT transparent

if the result is 10/10, 0/10=0, the codec transparent probability is 0

if the result is 5/10, 5/5=1, the codec is transparent

if the result is 1/10, 9/1=9, the codec is NO DOUBT transparent

If the result is 0/10 (which is impossible), 10/0=......No DOUBT transparent biggrin.gif

..............

This post has been edited by kotrtim: Nov 24 2004, 10:53
Go to the top of the page
+Quote Post
guruboolez
post Nov 25 2004, 09:15
Post #2





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



QUOTE (kotrtim @ Nov 24 2004, 07:35 AM)
(...)
if the result is 5/10, 5/5=1, the codec is transparent
(...)
*

Did you ever run any ABX program?

http://ff123.net/abx/abx.html
An encoded file is for sure transparent if pval < 0.05 (even below if ABX test is not sequential).
5/10 => pval = 0.624
In other word, 62% of chance that the tester is guessing.
Go to the top of the page
+Quote Post
kotrtim
post Nov 25 2004, 11:04
Post #3





Group: Members
Posts: 657
Joined: 4-December 02
Member No.: 3989



QUOTE (guruboolez @ Nov 25 2004, 12:15 AM)
An encoded file is for sure transparent if pval < 0.05 (even below if ABX test is not sequential).
5/10 => pval = 0.624
In other word, 62% of chance that the tester is guessing.
*


oops...thanks guru, I've used ABX in foobar2000, but I don't really understand the pval=XX% biggrin.gif

This post has been edited by kotrtim: Nov 25 2004, 11:05
Go to the top of the page
+Quote Post
guruboolez
post Nov 25 2004, 11:13
Post #4





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



Another precision:
0/10 doesn't mean transparency, but total failure. 9/10 is a pretty good result - not the opposite wink.gif
Go to the top of the page
+Quote Post

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 16th April 2014 - 18:02