listening tests help, for an audio codec I developed |
listening tests help, for an audio codec I developed |
 Jun 18 2005, 19:51
Post
#1
|
|
 Group: Members Posts: 175 Joined: 5-March 05 From: Morelia, Mexico Member No.: 20386  |
How can I rate how good or bad will the audio codec be on average?
I'm thinking on doing at least 21 ABX trials on each file and if the subject managed to tell a difference and the guess probability is low I'd also take into account a 1-5 point scale to measure the perceived quality. So far I have analized one subject, he did pretty well on most tests, except one, where the results where these: 15 out of 29, pval = 0.500 AFAIK, p<0.05 is good to be certain that he didn't know by chance, what about the rest? How do I interpret that?, is the codec transparent for him at that test? What are the ranges of the guess probabilities and how should I interpret them? Thanks in advance. This post has been edited by Luis G: Jun 18 2005, 19:52 -------------------- Home page: http://lc.fie.umich.mx/~legg/indexen.php
|
 |
 
|
 |
|
Jun 20 2005, 02:22
Post
#2
|
|
 ABC/HR developer, ff123.net admin Group: Developer (Donating) Posts: 1396 Joined: 24-September 01 Member No.: 12 |
I would double the number of samples from 8 to 16.
ff123 |
|
|
|
legg listening tests help Jun 18 2005, 19:51
guruboolez You should read Pio2001's explanation: it... Jun 18 2005, 20:18 Digga QUOTE (Luis G @ Jun 18 2005, 07:51 PM)So far ... Jun 18 2005, 20:28
legg QUOTE (Digga @ Jun 18 2005, 01:28 PM)if you s... Jun 19 2005, 16:28 ff123 If it were me, I'd just choose a whole bunch o... Jun 19 2005, 17:34 guruboolez QUOTE (ff123 @ Jun 19 2005, 05:34 PM)If it we... Jun 19 2005, 18:55 ff123 For an experienced listener like you, I'd defi... Jun 19 2005, 19:27 guruboolez Good point
I have to be more specific. Are such t... Jun 19 2005, 19:39 ff123 Individual results will have increased uncertainty... Jun 19 2005, 19:45 guruboolez That's encouraging. A listening test involving... Jun 19 2005, 20:06 legg ff123, currently I'm using 8 samples: castanet... Jun 20 2005, 01:52 legg QUOTE (ff123 @ Jun 19 2005, 07:22 PM)I would ... Jun 20 2005, 03:49 ff123 Heheheh. Yes, if you can. Good luck.
ff123 Jun 20 2005, 05:53 |
|
Lo-Fi Version | Time is now: 25th May 2013 - 11:52 |
