80 kbps LC AAC listening test, Are PNS and IS useful at 80 kbps? |
  |
80 kbps LC AAC listening test, Are PNS and IS useful at 80 kbps? |
 Jan 8 2007, 14:27
Post
#26
|
|
 Group: Developer Posts: 398 Joined: 14-October 01 Member No.: 289  |
QUOTE (SirChristof @ Jan 8 2007, 14:07)  Doing very many ABX tests between them (assuming you hear a difference), better allows you to "rate" them. Without such attention to detail, the test becomes less meaningfull, at least in my opinion. ... If I did not do many ABX tests to first prepare myself to get accustomed to what I should be hearing, I could simply say 5/5 and move on. When people don't give a full effort, and just listen a couple times then determine "It is transparent", that severely waters down the results from people like me who actually did everything in their power to not only hear the difference, but rate it as honestly as they can. Your metodology for participating in listening test is meaningful and it would be really nice to have some test with people that are doing just like you described. But how many people would do that? IMO not many even if you pay them. In public listening test many people don't give as much effort as you. But this does not "water down" your results. Public listening test produce average scores (that is average scores among people interested in doing test which should extrapolate to whole population that listens music). Most people don't hear differences without full effort, but their grades also count. Also have in mind that in another time in another place in different circuimstances, you wouldn't give exactly the same grades  People are just not accurate enough.In short: if you are deciding between 4.6 or 4.7, just give any of those. |
 |
 
|
|
Jan 15 2007, 13:32
Post
#27
|
|
 Nero MPEG4 developer Group: Developer (Donating) Posts: 1218 Joined: 11-October 01 From: LA Member No.: 267 |
Again thanks to all who have participated. Unfortunately we still don't have enough results at the moment. We will let the test run a little longer, until 29th of january for now.
Without your help it is not possible to determine if we should enable PNS and/or IS or not. This post has been edited by menno: Jan 15 2007, 13:33 |
|
|
|
|
Jan 16 2007, 11:46
Post
#28
|
|
|
Group: Members Posts: 37 Joined: 10-October 06 Member No.: 36183 |
Why not just user can decide this?
|
|
|
|
|
Jan 16 2007, 12:21
Post
#29
|
|
|
Nero MPEG4 developer Group: Developer Posts: 1466 Joined: 22-September 01 Member No.: 8 |
Because we want to avoid flood of suboptimal encodings (e.g. 192 kbps, PNS and IS ON)
 If we put PNS and IS in the encoder, they will either be off by default, or there will be a switch to easily disable them because one very widespread portable player (Apple iPod) appears not to support them well. |
|
|
|
|
Jan 16 2007, 17:13
Post
#30
|
|
 Group: Members Posts: 216 Joined: 9-December 02 From: Croatia Member No.: 4037 |
QUOTE (Ivan Dimkovic @ Jan 16 2007, 12:21) ...because one very widespread portable player (Apple iPod) appears not to support them well. This is so hard to believe... Can't they (Apple) just fix this and issue a firmware update... |
|
|
|
|
Jan 16 2007, 22:50
Post
#31
|
|
|
Group: Members Posts: 1315 Joined: 3-January 05 From: Argentina, Bs As Member No.: 18803 |
QUOTE (dand @ Jan 16 2007, 08:13) QUOTE (Ivan Dimkovic @ Jan 16 2007, 12:21) ...because one very widespread portable player (Apple iPod) appears not to support them well. This is so hard to believe... Can't they (Apple) just fix this and issue a firmware update... Considering that Apple always goes to very easy and low complexity codecs like ASP without Qpel, GMC, trellis and H.264 only up to not full Main Profile it's not surprise if they doesn't support IS and PNS. Don't talk about SBR. This post has been edited by IgorC: Jan 16 2007, 22:54 |
|
|
|
|
Jan 16 2007, 23:34
Post
#32
|
|
 Server Admin Group: Admin Posts: 4808 Joined: 24-September 01 Member No.: 13 |
QUOTE (IgorC @ Jan 16 2007, 22:50) QUOTE (dand @ Jan 16 2007, 08:13) QUOTE (Ivan Dimkovic @ Jan 16 2007, 12:21) ...because one very widespread portable player (Apple iPod) appears not to support them well. This is so hard to believe... Can't they (Apple) just fix this and issue a firmware update... Considering that Apple always goes to very easy and low complexity codecs like ASP without Qpel, GMC, trellis and H.264 only up to not full Main Profile it's not surprise if they doesn't support IS and PNS. Don't talk about SBR. Well, this is different. An AAC codec without IS is just broken, period. And you can't call it "MP4" without PNS, either. This isn't about some optional extensions, those tools are REQUIRED even in the low-complexity profile. |
|
|
|
|
Jan 17 2007, 13:54
Post
#33
|
|
|
Group: Members Posts: 216 Joined: 9-December 02 From: Croatia Member No.: 4037 |
QUOTE (Garf @ Jan 16 2007, 23:34) QUOTE (IgorC @ Jan 16 2007, 22:50) QUOTE (dand @ Jan 16 2007, 08:13) QUOTE (Ivan Dimkovic @ Jan 16 2007, 12:21) ...because one very widespread portable player (Apple iPod) appears not to support them well. This is so hard to believe... Can't they (Apple) just fix this and issue a firmware update... Considering that Apple always goes to very easy and low complexity codecs like ASP without Qpel, GMC, trellis and H.264 only up to not full Main Profile it's not surprise if they doesn't support IS and PNS. Don't talk about SBR. Well, this is different. An AAC codec without IS is just broken, period. And you can't call it "MP4" without PNS, either. This isn't about some optional extensions, those tools are REQUIRED even in the low-complexity profile. We should be looking at encoder and decoder separately here. Not supporting a feature in ENcoder is completely different than doing the same in DEcoder (i.e. failing to build a standard-conformant DEcoder). |
|
|
|
|
Jan 17 2007, 18:08
Post
#34
|
|
|
Server Admin Group: Admin Posts: 4808 Joined: 24-September 01 Member No.: 13 |
QUOTE (dand @ Jan 17 2007, 13:54) QUOTE (Garf @ Jan 16 2007, 23:34) Well, this is different. An AAC codec without IS is just broken, period. And you can't call it "MP4" without PNS, either. This isn't about some optional extensions, those tools are REQUIRED even in the low-complexity profile. We should be looking at encoder and decoder separately here. Not supporting a feature in ENcoder is completely different than doing the same in DEcoder (i.e. failing to build a standard-conformant DEcoder). IS and PNS (in MPEG-4) are REQUIRED in the DEcoder. The iPod is not a standard-conformant decoder. |
|
|
|
|
Jan 17 2007, 18:45
Post
#35
|
|
|
Nero MPEG4 developer Group: Developer (Donating) Posts: 1218 Joined: 11-October 01 From: LA Member No.: 267 |
I think IS does work, just the PNS gave troubles
|
|
|
|
|
Jan 25 2007, 16:04
Post
#36
|
|
|
Nero MPEG4 developer Group: Developer (Donating) Posts: 1218 Joined: 11-October 01 From: LA Member No.: 267 |
It would be great if we could get some more results for samples 4,5,7,9,10,11 and 13
|
|
|
|
|
Jan 28 2007, 23:20
Post
#37
|
|
 Group: Members Posts: 105 Joined: 18-December 06 Member No.: 38800 |
I should have read that last post before testing tonight.
This post has been edited by sketchy_c: Jan 28 2007, 23:20 |
|
|
|
|
Jan 29 2007, 19:38
Post
#38
|
|
|
Nero MPEG4 developer Group: Developer (Donating) Posts: 1218 Joined: 11-October 01 From: LA Member No.: 267 |
Since we still don't have enough results, we will simply let the test run until we do have enough (we do need an answer). I will let you know when we have enough results and from that moment people who are still doing the test will get a week to finish it.
Thanks again to everyone who already participated. |
|
|
|
|
Jan 31 2007, 01:25
Post
#39
|
|
 Group: Members Posts: 484 Joined: 8-January 06 From: Earth Member No.: 26978 |
Cool.. now I just have to stop forgetting this test is going on
-------------------- Vorbis-q0-lowpass99
lame3.93.1-q5-V9-k-nspsytune |
|
|
|
|
Feb 1 2007, 08:42
Post
#40
|
|
|
Nero MPEG4 developer Group: Developer (Donating) Posts: 1218 Joined: 11-October 01 From: LA Member No.: 267 |
QUOTE (gameplaya15143 @ Jan 31 2007, 01:25) Cool.. now I just have to stop forgetting this test is going on bump
|
|
|
|
|
Feb 6 2007, 19:41
Post
#41
|
|
|
Group: Members Posts: 1315 Joined: 3-January 05 From: Argentina, Bs As Member No.: 18803 |
German speech sample N5 was very low scored in 48 kbps test. While in this test it's transparent for me almost for all encode modes. Of course, 80 is a higer bitrate but, for example, LAME -V5 and Vorbis at 80 also have some problems with this sample.
Good work. This post has been edited by IgorC: Feb 6 2007, 19:43 |
|
|
|
|
Feb 9 2007, 02:38
Post
#42
|
|
|
Group: Members Posts: 484 Joined: 8-January 06 From: Earth Member No.: 26978 |
I got through samples 14-8 before I started to lose my mind
 (yes I'm going backwards)I think I started hearing things that weren't even there  time for a little break.
-------------------- Vorbis-q0-lowpass99
lame3.93.1-q5-V9-k-nspsytune |
|
|
|
|
Feb 9 2007, 03:06
Post
#43
|
|
|
Group: Members Posts: 94 Joined: 4-June 06 From: Ponta Grossa,PR Member No.: 31450 |
I'm save my results in .erf but don't save them in .abc now I can't open them [the .erf] how can I open these .erf?
-------------------- Sorry for my bad english.
|
|
|
|
|
Feb 9 2007, 03:12
Post
#44
|
|
|
Group: Members Posts: 830 Joined: 3-November 05 Member No.: 25526 |
You can't open them. THey're encrypted result files that you need to send to menno.
|
|
|
|
|
Feb 9 2007, 12:53
Post
#45
|
|
|
Group: Members Posts: 94 Joined: 4-June 06 From: Ponta Grossa,PR Member No.: 31450 |
QUOTE (Firon @ Feb 9 2007, 00:12) You can't open them. THey're encrypted result files that you need to send to menno. Thanks, indeed I Know about this the problem that's I don't save the sessions (I save but delete without want but made this)... -------------------- Sorry for my bad english.
|
|
|
|
|
Feb 13 2007, 13:17
Post
#46
|
|
|
Group: Members Posts: 105 Joined: 18-December 06 Member No.: 38800 |
Menno, is this still ongoing? Not sure if the 1.0.7.0 release was dependent on these results.
|
|
|
|
|
Feb 13 2007, 15:50
Post
#47
|
|
|
Nero MPEG4 developer Group: Developer (Donating) Posts: 1218 Joined: 11-October 01 From: LA Member No.: 267 |
Yes, test is still going on. We are very thankful for everyone submitting their test results. The results of this test will be used for our next release.
|
|
|
|
|
Mar 4 2007, 01:54
Post
#48
|
|
 Group: Members Posts: 69 Joined: 12-January 02 Member No.: 996 |
Currently working my way through the samples. Completed 4 samples so far.
-------------------- http://www.assortmentstoday.com
|
|
|
|
|
Mar 4 2007, 15:31
Post
#49
|
|
|
Group: Members Posts: 94 Joined: 4-June 06 From: Ponta Grossa,PR Member No.: 31450 |
Is the test now ended or still running?
-------------------- Sorry for my bad english.
|
|
|
|
|
Mar 4 2007, 20:01
Post
#50
|
|
|
Group: Members Posts: 69 Joined: 12-January 02 Member No.: 996 |
QUOTE (Diow @ Mar 4 2007, 07:31) Is the test now ended or still running? My understanding is that it is open until enough people submit their results. -------------------- http://www.assortmentstoday.com
|
|
|
|
|
|
Lo-Fi Version | Time is now: 23rd May 2013 - 16:58 |
