Help - Search - Members - Calendar
Full Version: Real vs Apple AAC samples
Hydrogenaudio Forums > Hydrogenaudio Forum > Uploads
guruboolez
blackwater sample

CODE
foo_abx v1.2 report
foobar2000 v0.8.3
2004/08/01 18:59:01

File A: file://C:\temp\Pomme vs Réel\Blackwater_Apple.m4a
File B: file://C:\temp\Pomme vs Réel\Blackwater_Real.m4a

18:59:05 : Test started.
19:00:06 : 01/01  50.0%
19:00:15 : 02/02  25.0%
19:00:24 : 03/03  12.5%
19:00:31 : 04/04  6.3%
19:00:41 : 05/05  3.1%
19:00:51 : 06/06  1.6%
19:00:59 : 07/07  0.8%
19:01:10 : 08/08  0.4%
19:01:20 : 09/09  0.2%
19:01:28 : 10/10  0.1%
19:01:35 : 11/11  0.0%
19:01:43 : 12/12  0.0%
19:01:56 : 13/13  0.0%
19:02:01 : 14/14  0.0%
19:02:10 : 15/15  0.0%
19:02:14 : 16/16  0.0%
19:02:15 : Test finished.

----------
Total: 16/16 (0.0%)


The lowpass betrayed Apple encoding (audible on cymbals, more pleasant and sharp with Real encoder). The first part of the sample was OK for me with both encoders. Therefore, both encoding are good in my opinion (and my listening system, based on AC'97 and poor line-out).


waiting sample

CODE
foo_abx v1.2 report
foobar2000 v0.8.3
2004/08/01 19:02:34

File A: file://C:\temp\Pomme vs Réel\Waiting_Apple.m4a
File B: file://C:\temp\Pomme vs Réel\Waiting_Real.m4a

19:02:38 : Test started.
19:02:52 : 01/01  50.0%
19:02:56 : 02/02  25.0%
19:03:00 : 03/03  12.5%
19:03:05 : 04/04  6.3%
19:03:10 : 05/05  3.1%
19:03:19 : 06/06  1.6%
19:03:28 : 07/07  0.8%
19:03:43 : 08/08  0.4%
19:03:48 : 09/09  0.2%
19:03:56 : 10/10  0.1%
19:04:04 : 11/11  0.0%
19:04:08 : 12/12  0.0%
19:04:16 : 13/13  0.0%
19:04:23 : 14/14  0.0%
19:04:30 : 15/15  0.0%
19:04:35 : 16/16  0.0%
19:04:36 : Test finished.

----------
Total: 16/16 (0.0%)


Here, the quality difference is really consequent. Apple AAC@128 is seriously distorted, whereas Real AAC@192 is really less annoying.
Cygnus X1
Results for Waiting, Apple vs Real:

Sample A: waiting apple.wav
Sample B: waiting real.wav

1 of 1, p = 0.5
2 of 2, p = 0.25
3 of 3, p = 0.125
4 of 4, p = 0.062
5 of 5, p = 0.031
6 of 6, p = 0.015
6 of 7, p = 0.062
7 of 8, p = 0.035
8 of 9, p = 0.019
9 of 10, p = 0.01
10 of 11, p = 0.0050
11 of 12, p = 0.0030
12 of 13, p = 0.0010
13 of 14, p = <0.001
14 of 15, p = <0.001
15 of 16, p = <0.001
16 of 17, p = <0.001
17 of 18, p = <0.001
18 of 19, p = <0.001
19 of 20, p = <0.001

COMMENTS: I concentrated on the first 4 seconds of the sample, listening to the singer's voice. Apple's encoder seems to create a sort of metallic or echoic lisp on the singer's higher notes ("I've been...."). Real does not have this effect. Also, the lowpass was noticeable here (though I'll admit that my >16Khz hearing isn't something to write home about, in my old age of 25 smile.gif )

Blackwater: I was not able to ABX the two, probably as a result of my poor HF hearing, though the significance was borderline at the .05 level (14/20, p=.057.)

A slightly OT comment is that actual songs I have purchased from iTunes have artifacts that are not found in encodings made "at home" with the same CD and settings. Perhaps that's another thing we need to consider...I can upload comparison samples if anybody is interested in what I mean.
echo
Thanks guruboolez and Cygnus X1 for taking the time to try them out. Seems like my results are backed up by yours.

Note to mods: maybe we should take these comments to where the rest of the conversation is? (http://www.hydrogenaudio.org/forums/index.php?showtopic=24568&st=25)
Garf
PS. In the AAC test Real did as good as iTunes on waiting. So the result here (with more bits Real is better) should not be surprising.
karl_lillevold
thanks to echo for encoding the samples and the comparison, and to guruboolez and Cygnus X1 for taking the time. These are useful results and samples to have.
guruboolez
One problem is: are we sure that the encoders we've tested are the same than the ones used for each stores? I never heard or analysed any Real AAC purchased file, but the only AAC@128 from iTunes Music Store I had was totaly different from all QuickTime AAC@128 encoders ever released (full frequencies up to 16000 Hz, and from 16 to 20 Khz, additional informations but at low energy).

In my opinion, comparing ATRAC/AAC encoders bundled with public software is not the good way to compare the sound quality of different on-line stores.
Cygnus X1
Guruboolez, my experience has been twofold in terms of encoders: many of the songs I bought from iTunes (which isn't many, actually smile.gif) sound much worse than the files I made afterwards once I purchased the actual CD. Of course, I don't normally rip things at 128kbps (I still use --aps), but I did so to compare the purchased file to the one I had ripped. In almost every case, a) iTunes purchased AAC file had ringing and flanging artifacts NOT found in my home-ripped versions, and b) most of the file exhibited a sharp 15-16Khz lowpass. Even with my HF hearing (not very sesnsitive above 16Khz, cutoff around 17.5), the lowpass is noticable on some songs. (Edit: I used QT 6.5 w/ iTunes 4.2 for comparisons).

However I recently bought a file that had content to 20Khz and sounded fine (no obvious flaws). Unfortunately, I accidentally deleted it somehow and can't remember what it was. So, I'm not sure what's going on with the different encoders, but suffice to say, my experience has been that iTunes music is inferior to the same rip done at home from a CD. In fact, with one of the albums (George Benson's greatest hits), the files sounded like they had been transcoded from 112kbps MusicMatch files! sick.gif
JohnV
QUOTE(guruboolez @ Aug 2 2004, 03:44 AM)
One problem is: are we sure that the encoders we've tested are the same than the ones used for each stores? I never heard or analysed any Real AAC purchased file, but the only AAC@128 from iTunes Music Store I had was totaly different from all QuickTime AAC@128 encoders ever released (full frequencies up to 16000 Hz, and from 16 to 20 Khz, additional informations but at low energy).

In my opinion, comparing ATRAC/AAC encoders bundled with public software is not the good way to compare the sound quality of different on-line stores.
*


Agree. 10 or more samples from the actual online stores should be tested, if we want to find out anything about the online stores qualities.
echo
Is there a chance that this difference in the iTunes store can only be attributed to different encoder versions? I guess Apple upgraded their encoders they use one the store together with the iTunes version and most people here seem to use the old iTunes 4.2 version of the encoder. Or maybe is it a totally different encoder? Although I don't understand why they would have two different versions of their encoder, one for their own use and one for the public. And I guess noone can rule out that the original source is not a CD but something else.

Maybe at least Karl can tell us about the encoder Real uses. Is it the exact same encoder found in Real player? And what about the original sources? Are they CDs or something else provided by the music labels?
robUx4
QUOTE(JohnV @ Aug 2 2004, 11:15 AM)
Agree. 10 or more samples from the actual online stores should be tested, if we want to find out anything about the online stores qualities.
*



This can't be done in a public test since you would need to break both DRM systems... Or maybe if you burn the fiels you bought and put them in FLAC then.
wkwai
I have implemented a AAC MP4 decoder able to decode Apple's m4a files.. I found out that ITune always uses Sin Window shape.. It doesn't switch to KB Window at all.. I think there is likely to be some aliasing problem with ITune.. which I can hear very well in some song samples..
eric.cheminot
echo, is it possible to get the original sample in order to evaluate (real Vs orig) Vs (apple Vs Orig)?

Don't know if the comparison between 2 ABX scores makes sens though.

-ec
echo
QUOTE(eric.cheminot @ Aug 5 2004, 12:54 AM)
echo, is it possible to get the original sample in order to evaluate (real Vs orig) Vs (apple Vs Orig)?

Don't know if the comparison between 2 ABX scores makes sens though.

-ec
*


As I said in my original post (in the other thread, the discussion seems to have moved here now) you can find it in ff123's page.

And about comparing ABX scores, no it doesn't make much sence... unless you are able to ABX codec A and not able to ABX the codec B. In this case I think you can safely say codec B is better than codec A.

edit for clarification: I mean ABXing original vs codec A and original vs codec B of course.
eric.cheminot
OK, thanks!

I'll try this.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2008 Invision Power Services, Inc.