QUOTE(kjoonlee @ May 29 2005, 01:13 PM)
You shouldn't ABX encodes against each other if you want to draw conclusions about encoding quality, IMHO.
From my own experience, comparing directly two encodings is a very important step if I really want to know if both encodings really sounds different.
ABC/HR step is generally not enough. It's easy to give two different notes to two different encodings, but if you must know if the difference really exists, the direct ABXing is necessary.
ABXing reference vs encoding is generally easier than ABXing encoding vs encoding. It's especially true when you try to compare encodings that are really close (ex: lame --standard vs lame -fast-standard).
You should also keep in mind that reference is still accessible if needed during the ABX comparison between two different encodings. At least with java ABC/HR.