I have been using EAC to make ogg files, when I discovered that they were all "corrupted" (bastardized would probably be more acurate). The ogg files had ID3 tags prepended by EAC.
As it happened, both of the programs that I was using to play the ogg files (a CVS snapshot of CoolPlayer and QCD 3) were originally MP3 players, and so they happily read the ID3 tags and passed along the actual ogg file to the decoder.
Windows media player with the DirectShow plugin won't play those files, because it apparently isn't looking for the ID3 tag.

I have to wonder how many other people have been doing the same thing as I have: using tools originally designed for MP3s that add and read the ID3 tags transparently?

On a related note, where can I get a player (Windows, GUI) that correctly reads the native ogg comments?

cool... here are your answers.

You have probably got ID3 tags because under Compression Options in EAC, under the External Compressor tab, you have Add ID3 tag selected, or under the ID3 tab in the same dialog, you have it set to write ID3 or ID3V2 tags.

Turn them both off.

As for native windows software for vorbis tags: you could check out Vorbis Extension (http://members.ozemail.com.au/~spitsw/VorbisExt/history.html). It isn't a player, but it is pretty cool.
Winamp with the vorbis plugin (from http://www.blorp.com/~peter/) handles vorbis comments.
Also, MediaJukebox (http://www.mediajukebox.com) can handle and mass-tag vorbis files, though it is somewhat unreliable, especially with more recently encoded vorbis files.

Oh, and for proper encoding and tagging of vorbis files from EAC, I use the oggenc.exe as an external compressor with the following additional command line options:

-q 5 -t "%t" -a "%a" -l "%g" -N "%n" -c "DESCRIPTION=ripped with eac 0.9 beta 1, encoded with oggenc 1.0 rc3" -d "%y" -o %d %s

let me know if you need further info...
gnoshi