QUOTE(D.Sync @ May 8 2008, 01:28)

Anyways, if I wanted to synchronized my entire music library to my iPod Classic, would I need to apply track/album replaygain data to every songs I got which I already replay-gained?
Yes. iPods are not replayGain-enabled players.
Programs (like foobar2000 and winamp) and digital audio players that are ""replayGain enabled" are able to read the gain stored in a metadata tag and then playback the file at the adjusted level. However, programs and DAPs that are not "replayGain-enabled" cannot do this. Therefore, the work-around is to use the replayGain numbers (that you've already calculated) to adjust the actual gain data stored in the mp3 file data. This is what foobar's
apply track/album replaygain to MP3 data command does.
QUOTE(D.Sync @ May 8 2008, 01:28)

Before that, would my iPod be able to playback those song with normalized volume after I transfer those

replaygain applied songs?
Conceptually, replayGain isn't exactly normalization.
http://replaygain.hydrogenaudio.org/index.htmlQUOTE(D.Sync @ May 8 2008, 01:28)

Btw, I still couldn't figure out what's the difference between track and album replaygain. It sounds no different to me whatsoever.
If you want an easy example, download
the new Nine Inch Nails album (yes it's free).

If you can't hear the difference between the modes with the
lights in the sky track, somethings wrong with you.
If you don't get the actual concepts, read
this.
What it calls "Radio", foobar2000 calls "track".
What it calls "audiophile", foobar2000 calls "album".
QUOTE(D.Sync @ May 8 2008, 01:28)

I choose the option 'Scan Selection as Albums (by tags)' by right clicking on the 'All Music' instead of one album after another. Did I choose the right choice?

Yes, if your files are tagged correctly.