Software :: Xmms - Volume Starts Very Loud?

I am using xmms to play mp3 files from machine. Whenever I play a file, the first second or two of the file start very loud and then goes down to a steady volume. I am using alsamixer as the volume controller with software volume control (although switching to wave doesn't make any difference).

My sound card is Soundblaster Audigy 4. I had the same card on my old system and I can't remember it doing it on that so I am assuming it's a software issue... Audacious works fine but I prefer xmms as the equalizer refuses to "stick" to the main window in audacious!!