Hmm... I'll look into this, but I definitely disabled debugging. Here's the command line I used to compile MAD:

./configure --host=arm-linux --enable-speed --enable-fpm=arm --disable-debugging

If I remember correctly, MAD wouldn't even play songs without skipping if debugging was turned on.