The Casualty visual uses the RMS value of the left and right channels combined together to determine the amount of displacement. The scaling is carefully chosen so that the maximum possible RMS values will cause a displacement to the top of the screen.

If you are experiencing very low displacement on all your music you should check that it has been normalised.