When reducing the bitrate, the server must transcode the file.
It may not be able to keep ahead of the receiver.
If the server is busy or under powered, reducing the bitrate may cause the glitches.