I'd tell my line manager, just say it's affecting your productivity!

Or even better, start doing something even more annoying in response, that'll piss him off.