You can do this passively with RCA Y-jacks (example link). Every time you do that, you drop the audio levels and add some noise, but you can kinda compensate for that by turning up the volume on the TV.

One step up would be to get some sort of distribution amplifier (example link). Of course, you can spend more money on fancier distribution amps.