My first go was 26 albums, so I have a little addendum:
Desert Island 10
- Sparta - Wiretap Scars
- Mars Volta - De-Loused in the Comatorium
- Bob Mould - Workbook
- Foo Fighters - The Colour and the Shape
- The Who - Live at Leeds
- Get-Up Kids - Something To Write Home About
- Husker Du - Zen Arcade
- Interpol - Turn On the Bright Lights
- Nirvana - In Utero
- Local H - No Fun EP & Sugar - Beaster (two EPs counts as one album, right?)
Bomb Shelter 20
- Wilco - Summerteeth
- U2 - Achtung Baby
- Ozma - Rock and Roll Part Three
- Peter Gabriel - I/Car
- Pink Floyd - Wish You Were Here
- Pixies - Doolittle
- Radiohead - The Bends
- Genesis - Duke
- Weezer - Weezer (Blue)
- Smashing Pumpkins - Siamese Dream
Awfully Small MP3 Player 25
- Pavement - Slanted and Enchanted
- Snapcase - Designs for Automotion
- Dust Brothers - Fight Club Soundtrack
- Dandy Warhols - Thirteen Tales from Urban Bohemia
- Husker Du - Candy Apple Grey
I'm sure if I spent more time I could swap categories some more, but I'm calling it quits.