LEDs suffer from thermal runaway issues so you need the big heatsinks to stop them from going bang.

The design of most downlights means that the heatsink is even bigger because the downlights are designed for halogens or regular bulbs which can tolerate the higher temperatures from lack of convection.