Yes, it's a common misconception I think. While your average Maplins 3mm LED doesn't generate any noticeable heat, something like a Luxeon Rebel generates a fair amount, although I'd say the reason it needs a heatsink is just because there's so little surface area to dissipate the heat compared to, say, a normal lightbulb.