Richmond is a place between the two that has lots of nice bars and restaurants (expensive though) not far from Kew Gardens either, and there's a riverbus pier.

Although Red Hill -> Richmond by public transport probably isn't that easy.

I think the trains from Red Hill come into London Bridge, plenty of nice places to eat and drink between Fulham and London Bridge.