My understanding is that your taxes are not due until April 15th.
Giving your money to the government for them to hold until that day is your choice- and a poor investment.
You don't owe them interest... not until after tax day.

At least, that's my understanding of it.
Complexities abound and I'm not standing hard behind what I've said here, but years ago it was perfectly normal to claim a high number of dependents in order that your earnings went into your pocket until tax day.
Some people don't like to do that because they think getting a refund is a good thing. I tend to think it's a no-interest loan that you just gave the government.

That's my $0.02...