At least in the US, well made fudge comes out smooth because of the use of a little corn syrup in addition to the regular sugar. But it seems like you ought to be able to use invert syrup, too, as it's the glucose that keeps the sucrose from crystallizing as easily.