It's a common, proven method for improving efficiency. It's especially helpful if you tend to drive short distances.
You probably don't need to plug in overnight though - a couple of hours, max., is all you need.
My car has 2 heaters - one inline coolant heater, one external contact heater - and I use them both. At the same time. And not just in the winter.