I will probably pick up at least one radiator type heater to have something and then focus on sealing up leaky drafts in the ceiling/attic and foundation/frame interfaces, along with aluminum tape on the highly accessible ductwork in my basement.
The A/C heatpump tinkering can then be looked into.
Another idea in my head is humidifying the house so it will
feel warmer at lower temperatures.