IWillTry.org Super insulate your hot water tank
If this heater weren't already converted to electric, you'd need to leave both the top and bottom open to airflow. However, he did finish the job with insulation right up to the top of the plywood box.
Remember, anything worth insulating is worth superinsulating.