If you could get a really snug cover over the ladder, it'll clean up the airflow around it and keep the air from trying to go through it. Just be sure it'd be tight enough not to flap around too much. A deflector in front would only delay the inevitable: air hitting all those rungs causing a majority of the drag.
__________________
|