Neil I think you're right, I've seen the illustrations showing the vortexes.I think when I roll the window down some it creates a low pressure area in the cabin and kills the vortex.
Here's a link showing the tufts I have on my car now.
Tuft testing - Picture