If possible I would recommend staying overnight, especially if you stay at the bassin louise as you'll have the chance to experience the image mill. Every night at 9:30, for the 400th aniversary of Quebec City there is a megaprojection on the history of the city. It is on the grain silos in the port. 600 metres long by 30 metres high, pretty impressive. Here's a pic
Yup, they did suggest going counter clockwise. Your explanation makes much sense.