My usual defense is to smile and wave at them like I know them. It's pretty funny actually I think some people will think "Holy crap, do I know that guy" and get a dumb, embarassed look on their face!
For the rest of the day they will be trying to figure out how they know me going thru store clerks and their childrens teachers in their head.
Brian