Most manual drivers will clutch start the engine, unless they're coasting up to a long stop (red light, train tracks, whatever).
Yes, there will be more wear. Any time you engage the clutch, there's wear. Also, you're straining the drivetrain components in the "other" direction.
Enough wear to be an issue? Depends on the vehicle and the skill of the driver, I suppose. Many have been doing this for years with no adverse effects.
See this thread for more discussion:
http://ecomodder.com/forum/showthrea...gine-1141.html