Something definitely isn't right. The regulator should put out 5V, and it should be getting 5V from the USB port. Make sure the voltage at the USB port is 5V, maybe even try using a different port.
Make sure the regulator is oriented properly, it's easy to install it backwards. And, make sure the Zener diodes are oriented properly, as well as the capacitors.
__________________
|