Sounds like you have the cold start engaged. Look for something like this on the injector pump. You want the lever pushed all the way away from the cable meaning this would be in the of or normal position.
If you are into exhaust work, yes it will sound sweet with a glass pack on it. No it should not have a cat, only the newer diesels have that.