I've slept in my bivy or less dozens of times. One trip up Jefferson I brought the bivy and no sleeping bag. On one rainy camping trip I got fed up with the group messing around with tarps and slept in the downpour in my rain jacket and rain pants.
Surviving the elements is easy so long as those elements are anticipated.
