The expense of CF is one thing, but the safety is another. Carbon fiber in the passenger compartment can become lethal in a crash. During a crash it turns into sharp strong shards capable of ripping a person apart.
That being said, I like the idea of CF for fenders, hoods, trunk lids, and the entire trunk if it's not a part of the passenger compartment.