I use a 2" wide strip of Velcro to hold the spoiler on my racecar. It takes quite a bit to get it off. But the spoiler is constantly being pushed into the bumper. Only time it came off was a backwards excursion through the grass, pulled it right off.
Maybe some fasteners up on the roof where you won't see them? And Velcro down the back?