I am concerned about that too. I am thinking of using 1x2s for the velcro which will then be attached to the panels. I am hoping the bottoms resting on the shelf will give it strength in compression and the crossbars will give it strength in tension. The corner attachments should give it monolithic rigidity.
__________________
|