Removing them would definitely make things easier. You could probably use some coroplast and make a couple inserts that are held in place with some clear packaging tape, which would make them easy to remove if you wanted to put the hooks back on for use.
__________________
|