Yep you can just yank them off. When you take then off the doors will drain water much faster. All that debris is what promotes must later on.
If you ford water alot then you can leave them in place as they would slow the flow of water it to the door.