Can I remove notifications for all-day events?

Yes, you can. From the details screen of the all-day event, select the reminder. Swipe left on the reminder you want to delete, and a delete button will appear. Remove all the reminders you wish to delete and press save to remove the notifications.