Well, as long as he is eating and drinking, I would just keep an eye on him. Would this have been your first clutch? Males and females both sit on eggs. They take turns. It sounds as if he just in the nesting mode. Any time there is a bad egg, it’s best to remove it and that’s what he did. Don’t forget to keep the nest box clean. Good luck!