kick oneself

be annoyed with oneself for doing something foolish or missing an opportunity.