The idiom ‘Don’t give up your day job’ is used in a humorous way to tell someone you do not think they are very good at something.
