thorn in his side

• constant irritant, something which is very bothersome and cannot be avoided or escaped