gnawed at him

• bothered him, was on his mind, tormented him, ate at him