رغم انف

In spite of the fact that

Against his will
In spite of him