got on his nerves

• irritated him, exasperated him, annoyed him