draw apart

• be distant from (a person)