for the worse

If sth changes or happens for the worse, it becomes more unpleasant or difficult