be down on one's luck

• be unfortunate, be unsuccessful, be unlucky, be in a wretched state