come down in the world

To lose a place of respect or honor, become lower (as in rank or fortune).
The stranger plainly had come down a long way in the world.
Categories: world {v. phr.}