Move the gorilla

A term to describe a restaurant, bar, or other location which was once great, but has since declined in quality.

This bar used to be so cool... they really moved the gorilla.

Or

I hear this restaurant is going to change ownership. I hope the new owner doesn't move the gorilla.