Keep them on their toes

Keep them on their toes is a phrase referring to keeping someone alert or active.

Boss: "Stop annoying staff"
Me: "I gotta keep them on their toes"