When there's no seats in the classroom left so you just stand outside.
Billy: "where'd he go?"
Jimmy :"he's pulling a johnny"
Billy :"oh ok"
The act of Pulling a Johnny is to play something safe.
"There are a dozen guards there. Which is why we're playing this safe instead of pulling a johnny."