To take off your middle class jacket is to do something that would not be regarded as traditionally socially acceptable in middle class society.
I'm going to take off my middle class jacket and play with those African Kids