the office he held

To be dominant over other.
To have a power that sets you higher.

the clothes was wonderful quality that became invisible to any one who was unfit for the office he held, or was incorrigibly stupid.