husband-like person

A man (or woman) filling all the responsibilities of a spouse, but to whom you are not married.

Barry is the best husband-like person I have encountered in my life.