Significant Over

A non-gender specific reference to to an ex-lover who was not a spouse.

"Yeah, Taylor was my significant other about five years ago, but now he's my significant over."