It's a term that refers to when you are super hungover, snaking out from DTs, stuck in a town or place you don't want to be, feeling sorry for yourself, regretting all the shit you did to get to this place after a bender.
Baby, I'm sorry, I shouldn't have taken off on you, I'm sick and sorry and just want to be home with you.
Don't baby me, sounds like you have bender regrets.