It is a way to tell someone to not worry about where you are going or what you are doing.
Person 1-- "Where you headed to?" Person 2--"Yo momma's house