A mark of shit left behind in your underwear from either not wiping or not wiping properly with a wet wipe. To call someone a shit smudge is very derogatory.
That guy at the bar all drunk and picking fights with everyone is a real shit smudge.