A young, badly-behaved, and inexperienced hoodlum. Also a petty criminal. The "two-bit" prefix denotes a cheap worthlessness.
Hey! That two bit punk just swiped the hubcaps off my Olds 98!