It’s when you lack all other kinds of smarts, such as book and street smarts, but can tell when someone is acting silly and/or like an idiot
I used silly smarts to make fun of Truman’s jellyfish costume in the musical