Amber flag

An amber flag is a sign in a person that's not quite a red flag, but something that should still be taken into consideration.

Girl: Omg he didn't hold my hand when crossing the road, that was a major amber flag.