This is a phrase used to give self assurance and confidence. It actually means "I know"
You and I both know that Cindy doesn't sleep around.
You and I both know the builders will be finished next week.
The check is in the post- you and I both know that