know the score

The ability to clearly understand a situation, usually due to wisdom gained from personal experience.

The contractor estimated it will take two days to finish the job. But I know the score. It will actually take two weeks.