Granddaddy is what you call your favourite old relative whether it be a man or a woman.
Bradley: Do you see that old lady over there? she's my granddaddy. Josh: Have you seen that old man over there? He's my Granddaddy too! Bradley: Awesome sauce!