A fair weather fisherman is an angler who only goes fishing when the weather is good or sunny. He never goes fishing when the conditions are uncomfortable. It is considered an insult.
Bob "I'm not going fishing today it's too cold." Jeff "Come on you fair weather fisherman."