It means that you agree with someone.
When you agree with someone, put your church fan up! Very similar to when you're in church and the pastor says something profound, all you can do is...put your church fan up.