A conservative pastor is trying to unseat a gay library boar