'Detrimental' plans for houses near Grade II-Listed pub reje