Plans to build houses on land 'gifted for community centre'