The town-gown relationship has long been fraught between Yale, one of the world’s most selective universities, where white students make up the largest demographic, and New Haven, which has long struggled with crime and poverty, and is majority Black and Hispanic.