Photo: PJ Lobster House Facebook Page. Plans uptown in Port Jefferson Village are moving along, with redevelopment of the rundown buildings in the area known as Upper Port into multi-use buildings, a combination of apartments and retail, taking a page from the playbook that helped revitalize Patchogue. While most of the redevelopment targets vacant storefronts, nearby Mather Hospital on North Country Road right where Main Street steeply dips downtown, is PJ Lobster House, which has served the area for decades as a restaurant and fish market. The building is on a parcel of land slated for development in the master plan that will one day make Upper Port into a walkable, transit oriented region.