On Shelter Island, a rare waterfront home owned by the same family for generations lists for $5.45M

At 20 Prospect Ave., the property also has a history of Methodist pilgrims who traveled from the city to worship at a nearby church.