The cleanest beach on the East Coast is just a state away