It was a sort of wholesale produce district before that, and it was a shipping district before that,” Berman said. In the early 1800s, Fort Gansevoort stood there.