Castle Clinton National Monument
A round 1811 sandstone fort in Battery Park that once defended the harbor and later served as an immigration station and aquarium. Today kids can explore its walls and small exhibits, and it's where Statue of Liberty ferry tickets are sold.