So this cold weather prompted me to resolve something that's been in my mind for a while.
NYC's underground water piping system seems pretty resilient against freezing weather. It is because by the city code, the pipes must be at least 3.5 feet deep in the ground, or specially insulated (hair felt insulation). This would prevent water inside piping from freezing under extreme cold weather condition.