Big Lots will start going-out-of-business sales at its stores, the company said. Party City, which has 14 stores on Long Island is also closing all of its stores, according to a media report.