The Swiss luxury watchmaker was asked to pay $4.8 million per year for the corner space in Manhattan’s prime retail corridor.