The flight of the ultra-rich has left many butlers, chefs and nannies used to earning up to £140,000 a year out of a job.