A rustic home on a UK private island with ties to British history that was priced at £4.5 million, or about $5.6 million, was taken off the market after its owner struggled to find a buyer.