The Palace would be "foolish" to consider any reconciliation with the Duke of Sussex, declared Hilary Fordwich.