But even the Nvidia A100 graphics card goes for upwards of $30,000, making it the most expensive GPU on the market (via NeoBits).