Matrix multiplication provides a series of fast multiply and add operations in parallel, and it is built into the hardware of GPUs and AI processing cores (see Tensor core). See compute-in-memory.

This carbon nanotube-based tensor processing chip ... which can perform two-bit integer convolution and matrix multiplication operations in parallel." The tightly coupled architecture introduced ...

Tensor cores compute values on matrices in parallel. A new matrix is created from two matrices by quickly multiplying and adding 16- or 32-bit floating point values in parallel. See TF32.