tensor cores are

Why can computers crunch numbers faster than humans?

Imagine you're trying to find the best route for a delivery truck in a city with hundreds of streets and intersections. You'd have to check countless possibilities to find the quickest path.

Computers use special math tricks to quickly compare lots of routes at once, finding the best one much faster than checking each one individually.

Example

Instead of checking 100 routes one by one, a computer can look at all 100 routes at the same time and pick the best one instantly.

Remember this

Computers can process many possibilities at once using matrix multiplication, saving time and resources.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

quantization to INT8 doubles throughput

Quantization to INT8 doubles throughput because tensor cores process INT8 2x faster

tensor cores do 4x4 matrix multiply in one clock cycle

Tensor cores perform 4x4 matrix multiply using optimized GEMM (General Matrix Multiply) instructions in one clock cycle

Matrix multiplication algorithm

Ever wondered how computers speed up multiplying huge numbers?

General-purpose computing on graphics processing units

Did you know your computer can do more than just compute numbers?

CUDA

CUDA enables parallel computation on GPUs

a Triton kernel is

Can your phone run faster with a different brain?

Swipe through 100 ML concepts daily

Open Pocket Polymath