Ever wondered how video games run so smoothly on your computer?
Ever wondered how video games run so smoothly on your computer?
Imagine you're playing an intense, fast-paced video game on your computer. The game suddenly freezes or lags, ruining the experience.
Your computer's graphics card helps run the game smoothly by processing complex calculations quickly. These calculations involve a special type of math called tensor operations, which are crucial for realistic graphics and physics in games.
Example
In the game, your character moves and interacts with the environment. The graphics card uses tensor cores to calculate how light reflects off surfaces and how objects move, making the game appear smooth and realistic.
Remember this
Tensor cores are specialized parts of your graphics card that handle complex calculations quickly, ensuring a smooth gaming experience.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
tensor cores are
Why can computers crunch numbers faster than humans?
TensorRT does: NVIDIA's inference optimizer that quantizes and fuses operations
TensorRT optimizes deep learning inference by quantizing and fusing operations for NVIDIA GPUs
XLA does for TensorFlow/JAX: compiles computation graphs for TPU/GPU execution
How can you speed up your favorite video game?
tensor cores do 4x4 matrix multiply in one clock cycle
Tensor cores perform 4x4 matrix multiply using optimized GEMM (General Matrix Multiply) instructions in one clock cycle
quantization to INT8 doubles throughput
Quantization to INT8 doubles throughput because tensor cores process INT8 2x faster
kernel fusion reduces memory bandwidth bottleneck
Can you imagine faster video games without waiting for loading screens?
Swipe through 100 ML concepts daily
Open Pocket Polymath