Ever wondered how computers can do so many tasks at once?
Image: Fensterblick., CC BY-SA 3.0, via Wikimedia Commons
Ever wondered how computers can do so many tasks at once?
Imagine you're cooking dinner while texting a friend and listening to music. You'd feel overwhelmed if you tried to do all these tasks at the same time!
Computers use a clever method to handle lots of tasks at once, like cooking, texting, and listening to music simultaneously. This method is called instruction-level parallelism (ILP).
Example
If your computer can handle 4 tasks at once (like cooking, texting, listening to music, and browsing the web), it can do 4 actions every second instead of just one.
Remember this
The key insight is that computers can perform multiple tasks at the same time using ILP, making them much more efficient.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Triton differs from CUDA
Why does a super-fast computer sometimes run slower than a regular one?
Loop nest optimization
Can speeding up your computer make tasks quicker?
fused kernels do
Why wait for a computer to finish one task before starting another?
Von Neumann architecture
CPU must fetch both data and instructions from memory
Matrix multiplication algorithm
Ever wondered how computers speed up multiplying huge numbers?
most transformer operations are memory-bound, not compute-bound
Why do computers sometimes get tired?
Swipe through 100 ML concepts daily
Open Pocket Polymath