Why can computers do many things at once?
Why can computers do many things at once?
Imagine you're cooking dinner while listening to a podcast and texting a friend. You can do all these tasks without missing a beat because you're multitasking.
Computers use a technique called "speculative execution" to predict what they might need to do next and start working on it while still doing other tasks. This way, they can do many things at once without waiting for one task to finish before starting another.
Example
If you're halfway through a recipe when you remember you need to text your friend, your brain can start typing the message while still following the recipe.
Remember this
Speculative execution allows computers to multitask efficiently.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
instruction-level parallelism (ILP) achieves: multiple operations per clock cycle
Ever wondered how computers can do so many tasks at once?
most transformer operations are memory-bound, not compute-bound
Why do computers sometimes get tired?
Triton differs from CUDA
Why does a super-fast computer sometimes run slower than a regular one?
ReLU and Leaky ReLU
Why do computers sometimes struggle with simple decisions?
Large language model
LLMs can generate, summarize, translate, and analyze text in many contexts
fused kernels do
Why wait for a computer to finish one task before starting another?
Swipe through more Machine Learning concepts
Open Pocket Polymath