Ever hit a wall with your phone's search?

Image: Santa Clara Valley Transportation Authority, Public domain, via Wikimedia Commons

Glossary of poker terms

Ever hit a wall with your phone's search?

Imagine you're trying to search for a friend's name using a phone app, but it keeps cutting off your search mid-sentence.

Your phone's search has a limit on how much text it can process at once, like a tiny window that only shows part of a larger picture.

Example

Searching for "John Smith" works fine, but adding "who lives in New York" causes the search to stop and restart.

Remember this

The search window limit means the maximum number of tokens your phone can process at once.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Unigram tokenization does: starts with large vocabulary and prunes using EM

Unigram tokenization starts with a large vocabulary and prunes using EM

the vocabulary size matters: larger vocab = shorter sequences but more parameters

Bigger vocab means shorter sentences but more brainpower needed

BLOCK_SIZE means in Triton: the tile size each program instance processes

Why does your computer sometimes feel slow when you're playing games?

Attention Is All You Need

"Attention Is All You Need" introduced the transformer architecture in 2017

subword tokenization solves: handles rare words by breaking into known pieces

Subword tokenization solves rare word handling by breaking into known pieces

BPE tokenization does: iteratively merges the most frequent byte pairs

How can we shrink text files without losing meaning?

Swipe through 100 ML concepts daily