
Can you guess how computers figure out secret codes in everyday communication?
Image: Edward Larsson, Public domain, via Wikimedia Commons
Can you guess how computers figure out secret codes in everyday communication?
Imagine you're texting a friend, and you want to make sure your message isn't intercepted. How does your phone make sure your secret messages are safe?
Your phone uses a clever method to guess the best secret code sequence that matches your message, even if someone tries to eavesdrop.
Example
If you send a series of emojis to represent a secret phrase, the phone guesses the most likely sequence of hidden words that those emojis could stand for.
Remember this
The Viterbi algorithm guesses the best secret code sequence for your message.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Viterbi semiring
How do we find the best path in a maze of choices?
Speech recognition
How do machines understand our spoken words?
t-SNE preserves local structure
Can we see the hidden patterns in a cloud of data points?
Likelihood function
Why can't we just guess probabilities correctly all the time?
Overlapping subproblems
Ever calculated a huge Fibonacci sequence by hand?
weight tying does in language models: shares embedding and output projection matrices
Ever wonder how machines understand the sequence of words in a sentence?
Swipe through more Machine Learning concepts
Open Pocket Polymath