Ever wondered how computers can predict your favorite songs?
Ever wondered how computers can predict your favorite songs?
Imagine you're trying to find new music but don't want to listen to anything too similar to your current favorites.
Think of your music taste as a big map. Sparse matrix factorization helps find hidden paths (similar songs) without walking the same roads (too similar songs) repeatedly.
Example
If you like rock and pop, sparse matrix factorization can help find new songs that are like rock and pop but aren't the same as your favorite tracks.
Remember this
It's like having a GPS that finds you the best routes without retracing your steps.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Dimensionality reduction
Dimensionality reduction transforms high-dimensional data into low-dimensional space while preserving meaningful properties
Rate-distortion theory: minimum bits to represent data within distortion D
How many bits do we need to perfectly copy a song?
Regularization (mathematics)
L1 regularization results in sparse solutions
the curse of dimensionality makes nearest neighbor search unreliable
Why can't we find our friends easily as we move to a city with more and more neighborhoods?
LASSO uses L1 to do feature selection by driving coefficients to exactly zero
Why do some numbers disappear when solving complex problems?
Vector quantization
How can you store a huge library of books in a tiny closet?
Swipe through 100 ML concepts daily
Open Pocket Polymath