Lambda calculus represents data using only functions
Lambda calculus represents data using only functions
Lambda calculus is a formal system that uses function abstraction and application to represent data. It operates solely on functions, without the need for variables or data structures. This makes it a powerful tool for expressing computation in a concise and abstract manner.
Example
In lambda calculus, the expression (λx.x) represents a function that takes an argument x and returns it unchanged. This can be seen as a simple identity function.
Remember this
Understanding lambda calculus is crucial for studying the foundations of computation and for exploring alternative models of computation.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Monad (functional programming)
Monads are a type constructor with two operations: return and bind
parametric polymorphism does: a function works for any type T without knowing what T is
Functions can work with any data type without knowing it!
the Y combinator does: enables recursion in languages without named functions
Can a computer program call itself to solve problems?
Encoder vs decoder: encoder sees all tokens bidirectionally, decoder sees only past tokens
Encoder: Sees all tokens bidirectionally; Decoder: Sees only past tokens
BPE tokenization does: iteratively merges the most frequent adjacent byte pairs
How do we make computers understand language better?
the tokenizer's special tokens do: [CLS], [SEP], [PAD], [MASK] have specific roles
[CLS] marks the start of input, [SEP] denotes separation, [PAD] fills space, [MASK] hides words for prediction
Swipe through 100 ML concepts daily
Open Pocket Polymath