Lambda calculus represents data using only functions
Lambda calculus represents data using only functions
Lambda calculus is a formal system that uses function abstraction and application to represent data. It operates solely on functions, without the need for variables or data structures. This makes it a powerful tool for expressing computation in a concise and abstract manner.
Example
In lambda calculus, the expression (λx.x) represents a function that takes an argument x and returns it unchanged. This can be seen as a simple identity function.
Remember this
Understanding lambda calculus is crucial for studying the foundations of computation and for exploring alternative models of computation.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
the do-calculus does: computes interventional probabilities from observational data
Do-calculus computes interventional probabilities from observational data
Monad (functional programming)
Monads are a type constructor with two operations: return and bind
Encoder vs decoder: encoder sees all tokens bidirectionally, decoder sees only past tokens
Encoder: Sees all tokens bidirectionally; Decoder: Sees only past tokens
the tokenizer's special tokens do: [CLS], [SEP], [PAD], [MASK] have specific roles
[CLS] marks the start of input, [SEP] denotes separation, [PAD] fills space, [MASK] hides words for prediction
[CLS] pooling does: uses the first token's embedding as the sentence representation
CLS pooling: uses the first token's embedding as the sentence representation
parametric polymorphism does: a function works for any type T without knowing what T is
Parametric polymorphism allows code to work with any type T
Swipe through 100 ML concepts daily
Open Pocket Polymath