constitutional AI does: model critiques and revises its own outputs using principles

MoE models have more parameters but similar compute cost

MoE models distribute parameters across k experts, reducing active experts' compute cost

Large language model

LLMs can generate, summarize, translate, and analyze text in many contexts

mechanism design does: designs rules so rational agents produce desired outcomes

Mechanism design constructs rules for desired outcomes

Curry–Howard correspondence

Proofs are programs, types are propositions

Adam has bias correction: divides by (1-β^t) in early steps

Why do we sometimes need to fix mistakes in computer decisions?

Prompt engineering

The GenAI model learns tasks from examples in the prompt