constitutional AI does: model critiques and revises its own outputs using principles

MoE models have more parameters but similar compute cost

MoE models distribute parameters across k experts, reducing active experts' compute cost

Machine learning in bioinformatics

How do Transformers understand what's important in a sentence?

Large language model

LLMs can generate, summarize, translate, and analyze text in many contexts

RAG does: retrieves relevant documents before generating to reduce hallucination

Can AI ever truly understand new information?

the ONNX format does: standardizes model representation for cross-framework deployment

Can AI models talk to each other across different platforms?

Curry–Howard correspondence

Proofs are programs, types are propositions