The GenAI model learns tasks from examples in the prompt
Image: Liz, CC BY 2.0, via Wikimedia Commons
The GenAI model learns tasks from examples in the prompt
Prompt engineering involves structuring natural language inputs to guide GenAI models in generating desired outputs. This process includes designing and refining input instructions to improve accuracy and relevance.
Example
Few-shot prompting involves providing a GenAI model with a few examples to learn and perform a task, such as summarizing a text.
Remember this
Understanding prompt engineering is crucial for effectively utilizing GenAI models in various applications.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
weight tying does in language models: shares embedding and output projection matrices
Ever wonder how machines understand the sequence of words in a sentence?
soft targets carry more information than hard labels: they encode class similarities
Why do some learning methods need to explore more than others?
Machine learning in bioinformatics
How do Transformers understand what's important in a sentence?
Retrieval-augmented generation
RAG enables LLMs to access new information without retraining
Knowledge distillation
Knowledge distillation transfers knowledge from a large model to a smaller one without loss of validity
Machine learning
Can we teach computers to learn like humans?
Swipe through 100 ML concepts daily
Open Pocket Polymath