Prompt engineering

The GenAI model learns tasks from examples in the prompt

Prompt engineering involves structuring natural language inputs to guide GenAI models in generating desired outputs. This process includes designing and refining input instructions to improve accuracy and relevance.

Example

Few-shot prompting involves providing a GenAI model with a few examples to learn and perform a task, such as summarizing a text.

Remember this

Understanding prompt engineering is crucial for effectively utilizing GenAI models in various applications.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

instruction tuning does: fine-tunes on (instruction, response) pairs

Fine-tuning adapts pre-trained models to new tasks

the system prompt does: sets persistent behavior instructions for the conversation

Prompt engineering shapes GenAI outputs

weight tying does in language models: shares embedding and output projection matrices

Ever wonder how machines understand the sequence of words in a sentence?

soft targets carry more information than hard labels: they encode class similarities

Why do some learning methods need to explore more than others?

Retrieval-augmented generation

RAG enables LLMs to access new information without retraining

Knowledge distillation

Knowledge distillation transfers knowledge from a large model to a smaller one without loss of validity

Swipe through 100 ML concepts daily

Open Pocket Polymath