RAG does: retrieves relevant documents before generating to reduce hallucination

Can AI ever truly understand new information?

Imagine you're trying to find out the latest weather forecast for your trip next week. You ask a smart assistant, but it gives you outdated information because it can't access the newest data.

RAG helps smart assistants like your trip planner by first looking up the most recent weather reports before answering your questions, ensuring you get the latest forecast.

Example

You ask your assistant for the weather next week, and it checks a real-time weather database before telling you it's sunny, instead of relying on its old training data which said it was raining.

Remember this

RAG retrieves and uses the latest information, reducing outdated responses from AI.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Retrieval-augmented generation

RAG enables LLMs to access new information without retraining

Large language model

LLMs can generate, summarize, translate, and analyze text in many contexts

Masking (behavior)

Can you not see what's right in front of you?

ring attention does: distributes long sequences across multiple devices

How can a machine understand and generate human language?

2022 in science

Why do Transformers sometimes seem to 'ignore' irrelevant parts of the input?

1536-dim OpenAI text-embedding-3-large is used for: semantic search and RAG

Used for semantic search, RAG, and enhancing language models' understanding

Swipe through 100 ML concepts daily

Open Pocket Polymath