Large language model

LLMs can generate, summarize, translate, and analyze text in many contexts

LLMs, or large language models, are neural networks trained on extensive text data, enabling them to perform a variety of natural language processing tasks. These tasks include generating new text, summarizing existing content, translating languages, and analyzing text for different purposes. The versatility of LLMs makes them invaluable tools in the realm of artificial intelligence and natural language processing.

Example

A chatbot powered by an LLM can engage in a conversation with users, providing responses that are coherent and contextually relevant.

Remember this

Understanding the capabilities of LLMs is crucial for leveraging their potential in various applications, from customer service to content creation.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Masking (behavior)

Can you not see what's right in front of you?

ring attention does: distributes long sequences across multiple devices

How can a machine understand and generate human language?

weight tying does in language models: shares embedding and output projection matrices

Ever wonder how machines understand the sequence of words in a sentence?

[CLS] pooling does: uses the first token's embedding as the sentence representation

CLS pooling: uses the first token's embedding as the sentence representation

BPE tokenization does: iteratively merges the most frequent adjacent byte pairs

How do we make computers understand language better?

Attempts to overturn the 2020 United States presidential election

Why can computers do many things at once?

Swipe through more Machine Learning concepts

Open Pocket Polymath