AI
Large Language Models (LLMs)
A practical guide to understanding what large language models are and why they matter for product and UX teams.
What LLMs are, how they generate responses, and what designers and product people need to understand to work effectively with AI-powered features.
What it is
A glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term is a type of AI glossarySystemA system is a collection of interconnected components that work together to achieve a specific function or outcome.Open glossary term trained on vast amounts of text to understand and generate human language.
glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term learn glossaryPatternA reusable solution to a common design problem.Open glossary term in language by processing enormous quantities of text — books, websites, articles, code, and more. From that training, they develop the ability to predict what comes next in a sequence of words, which is the core mechanism behind generating glossaryResponseA response is the data or result returned by a server after receiving a request.Open glossary term.
When you type a question or glossaryPromptA prompt is the input or instruction given to an AI system to guide its output or response.Open glossary term into an AI tool, the LLM generates a glossaryResponseA response is the data or result returned by a server after receiving a request.Open glossary term one token at a time, each step influenced by everything that came before it.
This means glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term are not retrieving pre-written answers. They are generating new text based on glossaryPatternA reusable solution to a common design problem.Open glossary term learned during training.
glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term power most of the AI glossaryFeatureA feature is a specific piece of functionality within a product that delivers value to users. It represents something users can do or experience as part of the overall product.Open glossary term people interact with today, from chatbots and writing assistants to glossarySearchSearch is the functionality that allows users to find content or information by entering queries. It relies on indexing, metadata, and relevance algorithms to return useful results.Open glossary term tools, code generators, and product recommendation systems.
When to use it
Understand when glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term are the right foundation. They are most relevant when:
They are less relevant when:
Key takeaway
LLMs are powerful at language tasks but not infallible. Understanding what they are and how they work helps you design features that play to their strengths.
How it works
Understand the basic mechanism. glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term are trained using a glossaryProcessA process is a defined sequence of steps used to achieve a specific outcome.Open glossary term called next-token prediction. The glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term is shown huge amounts of text and learns to predict what word or phrase comes next based on the context that precedes it.
Through billions of these predictions during training, the glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term develops a deep representation of language, including grammar, facts, reasoning glossaryPatternA reusable solution to a common design problem.Open glossary term, and style.
When generating a glossaryResponseA response is the data or result returned by a server after receiving a request.Open glossary term, the glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term samples from a probability distribution of likely next tokens, building the output word by word.
What this means for designers and product teams. glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term do not think or reason the way humans do. They generate plausible-sounding glossaryResponseA response is the data or result returned by a server after receiving a request.Open glossary term based on glossaryPatternA reusable solution to a common design problem.Open glossary term matching, which is why they can produce confident but incorrect answers.
The quality of an LLM's output is heavily influenced by how it is prompted. Vague or ambiguous inputs produce inconsistent outputs.
glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term have a knowledge cutoff — they do not know about events that occurred after their training was completed unless supplemented with tools like RAG.
What to look for
Focus on:
Where it goes wrong
Most issues come from: Treating an LLM like a database that retrieves facts will glossaryLeadA lead is a potential customer who has shown interest in a product or service, typically by providing contact information or engaging with content.Open glossary term to disappointment.
What you get from it
Understanding glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term gives you:
Key takeaway
LLMs are not magic — they are statistical language machines. The more clearly you understand that, the better the AI features you will design around them.
FAQ
Common questions
A few practical answers to the questions that usually come up around this method.
What is a large language model in simple terms?
An LLM is an AI glossarySystemA system is a collection of interconnected components that work together to achieve a specific function or outcome.Open glossary term trained on a huge amount of text to understand and generate human language. It works by predicting what words should come next in a sequence, which allows it to write, summarise, translate, answer questions, and hold conversations.
How is an LLM different from a search engine?
A glossarySearchSearch is the functionality that allows users to find content or information by entering queries. It relies on indexing, metadata, and relevance algorithms to return useful results.Open glossary term engine retrieves existing documents that match a query. An LLM generates new text based on glossaryPatternA reusable solution to a common design problem.Open glossary term it learned during training. Search returns what exists — glossaryLarge Language Model (LLM)A Large Language Model is an AI model trained on vast amounts of text data to understand and generate human-like language.Open glossary term generate what seems most plausible, which is why they can produce incorrect information with confidence.
What are the most well-known LLMs?
GPT-4 and GPT-4o from OpenAI, Claude from Anthropic, Gemini from Google, and Llama from Meta are among the most widely used. Most AI products you interact with are built on top of one of these guideFoundation ModelsWhat foundation models are, how they differ from traditional software, and what product and design teams need to know when building on top of them.Open guide.
Why do LLMs sometimes get things wrong?
Because they generate glossaryResponseA response is the data or result returned by a server after receiving a request.Open glossary term based on glossaryPatternA reusable solution to a common design problem.Open glossary term matching, not retrieval of verified facts. If the guideTraining DataWhat training data is, how it shapes what an AI model knows and assumes, and what product and design teams need to understand about its role in AI product quality.Open guide contained errors, biases, or gaps, those will show up in the outputs. This is why hallucinations happen — the model produces a plausible-sounding answer even when it does not have reliable information to draw from.
Do I need to understand how LLMs work technically?
Not in depth. But understanding that they generate language probabilistically, that they have knowledge cutoffs, and that their glossaryOutput QualityHow accurate, useful, and relevant a result is.Open glossary term depends heavily on how they are prompted will help you make better design and product decisions.
Quick take
If you are designing AI-powered products, understanding what an LLM is and how it works is a starting point for everything else.
Related Services
Related Guides