Artificial Intelligence
Inference
Plain English
When a glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term produces an answer.
Definition
guideInferenceWhat inference is, how it differs from training, and what product and design teams need to understand about its implications for speed, cost, and reliability.Open guide is the glossaryProcessA process is a defined sequence of steps used to achieve a specific outcome.Open glossary term of using a trained glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term to generate outputs or make predictions based on new input data.
In practice
Occurs when users interact with AI glossarySystemA system is a collection of interconnected components that work together to achieve a specific function or outcome.Open glossary term, such as generating text or predictions.
In context
It is the cost that recurs. Training is a large one-off; guideInferenceWhat inference is, how it differs from training, and what product and design teams need to understand about its implications for speed, cost, and reliability.Open guide is charged on every glossaryRequestA request is an action sent from a client to a server asking for data or a service.Open glossary term, which is what makes usage glossaryPatternA pattern is a reusable solution to a design problem that recurs across products and contexts. It captures an approach already shown to work, so a team solves the problem once rather than every time it appears.Open glossary term a commercial decision as much as a technical one.
The reality
guideInferenceWhat inference is, how it differs from training, and what product and design teams need to understand about its implications for speed, cost, and reliability.Open guide can be resource-intensive and may vary in speed and cost depending on the glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term.
Compared with
Inference vs Training
Training glossaryBuildA build is the process of compiling and packaging code into a runnable application.Open glossary term the glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term from glossaryDataData is raw, uninterpreted information collected and stored so it can be analysed, processed, or used to inform decisions. On its own it carries no meaning; context and interpretation are what make it useful.Open glossary term and happens rarely. Inference uses it to produce an output and happens constantly. Training dominates the initial cost; inference dominates the running one.
FAQ
Common questions
A few practical answers to the questions that usually come up around this term.
What is inference in AI?
It is the glossaryProcessA process is a defined sequence of steps used to achieve a specific outcome.Open glossary term of generating outputs using a trained glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term.
When does inference happen?
When a glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term is used to respond to new input.
Why is inference important?
It is how glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term deliver value in real-world use.
What affects inference performance?
glossaryModelA model is a system or representation used to process data and generate outputs, often trained to perform specific tasks.Open glossary term size, glossaryInfrastructureInfrastructure refers to the underlying systems and resources that support applications and services.Open glossary term, and input complexity.
Related Services
Related Guides
Related Terms
