energy-efficient AI inference
Energy-efficient AI inference produces useful model outputs while minimizing the electricity consumed by computation, memory, networking, and cooling.
Search clear AI terminology definitions, acronyms, related concepts and the reviewed videos that explain them.
Showing 261–280 of 1130 terms
Clear filtersEnergy-efficient AI inference produces useful model outputs while minimizing the electricity consumed by computation, memory, networking, and cooling.
An executable acceptance test is a runnable command or test that determines whether a defined acceptance condition has been met.
A foundation model is a broadly trained AI model that can be adapted to many downstream tasks and applications.
AI go-to-market orchestration coordinates customer data, decisions, automated actions, human tasks, and communication channels around a commercial outcome.
Hardware memory capacity is the amount of fast working memory available to hold an AI model and its runtime data.
Imitation learning trains an agent to perform a task by learning from demonstrations of behavior rather than relying only on an explicitly written reward function.
An immutable data store preserves prior records and represents changes by appending new entries instead of rewriting history.
Interpretability is the study of methods that help people understand how an AI system represents information and produces its behavior.
A large language model is an AI model trained on extensive tokenized data to understand and generate language and related structured outputs.
Linear attention reformulates attention so its computation grows roughly linearly with sequence length rather than quadratically like standard full attention.
A long-horizon agent pursues an objective across many actions or extended periods, requiring reliable task state, feedback and stopping conditions.
An AI model checkpoint is a saved version of model parameters and related state from a particular point in training or development.
AI model output is the text, image, audio, code, prediction or other result a model produces from its input and learned patterns.
Multi-graphics processing unit computing uses more than one graphics processing unit together to run a model or divide AI workloads.
Multi-robot collaboration is the coordinated use of two or more robots that communicate and divide work toward a shared objective.
Personal software is an application built around the specific workflow, preferences, or recurring problem of one person or a small group.
An AI price-to-performance ratio compares the useful capability or task success of an AI system with the money required to achieve it.
A proactive AI agent initiates relevant work or communication from goals and events instead of waiting for a direct prompt every time.
Prompt adherence is the degree to which a generated result accurately follows the requested subjects, actions, style, structure, constraints, and details.
Prompt injection is an attack that places malicious or conflicting instructions in an AI system's input so the model ignores intended rules or performs an unauthorized action.