The Orchestrator › Vocabulary › Inference engine
Inference engine
The model that interprets a goal and generates language or structured proposals for next steps. The runtime selects and executes tool calls around it. Typically a large language model generating next tokens from learned distributions, not a database lookup.
Discussed in the book
- Chapter 1: The Orchestrator's Toolkit — 1.3 Inference engines and models mentioned 4×
- Chapter 2: The Instructions Are Part of the System — 2.2 The instruction tree mentioned 4×
- Chapter 3: Delegation Is Architecture — 3.2 Contracts and grants mentioned 4×
- Chapter 3: What an Orchestrator Orchestrates — 3.3 Delegated intelligence mentioned 2×
- Chapter 1: The Orchestrator's Toolkit — 1.8 Policy and permission systems mentioned 2×
- Chapter 3: Delegation Is Architecture — 3.1 Operational orchestration mentioned 2×
- Chapter 3: What an Orchestrator Orchestrates — 3.9 The components of a delegated intelligence mentioned once
- Chapter 3: What an Orchestrator Orchestrates — 3.11 Deterministic and nondeterministic parts mentioned once
- Search for every mention of “Inference engine”
Related essays
- No published essay touches this term yet.