Tool Use & Integration Patterns
Designing lightweight tools for NPU-based agents. Async I/O and non-blocking integrations. Local vs. remote tool execution trade-offs. Building tool abstractions that respect hardware constraints.
3.1 Designing Tools for NPU-Bound Agents
Chapter 2 ended with a claim: tool selection is a decision problem, not a search. This chapter go...
3.2 Local-NPU vs Cloud Tools: A Real Trade-Off Table
If the tool runs locally on the NPU, the orchestrator pays a one-time compile cost and then has p...
3.3 Multi-Device Orchestration on a Single SoC
A Core Ultra SoC isn't one engine — it's three. CPU cores for general-purpose work, an integrated...
3.4 Structured Outputs and Constrained Decoding
An agent is only as reliable as the parser that reads its output. Chapter 3.1 covered designing t...