Recent Books
Onzichtbare Meesters
Een filosofische novelle over passie, erfenis en het ambacht dat onder de oppervlakte van de soft...
On the Edge: Agentic AI for Neural Processors
A practical guide to building intelligent agents optimized for NPU hardware. Learn how to design,...
Secure Software Development
The following pages and documents cover Secure Software Development, including the Secure Develop...
Recently Updated Pages
4.4 Security and Privacy on the Edge
"It runs on the device, so it's private" is the marketing line. It's also a half-truth that has c...
3.4 Structured Outputs and Constrained Decoding
An agent is only as reliable as the parser that reads its output. Chapter 3.1 covered designing t...
1.5 Speculative Decoding
Chapter 1.3 established the bandwidth ceiling as the binding constraint on LLM decode: 136.5 GB/s...
1.4 The Accuracy Cost of Quantization
Chapter 1.2 laid out the quantization recipes Intel NPU supports: INT8-sym, INT4-sym group-128 or...
Preface
This book is about a narrow, awkward, increasingly important corner of applied AI: building agent...
References
These are the primary sources for the technical claims in the book. Where multiple sources existe...
Glossary
The book uses vocabulary from three communities that don't always agree on terms: Intel NPU hardw...
2.3 Reasoning Loops Under Constraint
Chapter 2 closes here. We have a model that fits, weights we can stream, KV state we can manage, ...
2.2 KV Cache Engineering: Reuse, Eviction, and Prefix Sharing
The distinction between KV cache (what you keep in memory) and KV cache bandwidth (what you strea...
2.1 Context Windows and the Memory Wall
The agent's state — what it remembers from past steps and what it uses to make the next decision ...