Tag: inference
-
How Plan Caching Reduces LLM Agent Costs
Plan caching reuses planning templates across similar agent tasks, cutting cost and latency without throwing away accuracy.
-
A beginner-friendly guide to the GGUF model format
GGUF made local LLM inference feel practical by packaging model weights, vocabulary, hyperparameters, and architecture metadata into one runnable format.