FROM THE AUTHOR
Explore the published guides and contributions from John C. Mullen.
88 published articlesLocal LLM endpoints time out for reasons cloud APIs rarely do: cold model loads, KV cache allocation, prompt evaluation, and queueing behind other requests. This guide explains…
For local LLMs, dedicated VRAM capacity decides which models you can load at all — compute speed only decides how fast they answer. This guide explains how…
A LangChain RAG pipeline has three stages: index documents, retrieve the passages relevant to a query, and pass those passages to a chat model. This guide walks…
AI-generated WordPress content cannot be regression-tested with exact-match assertions, because correct output varies between runs. The practical replacement is an eval: a scored check that runs a…
A fixed test suite replaces impressions with a comparable number: freeze the tasks, the harness, the runtime, and the scoring rule, then run the same suite repeatedly.…
Metadata filtering is the retrieval-layer control that turns user identity, permissions, and dates into vector query constraints. In multi-tenant RAG, the orchestrator should apply tenant, ACL, and…
Practical AI for beginners starts with a bounded, reviewable task rather than a tool shopping list. This guide explains the beginner stack, how to choose tools and…
When a RAG system returns the wrong document, the language model is rarely the cause. The failure usually sits in chunking, retrieval, or ranking. This guide explains…
Retrieval-Augmented Generation lets a language model answer from evidence in your own documents instead of relying only on its training data. This guide explains the four stages…
AI API failures usually fall into authentication, rate limit or quota, and timeout classes. Reading the HTTP status and provider error code first prevents wasted retries and…
Local AI means running a language model on hardware you control instead of sending prompts to a hosted service. This guide explains how local inference works, how…
Adding human review before publication means inserting an explicit approval state between generation and publishing, binding that approval to a specific version of the content, and letting…