How to Automate WordPress Tasks with Ollama and WP-CLI
WP-CLI handles the deterministic WordPress operations, and a local Ollama model supplies the judgement layer that shell scripts lack. This guide shows how to pipe WP-CLI's JSON…
TAGGED GUIDES
#local LLM
Explore the guides, ideas, and practical explanations in this topic.
10 published articlesHow to Reproduce a Local Ollama Inference Run Exactly
Exact reproduction of an Ollama run requires pinning five layers at once: the model artifact, the runtime version, the sampling parameters, the prompt and context, and the…
How to Choose a GPU for Local AI: VRAM, Quantization, and Model Size
For local LLMs, dedicated VRAM capacity decides which models you can load at all — compute speed only decides how fast they answer. This guide explains how…
How to Benchmark Local LLMs for Code Generation with a Fixed Test Suite
A fixed test suite replaces impressions with a comparable number: freeze the tasks, the harness, the runtime, and the scoring rule, then run the same suite repeatedly.…
What Quantization Changes in a Language Model (and What It Leaves Alone)
Quantization rewrites a model's weights in lower precision while leaving its architecture, tokenizer, and parameter count intact. The memory savings are predictable; the quality cost is not,…
How to Choose a Local AI Model for Your Computer
Choosing a local AI model is a hardware-fit problem before it is a model-quality problem. Define the job, find your real memory budget, estimate weights plus KV…
How to Install Ollama and Run Your First Local Model
Ollama installs with a single command on macOS, Linux, and Windows, and a first local model can be running within minutes. This guide covers prerequisites, installation per…
Building Reliable AI Content Workflows with Human Review
A reliable AI content workflow gives each task to the party that can do it safely, keeps every claim linked to a source, and names a human…
RAM vs VRAM for Local AI: What Each One Does
When you run a local LLM, VRAM is where inference happens on the GPU, while system RAM provides capacity for loading models, CPU inference, and offloading. Both…
Connecting to Ollama from Another Device on Your Network
Ollama listens on 127.0.0.1:11434 by default, so nothing outside the host machine can reach it. Making it available to a phone, laptop, or second PC means changing…