Local AI

GPU servers, model stacks, local inference experiments, and agent workloads — everything running on-prem instead of in the cloud.

Local AI Server Build

In Progress

Building a dedicated GPU server for local LLM inference and fine-tuning. Started with a single RTX 3090, planning to add a second card once cooling is sorted. Runs Ollama, vLLM, and custom agent workloads in Docker containers.