10.1 Self-Hosting LLMs
Ollama, vLLM, TGI, hardware sizing, and GPU vs CPU inference for self-hosted LLMs.
2 docs tagged with "vllm"
View All Tags3.3 Running DeepSeek R1 Locally
Ollama, vLLM, hardware requirements, and quantization (Q4/Q8) for self-hosting.