Ollama

Ollama lets you run open-weight large language models such as Llama, Gemma, and Qwen locally with a simple API.