Local language model runners

Ollama lets you choose an AI model and chat with it on your own computer.

llama.cpp is a C/C++ program with no external dependencies for running language models, including models that read images, on hardware such as laptop CPUs, GPUs and phones.

Janus is a small local AI server written in Go: give it a GGUF model file (a compressed model format that runs on ordinary hardware) and it answers through an OpenAI-compatible API, the same request format OpenAI uses, so tools like Cursor or Cline can talk to it instead of a cloud service.

The Python library that defines how open models are written down, covering text, images, audio, video and combinations of them, for both running a model and training one.