Ollama: run open language models on your own machine

What it is: Ollama is a tool for running open language models locally. You install it, download a model from its library, and chat with it from the terminal. It also exposes a local REST API, so your own apps can talk to the model.

Who it is for: developers who want to experiment with language models without sending data to a hosted service, and anyone who wants to prototype an AI feature offline or at no per-request cost.

Why it is worth trying: the workflow is short. Pull a model, run it, and call it from code through the local API. Because everything stays on your computer, it is a convenient way to test prompts, build small tools and learn how these models behave.

ollama run <model-name>   # download the model if needed and start chatting
ollama list               # show the models installed on your machine

One limitation: performance depends on your hardware. Larger models need a lot of memory, and on a modest laptop you will usually be limited to smaller models, which are less capable than the biggest hosted ones.