628 B
628 B
title, ring, quadrant, tags
| title | ring | quadrant | tags | ||
|---|---|---|---|---|---|
| Ollama | trial | tools |
|
Running large language models local?
Downloading Ollama and typing ollama run llama3 is all you need.
Ollama is great to run various open source (open weight) models local and interact with them. You can do this either via the command line or via the Ollama API.
Ollama takes care of downloading and running models and it supports the specification of own model packages in a "Modelfile".
At AOE, we use it for local development and testing.