17 lines
628 B
Markdown
17 lines
628 B
Markdown
---
|
|
title: "Ollama"
|
|
ring: trial
|
|
quadrant: tools
|
|
tags: [ai, coding]
|
|
---
|
|
|
|
Running large language models local?
|
|
|
|
Downloading [Ollama](https://ollama.com/download) and typing `ollama run llama3` is all you need.
|
|
|
|
Ollama is great to run various open source (open weight) models local and interact with them. You can do this either via the command line or via the [Ollama API](https://github.com/ollama/ollama/blob/main/docs/api.md).
|
|
|
|
Ollama takes care of downloading and running models and it supports the specification of own model packages in a "Modelfile".
|
|
|
|
At AOE, we use it for local development and testing.
|