mirror of
https://git.FreeBSD.org/ports.git
synced 2025-01-20 08:27:15 +00:00
misc/ollama: Add environment variables to 'ollama start' to work around memory allocation issues
This commit is contained in:
parent
8f79c11c71
commit
ba338beba4
@ -5,7 +5,7 @@ You installed ollama: the AI model runner.
|
||||
|
||||
To run ollama, plese open 2 terminals.
|
||||
1. In the first terminal, please run:
|
||||
$ ollama start
|
||||
$ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start
|
||||
2. In the second terminal, please run:
|
||||
$ ollama run mistral
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user