Skip to content

Add optional local Ollama support with strict provider isolation - #106

Merged
AgustinSRG merged 3 commits into
AgustinSRG:masterfrom
TurboRx:feature/add-ollama-support
Jun 22, 2026
Merged

Add optional local Ollama support with strict provider isolation#106
AgustinSRG merged 3 commits into
AgustinSRG:masterfrom
TurboRx:feature/add-ollama-support

Conversation

@TurboRx

@TurboRx TurboRx commented Jun 21, 2026

Copy link
Copy Markdown
Contributor

#98 (comment)

you told me to add this so i added it. i didn't do property testing on it because i don't have powerful hardware to test local/self-hosted models.

@AgustinSRG

AgustinSRG commented Jun 21, 2026

Copy link
Copy Markdown
Owner

Thank you for the contribution. I tested it with my local Ollama installation and it works properly.

Even if you have less powerful hardware, some models may run on it. I recommend this website to check what may run on your GPU: https://www.canirun.ai/

Also, Ollama will run the model with RAM + CPU (~ 40 times slower or more) if your GPU does not support it, so you can even run an LLM on a CPU with the drawback of being very slow.

Before merging, please fix the linter issues reported by the CI. You can check in local by running npm test. You can also fix the trivial ones automatically by running npm run fix-test

@TurboRx

TurboRx commented Jun 22, 2026

Copy link
Copy Markdown
Contributor Author

Fixed lint.

@AgustinSRG
AgustinSRG merged commit 7d77bec into AgustinSRG:master Jun 22, 2026
2 checks passed
@TurboRx
TurboRx deleted the feature/add-ollama-support branch June 22, 2026 13:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants