jeena/service-update-alerts
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

classifier: Add fallback model for transient LLM failures

Browse source 
The 26b model occasionally hangs or fails outright on the local Ollama
box, which used to drop every such update into 'manual' for no good
reason. Retry the same prompt with a smaller model before giving up,
and surface both errors when even the fallback fails.

OLLAMA_FALLBACK_MODEL is new config, see .env.sample.
This commit is contained in:
Jeena 2026-10-06 22:10:07 +09:00
parent 2df588b957
commit 86268107fa
2 changed files with 19 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
.env.sample
View file

@ -23,3 +23,4 @@ UPTIME_KUMA_PASSWORD=your-password
# Ollama for AI-driven auto-update classification
OLLAMA_BASE_URL=http://192.168.1.20:11434
OLLAMA_MODEL=gemma4:26b
OLLAMA_FALLBACK_MODEL=gemma4:12b