Drop max_tokens cap on codegen; qwen3 reasoning truncation left content empty

qwen38-iq3s reasons extensively before emitting the skill body. A max_tokens
cap truncated the hidden reasoning (finish_reason: length) leaving content
empty, so the body write failed with 'skill body is empty'. Omit max_tokens
so the model runs to completion (~7 min); reasoning is filtered automatically
since only content is read. Client timeout default raised to 1200s.
This commit is contained in:
Denton Social
2026-09-24 01:20:18 -05:00
parent 440e49e76e
commit 9e365446a3
4 changed files with 64 additions and 20 deletions
+2 -2
View File
@@ -13,10 +13,10 @@
},
"llm": {"base_url": "http://localhost:11434/v1", "model": "qwen3.5:4b"},
"codegen": {
"_comment": "OpenAI-compatible model that writes runnable skill bodies. Larger/slower than the decision or self-assessment model.",
"_comment": "OpenAI-compatible model that writes runnable skill bodies. Larger/slower than the decision or self-assessment model. No max_tokens cap: qwen38-iq3s reasons extensively (~7 min) before emitting the body; reasoning is filtered automatically. timeout is seconds.",
"base_url": "http://localhost:11434/v1",
"model": "qwen38-iq3s",
"timeout": 600
"timeout": 1200
},
"skill_bodies": "data/skills",
"skills": {