Setup's AI step doesn't ask for the LLM context window #1001

Closed
opened 2026-10-01 19:01:37 +00:00 by claude-bot · 1 comment
Collaborator

The one piece of #439 not built.

The setup wizard's AI step (pages/Setup.jsx, AiStep) takes the Whisper and LLM endpoints and tests them live, but it doesn't ask for the LLM's context window. That setting is only in Admin → AI models (llm_context_tokens). #439 named it because of a real incident: a silent fallback to 32,768 tokens. The catalogue row IS-255 still says the step includes it, and no decision dropped it.

To do. Add the context window to the AI step (the same field and validation as Admin → AI models), or record a decision that it stays in Admin and correct IS-255. If added: a test that the wizard saves it, and that skipping the step leaves it on Admin's list of skipped things.

Refs #439.

The one piece of #439 not built. The setup wizard's AI step (`pages/Setup.jsx`, `AiStep`) takes the Whisper and LLM endpoints and tests them live, but it doesn't ask for the LLM's context window. That setting is only in Admin → AI models (`llm_context_tokens`). #439 named it because of a real incident: a silent fallback to 32,768 tokens. The catalogue row IS-255 still says the step includes it, and no decision dropped it. **To do.** Add the context window to the AI step (the same field and validation as Admin → AI models), or record a decision that it stays in Admin and correct IS-255. If added: a test that the wizard saves it, and that skipping the step leaves it on Admin's list of skipped things. Refs #439.
Author
Collaborator

Done: PR #1018 merged (main 2b41dc28, CI green on 9a7cfe28).

Setup's AI step now asks for the model's context window, between Summariser and Test both. It is the same component as Admin → AI models (ContextWindowField), so the label ("How much it can read at once"), the hint, the bounds and the "Currently in effect" line are one string in both places, and it is saved with the endpoints on leaving the step and before a test. No server change. IS-255 is now true as written. Rendered beside Admin's field on a phone and a desktop in both themes.

**Done: PR #1018 merged** (main `2b41dc28`, CI green on `9a7cfe28`). Setup's AI step now asks for the model's context window, between Summariser and Test both. It is the same component as Admin → AI models (`ContextWindowField`), so the label ("How much it can read at once"), the hint, the bounds and the "Currently in effect" line are one string in both places, and it is saved with the endpoints on leaving the step and before a test. No server change. IS-255 is now true as written. Rendered beside Admin's field on a phone and a desktop in both themes.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
rbrooks/Quest-Board#1001
No description provided.