Skip to content

docs(agents): custom LLM is configurable from the console - #242

Merged
virgoone merged 2 commits into
mainfrom
claude/custom-llm-console-config
Oct 14, 2026
Merged

virgoone merged 2 commits into
mainfrom
claude/custom-llm-console-config

Conversation

@virgoone

@virgoone virgoone commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Why

agents/build/custom-llm still listed "Configuration is API-only for now. A console UI comes later." under Limitations. The console now has a + Custom LLM entry in the model selector with a connection test, so the page contradicted the product.

What

  • "Point the agent at your endpoint" now describes the console flow as numbered steps, with what Run test reports as a list, ahead of the API call.
  • Removed the API-only limitation.
  • The latency tip is now a short list. It says 800 ms is a recommendation, not a limit. It also covers slow reasoning models and where to see first-token time.

🤖 Generated with Claude Code


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

Summary by CodeRabbit

  • Documentation
    • Added console instructions for configuring, testing, saving, editing, and removing a custom LLM.
    • Clarified that selecting a platform model removes the custom endpoint and stored key.
    • Updated latency guidance to recommend a time-to-first-token under 800 ms and added notes on reasoning models, test timing, and conversation history.

The page still said configuration was API-only with a console UI to come.
The console now has a + Custom LLM entry in the model selector with a
connection test, so describe that flow next to the API one, drop the
limitation, and phrase the 800 ms first-token figure as guidance with a
note on reasoning models.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@mintlify

mintlify Bot commented Oct 12, 2026 •

Copy link
Copy Markdown

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
hanabiaiinc 🟢 Ready View Preview Oct 12, 2026, 7:09 AM

💡 Tip: Enable Automations to automatically generate PRs for you.

@coderabbitai

coderabbitai Bot commented Oct 12, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 39892aa7-514a-4862-bce4-3c90348b8d51



📥 Commits

Reviewing files that changed from the base of the PR and between 1838f1d and cc5812e.




📒 Files selected for processing (1)
  • agents/build/custom-llm.mdx



Included review availability: This review used your included allowance. Your plan provides up to 1 included review per hour; 0 remain after this review.





📝 Walkthrough
📝 Walkthrough
📝 Walkthrough

Walkthrough

The custom LLM guide adds console setup and testing instructions, clarifies API configuration, and updates voice latency guidance.

Changes

Custom LLM Guidance

Layer / File(s) Summary
Setup and latency guidance
agents/build/custom-llm.mdx
Adds console instructions to configure, test, save, edit, and remove a custom LLM. Clarifies that selecting a platform model removes the endpoint and stored key. Adds first-token latency guidance for voice and describes timing shown in Run test and conversation history.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~5 minutes

Change: Other





Merge Risk: ⚪ Minimal · up to cc581

The guide documents console setup and latency guidance. No concrete issue in the changed documentation prevents merging; the console behavior was not independently checked against platform code.

Pre-merge checks | Passed 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title clearly and concisely describes the main change: documenting that custom LLMs can be configured from the console.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR





  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@virgoone
virgoone merged commit cc9d3e0 into main Oct 14, 2026
6 checks passed
@virgoone
virgoone deleted the claude/custom-llm-console-config branch October 14, 2026 08:13

This branch was successfully deployed

1 active deployment
staging — cc5812e2 Deployed Oct 12, 2026 by mintlify[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants