-
Notifications
You must be signed in to change notification settings - Fork 1.2k
docs: add Ollama + LiteLLM quickstart and sidebar entry #3176
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
alex-ciobotea-dvloper
wants to merge
5
commits into
Skyvern-AI:main
Choose a base branch
from
alex-ciobotea-dvloper:docs/ollama-litellm-quickstart
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
docs: add Ollama + LiteLLM quickstart and sidebar entry #3176
alex-ciobotea-dvloper
wants to merge
5
commits into
Skyvern-AI:main
from
alex-ciobotea-dvloper:docs/ollama-litellm-quickstart
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Caution
Changes requested ❌
Reviewed everything up to a4e2974 in 2 minutes and 40 seconds. Click for details.
- Reviewed
117
lines of code in2
files - Skipped
0
files when reviewing. - Skipped posting
2
draft comments. View those below. - Modify your settings and rules to customize what types of comments Ellipsis leaves. And don't forget to react with 👍 or 👎 to teach Ellipsis.
1. fern/docs.yml:153
- Draft comment:
Added navigation entry for the new integration. Please verify that the ordering within the Integrations section meets your intended convention. - Reason this comment was not posted:
Confidence changes required:33%
<= threshold50%
None
2. fern/integrations/ollama-litellm.mdx:22
- Draft comment:
The comment 'The API is usually at http://localhost:11434.' appears within the bash code block. Consider closing the code block before this note or moving the note outside to avoid confusion. - Reason this comment was not posted:
Decided after close inspection that this draft comment was likely wrong and/or not actionable: usefulness confidence = 10% vs. threshold = 50% The comment is technically correct - there is a formatting issue where explanatory text is mixed inside a code block. However, this is a documentation file and the issue is minor. The information is still clear and understandable to readers. The URL is actually useful to have near the commands. This feels like an overly pedantic formatting suggestion. The formatting inconsistency could cause confusion for users copy-pasting commands. Some users might accidentally try to run the note as a command. The risk is very low since the text clearly reads as a note, not a command, and is on a new line after the actual commands. Most users would understand this intuitively. While technically correct, this comment is too minor and pedantic for a documentation file. The current format is clear enough for readers.
Workflow ID: wflow_JoJ2avpDw74Jdnq0
You can customize by changing your verbosity settings, reacting with 👍 or 👎, replying to comments, or adding code review rules.
Thanks for the review! I addressed the formatting suggestions:
Navigation:
Vars match code:
|
suchintan
approved these changes
Aug 28, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds a new integration guide: Ollama + LiteLLM.
fern/integrations/ollama-litellm.mdx
fern/docs.yml
under IntegrationsENABLE_OLLAMA
,OLLAMA_SERVER_URL
,OLLAMA_MODEL
ENABLE_OPENAI_COMPATIBLE
andOPENAI_COMPATIBLE_*
env varsCloses #242.
📚 This PR adds comprehensive documentation for integrating Skyvern with local LLMs via Ollama and OpenAI-compatible proxies like LiteLLM, providing users with cost-effective alternatives to expensive cloud-based models like GPT-4.
🔍 Detailed Analysis
Key Changes
ollama-litellm.mdx
with detailed setup instructions for both direct Ollama and LiteLLM proxy configurationsdocs.yml
under the Integrations section for easy discoverabilityENABLE_OLLAMA
,OLLAMA_*
,ENABLE_OPENAI_COMPATIBLE
,OPENAI_COMPATIBLE_*
)Technical Implementation
Impact
Created with Palmier
Important
Adds Ollama + LiteLLM integration guide with configuration paths for Skyvern.
ollama-litellm.mdx
for Ollama + LiteLLM integration guide.docs.yml
to include Ollama + LiteLLM in the Integrations sidebar.ENABLE_OLLAMA
,OLLAMA_SERVER_URL
,OLLAMA_MODEL
.ENABLE_OPENAI_COMPATIBLE
and related env vars.This description was created by
for a4e2974. You can customize this summary. It will automatically update as commits are pushed.