Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ollama should start automatically by default, Ollama without nvidia support (e.g. for Apple server). #3598

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jowin202
Copy link

@jowin202 jowin202 commented Aug 9, 2024

add autostart to ollama and add ollama without nvidia support

Summary

The docker-compose file should suggest an ollama installation where the autostart is activated by default.
I spend one day figuring out why the chat did not work after reboot. Therfore, ollama should start automatically like librechat.

For the apple servers, there is no nvidia support needed. Therefore, a code block without nvidia is helpful for a fast proof-of-concept installation.

add autostart to ollama and add ollama without nvidia support
@berry-13
Copy link
Collaborator

berry-13 commented Aug 9, 2024

@jowin202, what's the purpose of this? Couldn't someone simply delete the deploy section? You could include a default Ollama without NVIDIA support, and then at the bottom of the Ollama configuration, you could add a comment like # NVIDIA support. This way, people can easily uncomment it if they want to enable NVIDIA. It would also be fantastic if you could add AMD support as well!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants