Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support different LLMs for different agents #17

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Conversation

zhangzaibin
Copy link
Member

This PR is to fix issue #15

This PR includes the following modifications:

  1. During the inference phase, the agent_id is passed to the inference_manager, where a distribution mechanism is designed to assign different ports to different agents, enabling hybrid LLMs simulation.
  2. In the test folder, I have added testing functions and a test project for the OASIS inference system. Actual tests show that the parallelization design significantly reduces inference time.
  3. Other minor fixes.

@yiyiyi0817
Copy link
Member

@zhangzaibin Hello, thanks for the contribute and I am reviewing the PR. A preliminary advice is that could you please fix the format check first? Reference in https://github.com/camel-ai/camel/blob/master/CONTRIBUTING.md.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants