feat(blocks): Add AI/ML API support to LLM blocks #9163

waterstark · 2025-01-01T13:06:28Z

Changes 🏗️

Added basic functionality to enable users to send requests to our models.
Added instructions for users on how to use the AI/ML API in AutoGPT.

Checklist 📋

For code changes:

I have clearly listed my changes in the PR description
I have made a test plan
I have tested my changes according to the test plan:
- The API key has been successfully added and saved to the user's profile.
- Sending requests to each model provided by us, enabling users to test them in a project with various max_tokens parameter values and other configurations.

Example test plan

Create from scratch and execute an agent with at least 3 blocks
Import an agent from file upload, and confirm it executes correctly
Upload agent to marketplace
Import an agent from marketplace and confirm it executes correctly
Edit an agent from monitor, and confirm it executes correctly

For configuration changes:

.env.example is updated or already compatible with my changes
docker-compose.yml is updated or already compatible with my changes
I have included a list of my configuration changes in the PR description (under Changes)

Examples of configuration changes

Changing ports
Adding new services that need to communicate with each other
Secrets or environment variable changes
New or infrastructure changes such as databases

CLAassistant · 2025-01-01T13:06:36Z

All committers have signed the CLA.

github-actions · 2025-01-01T13:06:41Z

This PR targets the master branch but does not come from dev or a hotfix/* branch.

Automatically setting the base branch to dev.

qodo-merge-pro · 2025-01-01T13:06:55Z

PR Reviewer Guide 🔍

Here are some key observations to aid the review process:

⏱️ Estimated effort to review: 4 🔵🔵🔵🔵⚪
🧪 No relevant tests
🔒 Security concerns API Key Exposure: The AIML API key is stored in environment variables and configuration files. While this is a common practice, ensure the .env file and configuration files have proper access restrictions and are not accidentally committed to version control.
⚡ Recommended focus areas for review Error Handling The AIML provider implementation lacks proper error handling for API failures and rate limits. Should add try-catch blocks and handle common API errors. elif provider == "aiml": client = openai.OpenAI( base_url="https://api.aimlapi.com/v2", api_key=credentials.api_key.get_secret_value(), ) completion = client.chat.completions.create( model=llm_model.value, messages=prompt, # type: ignore max_tokens=max_tokens, ) # response = completion.choices[0].message.content return ( completion.choices[0].message.content or "", completion.usage.prompt_tokens if completion.usage else 0, completion.usage.completion_tokens if completion.usage else 0, ) else: Token Counting Using GPT-3.5-turbo tokenizer as a hack for AIML models may lead to incorrect token counting since different models can have different tokenization schemes. def get_tokenizer(self, model_name: AimlModelName) -> ModelTokenizer[Any]: # HACK: No official tokenizer is available for AIML return tiktoken.encoding_for_model("gpt-3.5-turbo") Model Validation The code should validate that the provided model name exists in the AIML provider's model list before making API calls. completion = client.chat.completions.create( model=llm_model.value, messages=prompt, # type: ignore max_tokens=max_tokens, )

netlify · 2025-01-01T13:07:59Z

✅ Deploy Preview for auto-gpt-docs canceled.

Name	Link
🔨 Latest commit	`97b7fac`
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs/deploys/6786209460f41f0008b548dd

codecov · 2025-01-01T13:08:37Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Please upload report for BASE (dev@1ce1918). Learn more about missing BASE report.

Additional details and impacted files

@@          Coverage Diff           @@
##             dev    #9163   +/-   ##
======================================
  Coverage       ?   33.94%           
======================================
  Files          ?       16           
  Lines          ?     1258           
  Branches       ?      190           
======================================
  Hits           ?      427           
  Misses         ?      804           
  Partials       ?       27

Flag	Coverage Δ
Linux	`33.94% <ø> (?)`
Windows	`33.94% <ø> (?)`
autogpt-agent	`33.94% <ø> (?)`
macOS	`33.94% <ø> (?)`

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

netlify · 2025-01-02T09:14:38Z

✅ Deploy Preview for auto-gpt-docs-dev canceled.

Name	Link
🔨 Latest commit	`97b7fac`
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs-dev/deploys/67862094d6534600085fb3b6

…/AutoGPT into integration-with-aiml

autogpt_platform/backend/backend/blocks/llm.py

Pwuts · 2025-01-06T10:42:14Z

autogpt_platform/backend/backend/blocks/llm.py

@@ -35,6 +35,7 @@
    ProviderName.OLLAMA,
    ProviderName.OPENAI,
    ProviderName.OPEN_ROUTER,
+    ProviderName.AIML,


Suggested change

ProviderName.AIML,

ProviderName.AIML_API,

same for all other occurrences

autogpt_platform/backend/backend/integrations/credentials_store.py

Co-authored-by: Reinier van der Leer <[email protected]>

…e.py Co-authored-by: Reinier van der Leer <[email protected]>

aarushik93 · 2025-01-07T10:40:17Z

docs/content/classic/setup/index.md

@@ -175,6 +175,19 @@ If you don't know which to choose, you can safely go with OpenAI*.
 [anthropic/models]: https://docs.anthropic.com/en/docs/models-overview


+### AI/ML API
+1. Make sure you have credits in your account: [Billing -> View Usage](https://aimlapi.com/app/billing?utm_source=autogpt&utm_medium=github&utm_campaign=integration)


can we remove all the utm's please

hi!
We need the utms to evaluate the traffic from the project, and allocate the developer resources

(basically, I use them to prove to my team that open-source is important, and to grow our open-source integrators part of the team)

Hey @OctavianTheI - happy to discuss this
I've booked a call with you guys tomorrow via your website.

Pwuts · 2025-01-09T10:23:17Z

autogpt_platform/backend/backend/integrations/providers.py

@@ -4,6 +4,7 @@
 # --8<-- [start:ProviderName]
 class ProviderName(str, Enum):
    ANTHROPIC = "anthropic"
+    AIML_API = "aiml"


Suggested change

AIML_API = "aiml"

AIML_API = "aiml_api"

Pwuts · 2025-01-09T10:24:35Z

autogpt_platform/backend/backend/blocks/llm.py

@@ -433,6 +445,23 @@ def llm_call(
                response.usage.prompt_tokens if response.usage else 0,
                response.usage.completion_tokens if response.usage else 0,
            )
+        elif provider == "aiml":


Suggested change

elif provider == "aiml":

elif provider == "aiml_api":

Pwuts · 2025-01-09T10:25:02Z

autogpt_platform/backend/backend/integrations/credentials_store.py

@@ -49,6 +49,13 @@
    title="Use Credits for OpenAI",
    expires_at=None,
 )
+aiml_credentials = APIKeyCredentials(


Suggested change

aiml_credentials = APIKeyCredentials(

aiml_api_credentials = APIKeyCredentials(

Pwuts · 2025-01-09T10:25:22Z

autogpt_platform/backend/backend/integrations/credentials_store.py

@@ -49,6 +49,13 @@
    title="Use Credits for OpenAI",
    expires_at=None,
 )
+aiml_credentials = APIKeyCredentials(
+    id="aad82a89-9794-4ebb-977f-d736aa5260a3",
+    provider="aiml",


Suggested change

provider="aiml",

provider="aiml_api",

Pwuts · 2025-01-09T10:26:42Z

autogpt_platform/backend/backend/util/settings.py

@@ -266,6 +266,7 @@ class Secrets(UpdateTrackingModel["Secrets"], BaseSettings):
    )

    openai_api_key: str = Field(default="", description="OpenAI API key")
+    aiml_api_key: str = Field(default="", description="AI/ML API key")


Suggested change

aiml_api_key: str = Field(default="", description="AI/ML API key")

aiml_api_key: str = Field(default="", description="'AI/ML API' key")

Pwuts · 2025-01-09T10:26:53Z

autogpt_platform/frontend/src/app/profile/page.tsx

@@ -103,6 +103,7 @@ export default function PrivatePage() {
      "6b9fc200-4726-4973-86c9-cd526f5ce5db", // Replicate
      "53c25cb8-e3ee-465c-a4d1-e75a4c899c2a", // OpenAI
      "24e5d942-d9e3-4798-8151-90143ee55629", // Anthropic
+      "aad82a89-9794-4ebb-977f-d736aa5260a3", // AI/ML


Suggested change

"aad82a89-9794-4ebb-977f-d736aa5260a3", // AI/ML

"aad82a89-9794-4ebb-977f-d736aa5260a3", // AI/ML API

Pwuts · 2025-01-09T10:27:03Z

autogpt_platform/frontend/src/components/integrations/credentials-input.tsx

@@ -52,6 +52,7 @@ export const providerIcons: Record<
  github: FaGithub,
  google: FaGoogle,
  groq: fallbackIcon,
+  aiml: fallbackIcon,


Suggested change

aiml: fallbackIcon,

aiml_api: fallbackIcon,

Pwuts · 2025-01-09T10:27:28Z

autogpt_platform/frontend/src/lib/autogpt-server-api/types.ts

@@ -102,6 +102,7 @@ export type CredentialsType = "api_key" | "oauth2";
 // --8<-- [start:BlockIOCredentialsSubSchema]
 export const PROVIDER_NAMES = {
  ANTHROPIC: "anthropic",
+  AIML: "aiml",


Suggested change

AIML: "aiml",

AIML_API: "aiml_api",

Pwuts · 2025-01-09T10:27:37Z

autogpt_platform/frontend/src/components/integrations/credentials-provider.tsx

@@ -16,6 +16,7 @@ const CREDENTIALS_PROVIDER_NAMES = Object.values(

 // --8<-- [start:CredentialsProviderNames]
 const providerDisplayNames: Record<CredentialsProviderName, string> = {
+  aiml: "AI/ML",


Suggested change

aiml: "AI/ML",

aiml_api: "AI/ML API",

Pwuts · 2025-01-09T10:29:19Z

classic/original_autogpt/autogpt/app/config.py

Please git reset --hard dev -- classic docs/content/classic

…n-with-aiml

waterstark · 2025-01-14T09:50:57Z

Hi, could you review my PR again, please? I've made the changes you suggested. If there are any issues, let me know, and I'll address them. The only thing I couldn't get to work was the git reset --hard dev -- classic docs/content/classic command you recommended. Additionally, I'm unclear about what exactly needs to be added or modified in the checkbox.
Thank u in advance!

github-actions · 2025-01-18T16:52:01Z

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

waterstark added 3 commits December 25, 2024 12:13

Initial commit

48c28c3

Merge master to aiml

a2720f3

Integration with aiml api

3591306

waterstark requested a review from a team as a code owner January 1, 2025 13:06

waterstark requested review from aarushik93 and majdyz and removed request for a team January 1, 2025 13:06

github-actions bot changed the base branch from master to dev January 1, 2025 13:06

github-actions bot added documentation Improvements or additions to documentation Forge platform/frontend AutoGPT Platform - Front end platform/backend AutoGPT Platform - Back end platform/blocks size/l labels Jan 1, 2025

qodo-merge-pro bot added the Review effort [1-5]: 4 label Jan 1, 2025

Fix imports at config.py, minor changes at readme

0d6202c

github-actions bot added the Classic AutoGPT Agent label Jan 2, 2025

waterstark and others added 4 commits January 2, 2025 13:15

Merge branch 'dev' into integration-with-aiml

937b477

Fix

10fedd6

Merge branch 'integration-with-aiml' of https://github.com/waterstark…

c8b8086

…/AutoGPT into integration-with-aiml

Fix code style issues

ff6fa8d

Pwuts reviewed Jan 6, 2025

View reviewed changes

autogpt_platform/backend/backend/blocks/llm.py Outdated Show resolved Hide resolved

Pwuts reviewed Jan 6, 2025

View reviewed changes

autogpt_platform/backend/backend/integrations/credentials_store.py Outdated Show resolved Hide resolved

aarushik93 and others added 3 commits January 7, 2025 10:39

Update autogpt_platform/backend/backend/blocks/llm.py

142671e

Co-authored-by: Reinier van der Leer <[email protected]>

Update autogpt_platform/backend/backend/blocks/llm.py

996f8d4

Co-authored-by: Reinier van der Leer <[email protected]>

Update autogpt_platform/backend/backend/integrations/credentials_stor…

8ea7081

…e.py Co-authored-by: Reinier van der Leer <[email protected]>

aarushik93 reviewed Jan 7, 2025

View reviewed changes

waterstark added 2 commits January 8, 2025 15:19

Minor changes

d164486

Git pull

8f911a2

github-actions bot removed the Forge label Jan 8, 2025

Lint fixes

41414a7

Pwuts reviewed Jan 9, 2025

View reviewed changes

classic/original_autogpt/autogpt/app/config.py Outdated

Copy link

Member

Pwuts Jan 9, 2025 •

edited

Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please git reset --hard dev -- classic docs/content/classic

waterstark added 3 commits January 10, 2025 13:22

Minor changes

847ffe5

Merge https://github.com/Significant-Gravitas/AutoGPT into integratio…

9d93171

…n-with-aiml

Minor changes

fda0ad1

github-actions bot removed the Classic AutoGPT Agent label Jan 10, 2025

waterstark added 2 commits January 10, 2025 13:45

prettier fix

ed951b0

Lint fix

78a9677

github-actions bot added size/m and removed size/l labels Jan 13, 2025

Merge branch 'dev' into integration-with-aiml

97b7fac

github-actions bot added the conflicts Automatically applied to PRs with merge conflicts label Jan 18, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(blocks): Add AI/ML API support to LLM blocks #9163

feat(blocks): Add AI/ML API support to LLM blocks #9163

waterstark commented Jan 1, 2025

CLAassistant commented Jan 1, 2025 •

edited

Loading

github-actions bot commented Jan 1, 2025

qodo-merge-pro bot commented Jan 1, 2025

netlify bot commented Jan 1, 2025 •

edited

Loading

codecov bot commented Jan 1, 2025 •

edited

Loading

netlify bot commented Jan 2, 2025 •

edited

Loading

Pwuts Jan 6, 2025

aarushik93 Jan 7, 2025

OctavianTheI Jan 7, 2025 •

edited

Loading

Torantulino Jan 8, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025

Pwuts Jan 9, 2025 •

edited

Loading

waterstark commented Jan 14, 2025

github-actions bot commented Jan 18, 2025

	aiml_credentials = APIKeyCredentials(
	aiml_api_credentials = APIKeyCredentials(

	aiml_api_key: str = Field(default="", description="AI/ML API key")
	aiml_api_key: str = Field(default="", description="'AI/ML API' key")

	"aad82a89-9794-4ebb-977f-d736aa5260a3", // AI/ML
	"aad82a89-9794-4ebb-977f-d736aa5260a3", // AI/ML API

feat(blocks): Add AI/ML API support to LLM blocks #9163

Are you sure you want to change the base?

feat(blocks): Add AI/ML API support to LLM blocks #9163

Conversation

waterstark commented Jan 1, 2025

Changes 🏗️

Checklist 📋

For code changes:

For configuration changes:

CLAassistant commented Jan 1, 2025 • edited Loading

github-actions bot commented Jan 1, 2025

qodo-merge-pro bot commented Jan 1, 2025

PR Reviewer Guide 🔍

netlify bot commented Jan 1, 2025 • edited Loading

✅ Deploy Preview for auto-gpt-docs canceled.

codecov bot commented Jan 1, 2025 • edited Loading

Codecov Report

netlify bot commented Jan 2, 2025 • edited Loading

✅ Deploy Preview for auto-gpt-docs-dev canceled.

Choose a reason for hiding this comment

Choose a reason for hiding this comment

OctavianTheI Jan 7, 2025 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Pwuts Jan 9, 2025 • edited Loading

Choose a reason for hiding this comment

waterstark commented Jan 14, 2025

github-actions bot commented Jan 18, 2025

CLAassistant commented Jan 1, 2025 •

edited

Loading

netlify bot commented Jan 1, 2025 •

edited

Loading

codecov bot commented Jan 1, 2025 •

edited

Loading

netlify bot commented Jan 2, 2025 •

edited

Loading

OctavianTheI Jan 7, 2025 •

edited

Loading

Pwuts Jan 9, 2025 •

edited

Loading