New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Inconsistent Connection of AWS Bedrock from Lambda #302

Open

prashantsolanki975 opened this issue Sep 12, 2024 · 0 comments

prashantsolanki975 commented Sep 12, 2024

Hi Team!
We are trying to use AWS Bedrock from Lambda but there is some inconsistency again and again.

Sometime the Bedrock is connected and model gets invoked. but other times in the same lambda function with the same query/input it gets timeout.

[ERROR] 2024-09-12T02:53:02.888Z fed8c773-6e8d-47e0-9f15-23258903983a Unexpected error: Connect timeout on endpoint URL: "https://bedrock-runtime.ap-south-1.amazonaws.com/model/meta.llama3-8b-instruct-v1%3A0/invoke"

[ERROR] 2024-09-12T03:00:32.202Z fed8c773-6e8d-47e0-9f15-23258903983a Unexpected error: Connect timeout on endpoint URL: "https://bedrock-runtime.us-west-2.amazonaws.com/model/amazon.titan-embed-text-v2%3A0/invoke"

We are trying to use two different models from different region.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment