fix(bedrock): correct URL encoding for model params

[moritalous]

This pull request fixes an issue #740 by using Bedrock's Application Profile.

[RobertCraigie]

Ah thanks for tracking this down and opening a PR! Would you be able to add a unit test for this case to tests/lib/test_bedrock.py?

[moritalous]

The ARN of the Application Profile contains a unique inference_profile_id that is automatically assigned, but how should I write it?

I have the following ARN in my environment, but it will be a different ID in other AWS environments.

arn:aws:bedrock:us-east-1:637423213562:application-inference-profile/jf2sje1c0jnb

[RobertCraigie]

ah the test shouldn't hit the live API, all of our tests hit mocks.

here's an example from the test_bedrock.py file

@pytest.mark.respx()
def test_messages_retries(respx_mock: MockRouter) -> None:
    respx_mock.post(re.compile(r"https://bedrock-runtime\.us-east-1\.amazonaws\.com/model/.*/invoke")).mock(
        side_effect=[
            httpx.Response(500, json={"error": "server error"}, headers={"retry-after-ms": "10"}),
            httpx.Response(200, json={"foo": "bar"}),
        ]
    )
    sync_client.messages.create(
        max_tokens=1024,
        messages=[
            {
                "role": "user",
                "content": "Say hello there!",
            }
        ],
        model="anthropic.claude-3-sonnet-20240229-v1:0",
    )

    calls = cast("list[MockRequestCall]", respx_mock.calls)

    assert len(calls) == 2

    assert (
        calls[0].request.url
        == "https://bedrock-runtime.us-east-1.amazonaws.com/model/anthropic.claude-3-sonnet-20240229-v1:0/invoke"
    )
    assert (
        calls[1].request.url
        == "https://bedrock-runtime.us-east-1.amazonaws.com/model/anthropic.claude-3-sonnet-20240229-v1:0/invoke"
    )

[moritalous]

Thanks, I've added the test code.

[JCuomo]

tested and working!

[RobertCraigie]

Thanks!