Prompt caching

[Kaankoska22]

Hi I couldn't make this call work what am I doing wrong?

const response = await anthropic.beta.prompt_caching.messages.create({
betas: ['prompt-caching-2024-07-31'],
model: "claude-3-5-sonnet-20241022",
max_tokens: 1024,
system: [
{
type: "text",
text: "You are an AI assistant tasked with analyzing literary works. Your goal is to provide insightful commentary on themes, characters, and writing style.\n",
},
{
type: "text",
text: Bigprompt,
cache_control: { type: "ephemeral" }
}
],
messages: [
{
role: "user",
content: "example query"
}
]
});

[IbrohimIsroilov]

I think they disabled promptCaching, countTokens.

function makeBetaResource(client: AnthropicBedrock): BetaResource {
const resource = new Resources.Beta(client);

// @ts-expect-error we're deleting non-optional properties
delete resource.promptCaching;

// @ts-expect-error we're deleting non-optional properties
delete resource.messages.batches;

// @ts-expect-error we're deleting non-optional properties
delete resource.messages.countTokens;

return resource;
}

[goodroot]

I don't think this is in the SDK yet :)