title |
---|
Cloudflare Workers |
Create a new Cloudflare Worker and install @upstash/rag-chat
package.
npm create cloudflare@latest -- my-first-worker
cd my-first-worker
npm install @upstash/rag-chat
Create a Redis database using Upstash Console or Upstash CLI and copy the UPSTASH_REDIS_REST_URL
and UPSTASH_REDIS_REST_TOKEN
into your .dev.vars
file.
UPSTASH_REDIS_REST_URL=<YOUR_URL>
UPSTASH_REDIS_REST_TOKEN=<YOUR_TOKEN>
Create a Vector index using Upstash Console or Upstash CLI and copy the UPSTASH_VECTOR_REST_URL
and UPSTASH_VECTOR_REST_TOKEN
into your .dev.vars
file.
UPSTASH_VECTOR_REST_URL=<YOUR_URL>
UPSTASH_VECTOR_REST_TOKEN=<YOUR_TOKEN>
Navigate to QStash Console and copy the QSTASH_TOKEN
into your .dev.vars
file.
QSTASH_TOKEN=<YOUR_TOKEN>
Note that cache
must be set to false
in the Index
constructor for Cloudflare Workers as seen in the example below.
Update /src/index.ts
:
import { RAGChat, upstash } from "@upstash/rag-chat";
import { Index } from "@upstash/vector";
import { Redis } from "@upstash/redis/cloudflare";
export interface Env {
UPSTASH_REDIS_REST_TOKEN: string;
UPSTASH_REDIS_REST_URL: string;
UPSTASH_VECTOR_REST_TOKEN: string;
UPSTASH_VECTOR_REST_URL: string;
QSTASH_TOKEN: string;
}
export default {
async fetch(request, env, ctx): Promise<Response> {
const ragChat = new RAGChat({
redis: new Redis({
token: env.UPSTASH_REDIS_REST_TOKEN,
url: env.UPSTASH_REDIS_REST_URL
}),
vector: new Index({
token: env.UPSTASH_VECTOR_REST_TOKEN,
url: env.UPSTASH_VECTOR_REST_URL,
cache: false
}),
model: upstash("meta-llama/Meta-Llama-3-8B-Instruct", {
apiKey: env.QSTASH_TOKEN
}),
});
const response = await ragChat.chat("What is the speed of light?");
return new Response(response.output);
},
} satisfies ExportedHandler<Env>;
Run the Cloudflare Worker locally:
npx wrangler dev
Visit http://localhost:8787
For deployment, use the wrangler
CLI to securely set environment variables. Run the following command for each secret:
npx wrangler secret put SECRET_NAME
Replace SECRET_NAME
with the actual name of each environment variable (e.g., UPSTASH_REDIS_REST_URL
).
Deploy the Cloudflare Worker:
npx wrangler deploy