cloudflare

Braintrust AI Proxy (Cloudflare)

This directory contains an implementation of the Braintrust AI Proxy that runs on Cloudflare Workers. Because of their global network, you get the benefit of low latency and can scale up to millions of users.

Deploying

You'll need the following prerequisites:

• A Cloudflare account
• pnpm

By default, the worker uses the local @braintrust/proxy package, which you need to build. From the repository's root, run:

pnpm install
pnpm build

Then, you return to this directory and setup a KV namespace for the proxy:

wrangler kv:namespace create ai_proxy

Record the ID of the namespace that you just created. Then, copy wrangler-template.toml to wrangler.toml and replace <YOUR_KV_ID> with the ID of the namespace.

Finally, you can run the worker locally with

npx wrangler dev

or deploy it to Cloudflare with

npx wrangler deploy

Integrating into your own project

If you'd like to use the proxy in your own project, that's fine too! Simply install the @braintrust/proxy package with your favorite package manager, and follow/customize the implementation in proxy.ts.