BricksLLM Docker

This repository serves as a quick way to try out/develop BricksLLM AI gateway using the docker compose. It helps set up dependencies such as

• Postgresql - BricksLLM uses Postgresql for storing gateway configurations.
• Redis - It is used for caching purposes such as rating limiting and cost controlling API calls to third party LLM models.

Prerequisites

• docker-compose

Getting started

First set up your OpenAI credential

export OPENAI_API_KEY=YOUR_OPENAI_API_KEY

Then run docker-compose

docker-compose up -d