# AGENTS.md

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

## Setup

```
npm ci
```

## Commands

```
make help
make info
make install-dev
make bootstrap
make install-proxy-dev
make install-dev-ci
```

## Layout

- `tests/`        2911 source files
- `litellm/`      2255 source files
- `ui/`           1865 source files
- `enterprise/`   149 source files
- `litellm-rust/` 127 source files
- `cookbook/`     38 source files

## Conventions

- Tests live alongside the code they cover, following `.github/workflows/helm_unit_test.yml`.
- CI defines what passing means. See `.github/workflows/_test-unit-base.yml`, and keep it green.
- TODO: add the two or three conventions a newcomer always gets wrong here.

## Gotchas

- `ui/litellm-dashboard/src/lib/http/schema.d.ts` is 2158KB. It will not fit comfortably in context, so read it in parts.
- Copy `.env.example` before running anything that needs configuration.

---

Drafted by agentreadme.com from what is in this repository. Everything marked TODO
needs a human. Check it in as AGENTS.md at the root.