---
title: "Directory Structure"
url: "/docs/adding_provider/directory_structure"
canonical_url: "https://docs.litellm.ai/docs/adding_provider/directory_structure"
type: "docs"
last_updated: "2026-10-03"
summary: "When adding a new provider, you need to create a directory for the provider that follows the following structure:"
related:
  - "/docs/contributing/adding_openai_compatible_providers"
  - "/docs/adding_provider/new_rerank_provider"
---
# Directory Structure

> Index of all LiteLLM docs: https://docs.litellm.ai/llms.txt


When adding a new provider, you need to create a directory for the provider that follows the following structure:

```
litellm/llms/
└── provider_name/
    ├── completion/ # use when endpoint is equivalent to openai's `/v1/completions`
    │   ├── handler.py
    │   └── transformation.py
    ├── chat/ # use when endpoint is equivalent to openai's `/v1/chat/completions`
    │   ├── handler.py
    │   └── transformation.py
    ├── embed/ # use when endpoint is equivalent to openai's `/v1/embeddings`
    │   ├── handler.py
    │   └── transformation.py
    ├── audio_transcription/ # use when endpoint is equivalent to openai's `/v1/audio/transcriptions`
    │   ├── handler.py
    │   └── transformation.py
    └── rerank/ # use when endpoint is equivalent to cohere's `/rerank` endpoint.
        ├── handler.py
        └── transformation.py
```

## Related pages

- [Adding OpenAI-Compatible Providers](https://docs.litellm.ai/docs/contributing/adding_openai_compatible_providers.md)
- [Add Rerank Provider](https://docs.litellm.ai/docs/adding_provider/new_rerank_provider.md)