<p align="left">
    <img src="https://cdn-icons-png.flaticon.com/512/8618/8618901.png" align="left" width="30%">
</p>
<p align="left"><h1 align="left">LITELLM</h1></p>
<p align="left">
	<em><code>❯ REPLACE-ME</code></em>
</p>
<p align="left">
	<img src="https://img.shields.io/github/license/BerriAI/litellm?style=flat-square&logo=opensourceinitiative&logoColor=white&color=gold" alt="license">
	<img src="https://img.shields.io/github/last-commit/BerriAI/litellm?style=flat-square&logo=git&logoColor=white&color=gold" alt="last-commit">
	<img src="https://img.shields.io/github/languages/top/BerriAI/litellm?style=flat-square&color=gold" alt="repo-top-language">
	<img src="https://img.shields.io/github/languages/count/BerriAI/litellm?style=flat-square&color=gold" alt="repo-language-count">
</p>
<p align="left">Built with the tools and technologies:</p>
<p align="left">
	<img src="https://img.shields.io/badge/Resend-000000.svg?style=flat-square&logo=Resend&logoColor=white" alt="Resend">
	<img src="https://img.shields.io/badge/Anthropic-191919.svg?style=flat-square&logo=Anthropic&logoColor=white" alt="Anthropic">
	<img src="https://img.shields.io/badge/Redis-DC382D.svg?style=flat-square&logo=Redis&logoColor=white" alt="Redis">
	<img src="https://img.shields.io/badge/Prometheus-E6522C.svg?style=flat-square&logo=Prometheus&logoColor=white" alt="Prometheus">
	<img src="https://img.shields.io/badge/JavaScript-F7DF1E.svg?style=flat-square&logo=JavaScript&logoColor=black" alt="JavaScript">
	<img src="https://img.shields.io/badge/Gunicorn-499848.svg?style=flat-square&logo=Gunicorn&logoColor=white" alt="Gunicorn">
	<img src="https://img.shields.io/badge/FastAPI-009688.svg?style=flat-square&logo=FastAPI&logoColor=white" alt="FastAPI">
	<img src="https://img.shields.io/badge/NumPy-013243.svg?style=flat-square&logo=NumPy&logoColor=white" alt="NumPy">
	<br>
	<img src="https://img.shields.io/badge/Pytest-0A9EDC.svg?style=flat-square&logo=Pytest&logoColor=white" alt="Pytest">
	<img src="https://img.shields.io/badge/Docker-2496ED.svg?style=flat-square&logo=Docker&logoColor=white" alt="Docker">
	<img src="https://img.shields.io/badge/Python-3776AB.svg?style=flat-square&logo=Python&logoColor=white" alt="Python">
	<img src="https://img.shields.io/badge/TypeScript-3178C6.svg?style=flat-square&logo=TypeScript&logoColor=white" alt="TypeScript">
	<img src="https://img.shields.io/badge/GitHub%20Actions-2088FF.svg?style=flat-square&logo=GitHub-Actions&logoColor=white" alt="GitHub%20Actions">
	<img src="https://img.shields.io/badge/Poetry-60A5FA.svg?style=flat-square&logo=Poetry&logoColor=white" alt="Poetry">
	<img src="https://img.shields.io/badge/Prisma-2D3748.svg?style=flat-square&logo=Prisma&logoColor=white" alt="Prisma">
	<img src="https://img.shields.io/badge/AIOHTTP-2C5BB4.svg?style=flat-square&logo=AIOHTTP&logoColor=white" alt="AIOHTTP">
	<img src="https://img.shields.io/badge/OpenAI-412991.svg?style=flat-square&logo=OpenAI&logoColor=white" alt="OpenAI">
	<img src="https://img.shields.io/badge/Google%20Gemini-8E75B2.svg?style=flat-square&logo=Google-Gemini&logoColor=white" alt="Google%20Gemini">
	<img src="https://img.shields.io/badge/Pydantic-E92063.svg?style=flat-square&logo=Pydantic&logoColor=white" alt="Pydantic">
</p>
<br>

<details><summary>Table of Contents</summary>

- [📍 Overview](#-overview)
- [👾 Features](#-features)
- [📁 Project Structure](#-project-structure)
  - [📂 Project Index](#-project-index)
- [🚀 Getting Started](#-getting-started)
  - [☑️ Prerequisites](#-prerequisites)
  - [⚙️ Installation](#-installation)
  - [🤖 Usage](#🤖-usage)
  - [🧪 Testing](#🧪-testing)
- [📌 Project Roadmap](#-project-roadmap)
- [🔰 Contributing](#-contributing)
- [🎗 License](#-license)
- [🙌 Acknowledgments](#-acknowledgments)

</details>
<hr>

## 📍 Overview

<code>❯ REPLACE-ME</code>

---

## 👾 Features

<code>❯ REPLACE-ME</code>

---

## 📁 Project Structure

```sh
└── litellm/
    ├── .github
    ├── Dockerfile
    ├── LICENSE
    ├── README.md
    ├── ci_cd
    ├── codecov.yaml
    ├── cookbook
    ├── db_scripts
    ├── deploy
    ├── docker
    ├── docker-compose.yml
    ├── docs
    ├── enterprise
    ├── index.yaml
    ├── litellm
    ├── litellm-js
    ├── model_prices_and_context_window.json
    ├── mypy.ini
    ├── package-lock.json
    ├── package.json
    ├── poetry.lock
    ├── prometheus.yml
    ├── proxy_server_config.yaml
    ├── pyproject.toml
    ├── pyrightconfig.json
    ├── render.yaml
    ├── requirements.txt
    ├── ruff.toml
    ├── schema.prisma
    ├── security.md
    ├── tests
    └── ui
```


### 📂 Project Index
<details open>
	<summary><b><code>LITELLM/</code></b></summary>
	<details> <!-- __root__ Submodule -->
		<summary><b>__root__</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/render.yaml'>render.yaml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/pyrightconfig.json'>pyrightconfig.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/requirements.txt'>requirements.txt</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/codecov.yaml'>codecov.yaml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/proxy_server_config.yaml'>proxy_server_config.yaml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/Dockerfile'>Dockerfile</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/schema.prisma'>schema.prisma</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/pyproject.toml'>pyproject.toml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/mypy.ini'>mypy.ini</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/package-lock.json'>package-lock.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/package.json'>package.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ruff.toml'>ruff.toml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker-compose.yml'>docker-compose.yml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/model_prices_and_context_window.json'>model_prices_and_context_window.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/prometheus.yml'>prometheus.yml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/index.yaml'>index.yaml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
		</blockquote>
	</details>
	<details> <!-- ui Submodule -->
		<summary><b>ui</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/requirements.txt'>requirements.txt</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/Dockerfile'>Dockerfile</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/admin.py'>admin.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/package-lock.json'>package-lock.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/package.json'>package.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
			<details>
				<summary><b>litellm-dashboard</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/build_ui_custom_path.sh'>build_ui_custom_path.sh</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/tailwind.config.js'>tailwind.config.js</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/next.config.mjs'>next.config.mjs</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/build_ui.sh'>build_ui.sh</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/ui_colors.json'>ui_colors.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/tailwind.config.ts'>tailwind.config.ts</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/package-lock.json'>package-lock.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/package.json'>package.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/tsconfig.json'>tsconfig.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/postcss.config.js'>postcss.config.js</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/.eslintrc.json'>.eslintrc.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>out</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/model_hub.txt'>model_hub.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/index.html'>index.html</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/index.txt'>index.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/404.html'>404.html</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/model_hub.html'>model_hub.html</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/onboarding.txt'>onboarding.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/out/onboarding.html'>onboarding.html</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>src</b></summary>
						<blockquote>
							<details>
								<summary><b>app</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/app/layout.tsx'>layout.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/app/page.tsx'>page.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/app/globals.css'>globals.css</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
									<details>
										<summary><b>model_hub</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/app/model_hub/page.tsx'>page.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
									<details>
										<summary><b>onboarding</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/app/onboarding/page.tsx'>page.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
								</blockquote>
							</details>
							<details>
								<summary><b>components</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/settings.tsx'>settings.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/view_users.tsx'>view_users.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/navbar.tsx'>navbar.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/request_model_access.tsx'>request_model_access.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/networking.tsx'>networking.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/edit_user.tsx'>edit_user.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/dashboard_default_team.tsx'>dashboard_default_team.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/onboarding_link.tsx'>onboarding_link.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/create_key_button.tsx'>create_key_button.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/view_key_table.tsx'>view_key_table.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/key_value_input.tsx'>key_value_input.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/user_dashboard.tsx'>user_dashboard.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/delete_model_button.tsx'>delete_model_button.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/api_ref.tsx'>api_ref.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/model_hub.tsx'>model_hub.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/model_dashboard.tsx'>model_dashboard.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/add_fallbacks.tsx'>add_fallbacks.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/pass_through_settings.tsx'>pass_through_settings.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/add_pass_through.tsx'>add_pass_through.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/leftnav.tsx'>leftnav.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/usage.tsx'>usage.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/cache_dashboard.tsx'>cache_dashboard.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/view_user_spend.tsx'>view_user_spend.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/chat_ui.tsx'>chat_ui.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/view_user_team.tsx'>view_user_team.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/teams.tsx'>teams.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/create_user_button.tsx'>create_user_button.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/general_settings.tsx'>general_settings.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/enter_proxy_url.tsx'>enter_proxy_url.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/admins.tsx'>admins.tsx</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
									<details>
										<summary><b>alerting</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/alerting/alerting_settings.tsx'>alerting_settings.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/alerting/dynamic_form.tsx'>dynamic_form.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
									<details>
										<summary><b>model_metrics</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/model_metrics/time_to_first_token.tsx'>time_to_first_token.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
									<details>
										<summary><b>model_add</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/model_add/dynamic_form.tsx'>dynamic_form.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
									<details>
										<summary><b>budgets</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/budgets/budget_settings.tsx'>budget_settings.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/budgets/edit_budget_modal.tsx'>edit_budget_modal.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/budgets/budget_modal.tsx'>budget_modal.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/litellm-dashboard/src/components/budgets/budget_panel.tsx'>budget_panel.tsx</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
								</blockquote>
							</details>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>pages</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ui/pages/user.py'>user.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
		</blockquote>
	</details>
	<details> <!-- docker Submodule -->
		<summary><b>docker</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/Dockerfile.alpine'>Dockerfile.alpine</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/Dockerfile.non_root'>Dockerfile.non_root</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/build_admin_ui.sh'>build_admin_ui.sh</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/.env.example'>.env.example</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/Dockerfile.database'>Dockerfile.database</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/Dockerfile.custom_ui'>Dockerfile.custom_ui</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/docker/entrypoint.sh'>entrypoint.sh</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
		</blockquote>
	</details>
	<details> <!-- ci_cd Submodule -->
		<summary><b>ci_cd</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ci_cd/check_file_length.py'>check_file_length.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/ci_cd/check_files_match.py'>check_files_match.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
		</blockquote>
	</details>
	<details> <!-- enterprise Submodule -->
		<summary><b>enterprise</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/utils.py'>utils.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
			<details>
				<summary><b>enterprise_callbacks</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_callbacks/generic_api_callback.py'>generic_api_callback.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_callbacks/example_logging_api.py'>example_logging_api.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>cloudformation_stack</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/cloudformation_stack/litellm.yaml'>litellm.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>enterprise_hooks</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/blocked_user_list.py'>blocked_user_list.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/aporia_ai.py'>aporia_ai.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/openai_moderation.py'>openai_moderation.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secret_detection.py'>secret_detection.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/google_text_moderation.py'>google_text_moderation.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/llm_guard.py'>llm_guard.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/llama_guard.py'>llama_guard.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/banned_keywords.py'>banned_keywords.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>secrets_plugins</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/bitbucket.py'>bitbucket.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/microsoft_teams_webhook.py'>microsoft_teams_webhook.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/scalingo_api_token.py'>scalingo_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/messagebird.py'>messagebird.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/sendinblue_api_token.py'>sendinblue_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/twitch_api_token.py'>twitch_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/lob.py'>lob.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/openai_api_key.py'>openai_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/authress_access_key.py'>authress_access_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/pulumi_api_token.py'>pulumi_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/age_secret_key.py'>age_secret_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/heroku_api_key.py'>heroku_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/telegram_bot_api_token.py'>telegram_bot_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/atlassian_api_token.py'>atlassian_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/finnhub_access_token.py'>finnhub_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/asana.py'>asana.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/nytimes_access_token.py'>nytimes_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/shopify.py'>shopify.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/gitlab.py'>gitlab.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/finicity.py'>finicity.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/datadog_access_token.py'>datadog_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/fastly_api_token.py'>fastly_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/adafruit.py'>adafruit.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/linear.py'>linear.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/readme_api_token.py'>readme_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/discord.py'>discord.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/rubygems_api_token.py'>rubygems_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/postman_api_token.py'>postman_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/freshbooks_access_token.py'>freshbooks_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/okta_access_token.py'>okta_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/easypost.py'>easypost.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/yandex.py'>yandex.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/flutterwave.py'>flutterwave.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/hashicorp_tf_api_token.py'>hashicorp_tf_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/grafana.py'>grafana.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/frameio_api_token.py'>frameio_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/digitalocean.py'>digitalocean.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/prefect_api_token.py'>prefect_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/gocardless_api_token.py'>gocardless_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/codecov_access_token.py'>codecov_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/kucoin.py'>kucoin.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/jfrog.py'>jfrog.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/clojars_api_token.py'>clojars_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/sumologic.py'>sumologic.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/contentful_api_token.py'>contentful_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/dropbox.py'>dropbox.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/confluent.py'>confluent.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/coinbase_access_token.py'>coinbase_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/airtable_api_key.py'>airtable_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/bittrex.py'>bittrex.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/flickr_access_token.py'>flickr_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/new_relic.py'>new_relic.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/sendgrid_api_token.py'>sendgrid_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/dynatrace_api_token.py'>dynatrace_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/vault.py'>vault.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/twitter.py'>twitter.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/travisci_access_token.py'>travisci_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/rapidapi_access_token.py'>rapidapi_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/pypi_upload_token.py'>pypi_upload_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/huggingface.py'>huggingface.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/mailgun.py'>mailgun.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/mattermost_access_token.py'>mattermost_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/linkedin.py'>linkedin.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/algolia_api_key.py'>algolia_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/mapbox_api_token.py'>mapbox_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/alibaba.py'>alibaba.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/shippo_api_token.py'>shippo_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/planetscale.py'>planetscale.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/github_token.py'>github_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/intercom_api_key.py'>intercom_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/etsy_access_token.py'>etsy_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/typeform_api_token.py'>typeform_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/facebook_access_token.py'>facebook_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/sentry_access_token.py'>sentry_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/defined_networking_api_token.py'>defined_networking_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/hubspot_api_key.py'>hubspot_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/gitter_access_token.py'>gitter_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/netlify_access_token.py'>netlify_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/slack.py'>slack.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/launchdarkly_access_token.py'>launchdarkly_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/databricks_api_token.py'>databricks_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/duffel_api_token.py'>duffel_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/squarespace_access_token.py'>squarespace_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/doppler_api_token.py'>doppler_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/jwt.py'>jwt.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/gcp_api_key.py'>gcp_api_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/kraken_access_token.py'>kraken_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/snyk_api_token.py'>snyk_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/droneci_access_token.py'>droneci_access_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/sendbird.py'>sendbird.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/adobe.py'>adobe.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/beamer_api_token.py'>beamer_api_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_hooks/secrets_plugins/zendesk_secret_key.py'>zendesk_secret_key.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>enterprise_ui</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/enterprise/enterprise_ui/_enterprise_colors.json'>_enterprise_colors.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
		</blockquote>
	</details>
	<details> <!-- deploy Submodule -->
		<summary><b>deploy</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/Dockerfile.ghcr_base'>Dockerfile.ghcr_base</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
			<details>
				<summary><b>charts</b></summary>
				<blockquote>
					<details>
						<summary><b>litellm-helm</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/Chart.yaml'>Chart.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/.helmignore'>.helmignore</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/values.yaml'>values.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>charts</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/charts/postgresql-14.3.1.tgz'>postgresql-14.3.1.tgz</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/charts/redis-18.19.1.tgz'>redis-18.19.1.tgz</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>templates</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/deployment.yaml'>deployment.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/configmap-litellm.yaml'>configmap-litellm.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/NOTES.txt'>NOTES.txt</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/ingress.yaml'>ingress.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/secret-dbcredentials.yaml'>secret-dbcredentials.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/service.yaml'>service.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/hpa.yaml'>hpa.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/serviceaccount.yaml'>serviceaccount.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/secret-masterkey.yaml'>secret-masterkey.yaml</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/charts/litellm-helm/templates/_helpers.tpl'>_helpers.tpl</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>kubernetes</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/kubernetes/kub.yaml'>kub.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/kubernetes/service.yaml'>service.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>azure_resource_manager</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/azure_resource_manager/main.bicep'>main.bicep</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>azure_marketplace</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/azure_resource_manager/azure_marketplace/mainTemplate.json'>mainTemplate.json</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/deploy/azure_resource_manager/azure_marketplace/createUiDefinition.json'>createUiDefinition.json</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
		</blockquote>
	</details>
	<details> <!-- cookbook Submodule -->
		<summary><b>cookbook</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Proxy_Batch_Users.ipynb'>Proxy_Batch_Users.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_Petals.ipynb'>LiteLLM_Petals.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_Completion_Cost.ipynb'>LiteLLM_Completion_Cost.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_Test_Multiple_Providers.ipynb'>litellm_Test_Multiple_Providers.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/VLLM_Model_Testing.ipynb'>VLLM_Model_Testing.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_model_fallback.ipynb'>litellm_model_fallback.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_OpenRouter.ipynb'>LiteLLM_OpenRouter.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_test_multiple_llm_demo.ipynb'>litellm_test_multiple_llm_demo.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/mlflow_langchain_tracing_litellm_proxy.ipynb'>mlflow_langchain_tracing_litellm_proxy.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_Ollama.ipynb'>liteLLM_Ollama.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_User_Based_Rate_Limits.ipynb'>LiteLLM_User_Based_Rate_Limits.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_HuggingFace.ipynb'>LiteLLM_HuggingFace.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_clarifai_Demo.ipynb'>liteLLM_clarifai_Demo.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_Bedrock.ipynb'>LiteLLM_Bedrock.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_Langchain_Demo.ipynb'>liteLLM_Langchain_Demo.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_Baseten.ipynb'>liteLLM_Baseten.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_Getting_Started.ipynb'>liteLLM_Getting_Started.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Evaluating_LLMs.ipynb'>Evaluating_LLMs.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_VertextAI_Example.ipynb'>liteLLM_VertextAI_Example.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_function_calling.ipynb'>liteLLM_function_calling.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb'>Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_IBM_Watsonx.ipynb'>liteLLM_IBM_Watsonx.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/TogetherAI_liteLLM.ipynb'>TogetherAI_liteLLM.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_batch_completion.ipynb'>LiteLLM_batch_completion.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_A121_Jurrasic_example.ipynb'>liteLLM_A121_Jurrasic_example.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Parallel_function_calling.ipynb'>Parallel_function_calling.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_PromptLayer.ipynb'>LiteLLM_PromptLayer.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Benchmarking_LLMs_by_use_case.ipynb'>Benchmarking_LLMs_by_use_case.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb'>Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/result.html'>result.html</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_Streaming_Demo.ipynb'>liteLLM_Streaming_Demo.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_Comparing_LLMs.ipynb'>LiteLLM_Comparing_LLMs.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/liteLLM_Replicate_Demo.ipynb'>liteLLM_Replicate_Demo.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/LiteLLM_Azure_and_OpenAI_example.ipynb'>LiteLLM_Azure_and_OpenAI_example.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb'>Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
			<details>
				<summary><b>benchmark</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/benchmark/benchmark.py'>benchmark.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>eval_suites_mlflow_autoevals</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/benchmark/eval_suites_mlflow_autoevals/auto_evals.py'>auto_evals.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>misc</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/misc/sagmaker_streaming.py'>sagmaker_streaming.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/misc/migrate_proxy_config.py'>migrate_proxy_config.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/misc/config.yaml'>config.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/misc/openai_timeouts.py'>openai_timeouts.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/misc/dev_release.txt'>dev_release.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/misc/add_new_models.py'>add_new_models.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>codellama-server</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/codellama-server/README.MD'>README.MD</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/codellama-server/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>community-resources</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/community-resources/get_hf_models.py'>get_hf_models.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/community-resources/max_tokens.json'>max_tokens.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>litellm_proxy_server</b></summary>
				<blockquote>
					<details>
						<summary><b>grafana_dashboard</b></summary>
						<blockquote>
							<details>
								<summary><b>dashboard_1</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_proxy_server/grafana_dashboard/dashboard_1/grafana_dashboard.json'>grafana_dashboard.json</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>dashboard_v2</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_proxy_server/grafana_dashboard/dashboard_v2/grafana_dashboard.json'>grafana_dashboard.json</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>litellm_router</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/error_log.txt'>error_log.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/load_test_proxy.py'>load_test_proxy.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/load_test_queuing.py'>load_test_queuing.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/request_log.txt'>request_log.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/response_log.txt'>response_log.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/load_test_router.py'>load_test_router.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>test_questions</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/test_questions/question3.txt'>question3.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/test_questions/question2.txt'>question2.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router/test_questions/question1.txt'>question1.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>litellm_router_load_test</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/test_loadtest_router_withs3_cache.py'>test_loadtest_router_withs3_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/test_loadtest_router.py'>test_loadtest_router.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/test_loadtest_openai_client.py'>test_loadtest_openai_client.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>memory_usage</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/memory_usage/router_memory_usage copy.py'>router_memory_usage copy.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/memory_usage/router_endpoint.py'>router_endpoint.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/memory_usage/send_request.py'>send_request.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm_router_load_test/memory_usage/router_memory_usage.py'>router_memory_usage.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>logging_observability</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/logging_observability/LiteLLM_Langfuse.ipynb'>LiteLLM_Langfuse.ipynb</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/logging_observability/LiteLLM_Lunary.ipynb'>LiteLLM_Lunary.ipynb</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>litellm-ollama-docker-image</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm-ollama-docker-image/requirements.txt'>requirements.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm-ollama-docker-image/Dockerfile'>Dockerfile</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm-ollama-docker-image/test.py'>test.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/cookbook/litellm-ollama-docker-image/start.sh'>start.sh</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
		</blockquote>
	</details>
	<details> <!-- litellm-js Submodule -->
		<summary><b>litellm-js</b></summary>
		<blockquote>
			<details>
				<summary><b>proxy</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/proxy/package.json'>package.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/proxy/tsconfig.json'>tsconfig.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/proxy/wrangler.toml'>wrangler.toml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>src</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/proxy/src/index.ts'>index.ts</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>spend-logs</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/Dockerfile'>Dockerfile</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/schema.prisma'>schema.prisma</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/package-lock.json'>package-lock.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/package.json'>package.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/tsconfig.json'>tsconfig.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>src</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/src/index.ts'>index.ts</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm-js/spend-logs/src/_types.ts'>_types.ts</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
		</blockquote>
	</details>
	<details> <!-- db_scripts Submodule -->
		<summary><b>db_scripts</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/db_scripts/update_unassigned_teams.py'>update_unassigned_teams.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/db_scripts/create_views.py'>create_views.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
		</blockquote>
	</details>
	<details> <!-- .github Submodule -->
		<summary><b>.github</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/FUNDING.yml'>FUNDING.yml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/template.yaml'>template.yaml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/dependabot.yaml'>dependabot.yaml</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
			<details>
				<summary><b>workflows</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/update_release.py'>update_release.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/locustfile.py'>locustfile.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/lint.yml'>lint.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/read_pyproject_version.yml'>read_pyproject_version.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/ghcr_helm_deploy.yml'>ghcr_helm_deploy.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/auto_update_price_and_context_window_file.py'>auto_update_price_and_context_window_file.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/auto_update_price_and_context_window.yml'>auto_update_price_and_context_window.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/ghcr_deploy.yml'>ghcr_deploy.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/load_test.yml'>load_test.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/interpret_load_test.py'>interpret_load_test.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/redeploy_proxy.py'>redeploy_proxy.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/workflows/main.yml'>main.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>actions</b></summary>
				<blockquote>
					<details>
						<summary><b>helm-oci-chart-releaser</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/actions/helm-oci-chart-releaser/action.yml'>action.yml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>ISSUE_TEMPLATE</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/ISSUE_TEMPLATE/feature_request.yml'>feature_request.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/ISSUE_TEMPLATE/bug_report.yml'>bug_report.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/.github/ISSUE_TEMPLATE/config.yml'>config.yml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
		</blockquote>
	</details>
	<details> <!-- litellm Submodule -->
		<summary><b>litellm</b></summary>
		<blockquote>
			<table>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/_logging.py'>_logging.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/requirements.txt'>requirements.txt</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/_version.py'>_version.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/cost_calculator.py'>cost_calculator.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/cost.json'>cost.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/timeout.py'>timeout.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/model_prices_and_context_window_backup.json'>model_prices_and_context_window_backup.json</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/utils.py'>utils.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/py.typed'>py.typed</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/exceptions.py'>exceptions.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/scheduler.py'>scheduler.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router.py'>router.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/main.py'>main.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/budget_manager.py'>budget_manager.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/_redis.py'>_redis.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			<tr>
				<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/_service_logger.py'>_service_logger.py</a></b></td>
				<td><code>❯ REPLACE-ME</code></td>
			</tr>
			</table>
			<details>
				<summary><b>types</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/rerank.py'>rerank.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/files.py'>files.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/services.py'>services.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/completion.py'>completion.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/embedding.py'>embedding.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/adapter.py'>adapter.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/caching.py'>caching.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/utils.py'>utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/guardrails.py'>guardrails.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/router.py'>router.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>integrations</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/integrations/langfuse.py'>langfuse.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/integrations/prometheus.py'>prometheus.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/integrations/slack_alerting.py'>slack_alerting.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/integrations/argilla.py'>argilla.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/integrations/arize.py'>arize.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>llms</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/openai.py'>openai.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/vertex_ai.py'>vertex_ai.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/anthropic.py'>anthropic.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/custom_llm.py'>custom_llm.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/databricks.py'>databricks.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/cohere.py'>cohere.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/ollama.py'>ollama.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/bedrock.py'>bedrock.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/types/llms/azure_ai.py'>azure_ai.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>proxy</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/prisma_migration.py'>prisma_migration.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_new_secret_config.yaml'>_new_secret_config.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_types.py'>_types.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_logging.py'>_logging.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_config.yaml'>proxy_config.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_cli.py'>proxy_cli.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/llamaguard_prompt.txt'>llamaguard_prompt.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/litellm_pre_call_utils.py'>litellm_pre_call_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/lambda.py'>lambda.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/schema.prisma'>schema.prisma</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/caching_routes.py'>caching_routes.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_server.py'>proxy_server.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/utils.py'>utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/health_check.py'>health_check.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_super_secret_config.yaml'>_super_secret_config.yaml</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/custom_sso.py'>custom_sso.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/openapi.json'>openapi.json</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/start.sh'>start.sh</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/post_call_rules.py'>post_call_rules.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/route_llm_request.py'>route_llm_request.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>common_utils</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/load_config_utils.py'>load_config_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/callback_utils.py'>callback_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/openai_endpoint_utils.py'>openai_endpoint_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/http_parsing_utils.py'>http_parsing_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/encrypt_decrypt_utils.py'>encrypt_decrypt_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/swagger_utils.py'>swagger_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/admin_ui_utils.py'>admin_ui_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/common_utils/debug_utils.py'>debug_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>guardrails</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/init_guardrails.py'>init_guardrails.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_helpers.py'>guardrail_helpers.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>guardrail_hooks</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_hooks/aporia_ai.py'>aporia_ai.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py'>bedrock_guardrails.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_hooks/presidio.py'>presidio.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_hooks/custom_guardrail.py'>custom_guardrail.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_hooks/lakera_ai.py'>lakera_ai.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/guardrails/guardrail_hooks/guardrails_ai.py'>guardrails_ai.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>spend_tracking</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/spend_tracking/spend_management_endpoints.py'>spend_management_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/spend_tracking/spend_tracking_utils.py'>spend_tracking_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>health_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/health_endpoints/_health_endpoints.py'>_health_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>config_management_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/config_management_endpoints/pass_through_endpoints.py'>pass_through_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>vertex_ai_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/vertex_ai_endpoints/vertex_endpoints.py'>vertex_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/vertex_ai_endpoints/langfuse_endpoints.py'>langfuse_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/vertex_ai_endpoints/google_ai_studio_endpoints.py'>google_ai_studio_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>_experimental</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_experimental/post_call_rules.py'>post_call_rules.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>out</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_experimental/out/model_hub.txt'>model_hub.txt</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_experimental/out/index.html'>index.html</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_experimental/out/index.txt'>index.txt</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/_experimental/out/onboarding.txt'>onboarding.txt</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>openai_files_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/openai_files_endpoints/files_endpoints.py'>files_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>auth</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/route_checks.py'>route_checks.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/service_account_checks.py'>service_account_checks.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/auth_checks.py'>auth_checks.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/oauth2_check.py'>oauth2_check.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/model_checks.py'>model_checks.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/oauth2_proxy_hook.py'>oauth2_proxy_hook.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/auth_utils.py'>auth_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/auth_checks_organization.py'>auth_checks_organization.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/handle_jwt.py'>handle_jwt.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/rds_iam_token.py'>rds_iam_token.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/user_api_key_auth.py'>user_api_key_auth.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/auth/litellm_license.py'>litellm_license.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>analytics_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/analytics_endpoints/analytics_endpoints.py'>analytics_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>fine_tuning_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/fine_tuning_endpoints/endpoints.py'>endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>proxy_load_test</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/litellm_proxy_config.yaml'>litellm_proxy_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/locustfile.py'>locustfile.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/openai_endpoint.py'>openai_endpoint.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/simple_litellm_router_proxy.py'>simple_litellm_router_proxy.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/simple_litellm_proxy.py'>simple_litellm_proxy.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/simple_proxy.py'>simple_proxy.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>litellm_router_proxy</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/litellm_router_proxy/Dockerfile'>Dockerfile</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/proxy_load_test/litellm_router_proxy/main.py'>main.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>rerank_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/rerank_endpoints/endpoints.py'>endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>management_helpers</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_helpers/utils.py'>utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>hooks</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/cache_control_check.py'>cache_control_check.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/batch_redis_get.py'>batch_redis_get.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/dynamic_rate_limiter.py'>dynamic_rate_limiter.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/presidio_pii_masking.py'>presidio_pii_masking.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/prompt_injection_detection.py'>prompt_injection_detection.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/max_budget_limiter.py'>max_budget_limiter.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/parallel_request_limiter.py'>parallel_request_limiter.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/example_presidio_ad_hoc_recognizer.json'>example_presidio_ad_hoc_recognizer.json</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/hooks/azure_content_safety.py'>azure_content_safety.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>ui_crud_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/ui_crud_endpoints/proxy_setting_endpoints.py'>proxy_setting_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>management_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/key_management_endpoints.py'>key_management_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/team_endpoints.py'>team_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/sso_helper_utils.py'>sso_helper_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/organization_endpoints.py'>organization_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/ui_sso.py'>ui_sso.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/internal_user_endpoints.py'>internal_user_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/management_endpoints/team_callback_endpoints.py'>team_callback_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>db</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/db/base_client.py'>base_client.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/db/prisma_client.py'>prisma_client.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/db/create_views.py'>create_views.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/db/dynamo_db.py'>dynamo_db.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/db/check_migration.py'>check_migration.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>example_config_yaml</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/otel_test_config.yaml'>otel_test_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/custom_auth.py'>custom_auth.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/azure_config.yaml'>azure_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/aliases_config.yaml'>aliases_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/custom_auth_basic.py'>custom_auth_basic.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/bad_schema.prisma'>bad_schema.prisma</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/opentelemetry_config.yaml'>opentelemetry_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/disable_schema_update.yaml'>disable_schema_update.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/simple_config.yaml'>simple_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/load_balancer.yaml'>load_balancer.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/pass_through_config.yaml'>pass_through_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/langfuse_config.yaml'>langfuse_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/custom_guardrail.py'>custom_guardrail.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/custom_callbacks1.py'>custom_callbacks1.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/_health_check_test_config.yaml'>_health_check_test_config.yaml</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/custom_handler.py'>custom_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/example_config_yaml/custom_callbacks.py'>custom_callbacks.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>pass_through_endpoints</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/pass_through_endpoints/pass_through_endpoints.py'>pass_through_endpoints.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/pass_through_endpoints/types.py'>types.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/pass_through_endpoints/success_handler.py'>success_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/proxy/pass_through_endpoints/streaming_handler.py'>streaming_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>fine_tuning</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/fine_tuning/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>assistants</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/assistants/utils.py'>utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/assistants/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>secret_managers</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/secret_managers/google_secret_manager.py'>google_secret_manager.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/secret_managers/google_kms.py'>google_kms.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/secret_managers/aws_secret_manager.py'>aws_secret_manager.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/secret_managers/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/secret_managers/get_azure_ad_token_provider.py'>get_azure_ad_token_provider.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>rerank_api</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/rerank_api/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>realtime_api</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/realtime_api/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>integrations</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/arize_ai.py'>arize_ai.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/dynamodb.py'>dynamodb.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/supabase.py'>supabase.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/helicone.py'>helicone.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/prometheus_services.py'>prometheus_services.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/langsmith.py'>langsmith.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/galileo.py'>galileo.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/lago.py'>lago.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/traceloop.py'>traceloop.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/braintrust_logging.py'>braintrust_logging.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/opentelemetry.py'>opentelemetry.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/custom_logger.py'>custom_logger.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/logfire_logger.py'>logfire_logger.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/langtrace.py'>langtrace.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/weights_biases.py'>weights_biases.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/prompt_layer.py'>prompt_layer.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/custom_batch_logger.py'>custom_batch_logger.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/literal_ai.py'>literal_ai.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/prometheus.py'>prometheus.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/email_alerting.py'>email_alerting.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/custom_guardrail.py'>custom_guardrail.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/argilla.py'>argilla.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/athina.py'>athina.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/test_httpx.py'>test_httpx.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/greenscale.py'>greenscale.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/s3.py'>s3.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/lunary.py'>lunary.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/openmeter.py'>openmeter.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>langfuse</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/langfuse/langfuse_handler.py'>langfuse_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/langfuse/langfuse.py'>langfuse.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>_types</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/_types/open_inference.py'>open_inference.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>email_templates</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/email_templates/templates.py'>templates.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>prometheus_helpers</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/prometheus_helpers/prometheus_api.py'>prometheus_api.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>gcs_bucket</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/gcs_bucket/gcs_bucket.py'>gcs_bucket.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/gcs_bucket/gcs_bucket_base.py'>gcs_bucket_base.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>datadog</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/datadog/types.py'>types.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/datadog/utils.py'>utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/datadog/datadog.py'>datadog.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>SlackAlerting</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/SlackAlerting/utils.py'>utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/SlackAlerting/slack_alerting.py'>slack_alerting.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/SlackAlerting/batching_handler.py'>batching_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>opik</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/opik/opik.py'>opik.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/integrations/opik/utils.py'>utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>adapters</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/adapters/anthropic_adapter.py'>anthropic_adapter.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>deprecated_litellm_server</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/deprecated_litellm_server/requirements.txt'>requirements.txt</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/deprecated_litellm_server/Dockerfile'>Dockerfile</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/deprecated_litellm_server/.env.template'>.env.template</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/deprecated_litellm_server/server_utils.py'>server_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/deprecated_litellm_server/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>files</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/files/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>litellm_core_utils</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/redact_messages.py'>redact_messages.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/token_counter.py'>token_counter.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/streaming_utils.py'>streaming_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/asyncify.py'>asyncify.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/litellm_logging.py'>litellm_logging.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/json_validation_rule.py'>json_validation_rule.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/core_helpers.py'>core_helpers.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/mock_functions.py'>mock_functions.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/get_llm_provider_logic.py'>get_llm_provider_logic.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/realtime_streaming.py'>realtime_streaming.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/response_header_helpers.py'>response_header_helpers.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/streaming_chunk_builder_utils.py'>streaming_chunk_builder_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/llm_request_utils.py'>llm_request_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/logging_utils.py'>logging_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/exception_mapping_utils.py'>exception_mapping_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>llm_response_utils</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/llm_response_utils/convert_dict_to_response.py'>convert_dict_to_response.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/llm_response_utils/get_headers.py'>get_headers.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>audio_utils</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/audio_utils/utils.py'>utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>llm_cost_calc</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/llm_cost_calc/google.py'>google.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/litellm_core_utils/llm_cost_calc/utils.py'>utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>batch_completion</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/batch_completion/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>router_utils</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/client_initalization_utils.py'>client_initalization_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/fallback_event_handlers.py'>fallback_event_handlers.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/handle_error.py'>handle_error.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/batch_utils.py'>batch_utils.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/cooldown_cache.py'>cooldown_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/cooldown_callbacks.py'>cooldown_callbacks.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/cooldown_handlers.py'>cooldown_handlers.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/pattern_match_deployments.py'>pattern_match_deployments.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>router_callbacks</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_utils/router_callbacks/track_deployment_metrics.py'>track_deployment_metrics.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>llms</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_text.py'>azure_text.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/maritalk.py'>maritalk.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/palm.py'>palm.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/triton.py'>triton.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vllm.py'>vllm.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/volcengine.py'>volcengine.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/openrouter.py'>openrouter.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/replicate.py'>replicate.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/petals.py'>petals.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cloudflare.py'>cloudflare.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/gemini.py'>gemini.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/aleph_alpha.py'>aleph_alpha.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/ollama_chat.py'>ollama_chat.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/oobabooga.py'>oobabooga.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/text_completion_codestral.py'>text_completion_codestral.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/base_aws_llm.py'>base_aws_llm.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/baseten.py'>baseten.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/custom_llm.py'>custom_llm.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/watsonx.py'>watsonx.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/clarifai.py'>clarifai.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/huggingface_restapi.py'>huggingface_restapi.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/ollama.py'>ollama.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/base.py'>base.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/predibase.py'>predibase.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/nlp_cloud.py'>nlp_cloud.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
					<details>
						<summary><b>cohere</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cohere/rerank.py'>rerank.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cohere/embed.py'>embed.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cohere/completion.py'>completion.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cohere/cost_calculator.py'>cost_calculator.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cohere/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>tokenizers</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/tokenizers/anthropic_tokenizer.json'>anthropic_tokenizer.json</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/tokenizers/9b5ad71b2ce5302211f9c61530b329a4922fc6a4'>9b5ad71b2ce5302211f9c61530b329a4922fc6a4</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/tokenizers/ec7223a39ce59f226a68acc30dc1af2788490e15'>ec7223a39ce59f226a68acc30dc1af2788490e15</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/tokenizers/fb374d419588a4632f3f557e76b4b70aebbca790'>fb374d419588a4632f3f557e76b4b70aebbca790</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>sambanova</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/sambanova/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>fine_tuning_apis</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/fine_tuning_apis/azure.py'>azure.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/fine_tuning_apis/openai.py'>openai.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/fine_tuning_apis/vertex_ai.py'>vertex_ai.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>huggingface_llms_metadata</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/huggingface_llms_metadata/hf_text_generation_models.txt'>hf_text_generation_models.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/huggingface_llms_metadata/hf_conversational_models.txt'>hf_conversational_models.txt</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>AzureOpenAI</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/assistants.py'>assistants.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/azure.py'>azure.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/cost_calculation.py'>cost_calculation.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/audio_transcriptions.py'>audio_transcriptions.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/chat/o1_handler.py'>o1_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/chat/o1_transformation.py'>o1_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/chat/gpt_transformation.py'>gpt_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>realtime</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AzureOpenAI/realtime/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>files_apis</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/files_apis/azure.py'>azure.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>azure_ai</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/cost_calculator.py'>cost_calculator.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>embed</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/embed/cohere_transformation.py'>cohere_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/embed/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/chat/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/chat/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>rerank</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/rerank/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/azure_ai/rerank/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>databricks</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/databricks/cost_calculator.py'>cost_calculator.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/databricks/streaming_utils.py'>streaming_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/databricks/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/databricks/exceptions.py'>exceptions.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>groq</b></summary>
						<blockquote>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/groq/chat/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/groq/chat/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>stt</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/groq/stt/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>jina_ai</b></summary>
						<blockquote>
							<details>
								<summary><b>embedding</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/jina_ai/embedding/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>bedrock</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/image_generation.py'>image_generation.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>embed</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/embed/cohere_transformation.py'>cohere_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/embed/embedding.py'>embedding.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/embed/amazon_titan_multimodal_transformation.py'>amazon_titan_multimodal_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/embed/amazon_titan_g1_transformation.py'>amazon_titan_g1_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/embed/amazon_titan_v2_transformation.py'>amazon_titan_v2_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/chat/invoke_handler.py'>invoke_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/chat/converse_handler.py'>converse_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/bedrock/chat/converse_transformation.py'>converse_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>hosted_vllm</b></summary>
						<blockquote>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/hosted_vllm/chat/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>perplexity</b></summary>
						<blockquote>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/perplexity/chat/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>fireworks_ai</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/fireworks_ai/cost_calculator.py'>cost_calculator.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>embed</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/fireworks_ai/embed/fireworks_ai_transformation.py'>fireworks_ai_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/fireworks_ai/chat/fireworks_ai_transformation.py'>fireworks_ai_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>nvidia_nim</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/nvidia_nim/embed.py'>embed.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/nvidia_nim/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>anthropic</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/anthropic/completion.py'>completion.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/anthropic/cost_calculation.py'>cost_calculation.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/anthropic/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>experimental_pass_through</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/anthropic/experimental_pass_through/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/anthropic/chat/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/anthropic/chat/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>together_ai</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/together_ai/rerank.py'>rerank.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/together_ai/embed.py'>embed.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/together_ai/cost_calculator.py'>cost_calculator.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/together_ai/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>completion</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/together_ai/completion/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/together_ai/completion/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>vertex_ai_and_google_ai_studio</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_llm_base.py'>vertex_llm_base.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_ai_non_gemini.py'>vertex_ai_non_gemini.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>multimodal_embeddings</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/multimodal_embeddings/embedding_handler.py'>embedding_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>context_caching</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/context_caching/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/context_caching/vertex_ai_context_caching.py'>vertex_ai_context_caching.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>vertex_embeddings</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_embeddings/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_embeddings/embedding_handler.py'>embedding_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_embeddings/types.py'>types.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>gemini</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/gemini/transformation.py'>transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/gemini/vertex_and_google_ai_studio_gemini.py'>vertex_and_google_ai_studio_gemini.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>image_generation</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/image_generation/image_generation_handler.py'>image_generation_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>gemini_embeddings</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/gemini_embeddings/batch_embed_content_handler.py'>batch_embed_content_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/gemini_embeddings/batch_embed_content_transformation.py'>batch_embed_content_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>text_to_speech</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/text_to_speech/text_to_speech_handler.py'>text_to_speech_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>vertex_ai_partner_models</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_ai_partner_models/main.py'>main.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
									<details>
										<summary><b>llama3</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_ai_partner_models/llama3/transformation.py'>transformation.py</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
									<details>
										<summary><b>anthropic</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_ai_partner_models/anthropic/transformation.py'>transformation.py</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
									<details>
										<summary><b>ai21</b></summary>
										<blockquote>
											<table>
											<tr>
												<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/vertex_ai_and_google_ai_studio/vertex_ai_partner_models/ai21/transformation.py'>transformation.py</a></b></td>
												<td><code>❯ REPLACE-ME</code></td>
											</tr>
											</table>
										</blockquote>
									</details>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>cerebras</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/cerebras/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>openai_like</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/openai_like/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>embedding</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/openai_like/embedding/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>AI21</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AI21/completion.py'>completion.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/AI21/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>mistral</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/mistral/mistral_embedding_transformation.py'>mistral_embedding_transformation.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/mistral/embedding.py'>embedding.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/mistral/chat.py'>chat.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/mistral/mistral_chat_transformation.py'>mistral_chat_transformation.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>OpenAI</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/cost_calculation.py'>cost_calculation.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/audio_transcriptions.py'>audio_transcriptions.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/openai.py'>openai.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
							<details>
								<summary><b>chat</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/chat/o1_handler.py'>o1_handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/chat/gpt_audio_transformation.py'>gpt_audio_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/chat/o1_transformation.py'>o1_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/chat/gpt_transformation.py'>gpt_transformation.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>completion</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/completion/utils.py'>utils.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
							<details>
								<summary><b>realtime</b></summary>
								<blockquote>
									<table>
									<tr>
										<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/OpenAI/realtime/handler.py'>handler.py</a></b></td>
										<td><code>❯ REPLACE-ME</code></td>
									</tr>
									</table>
								</blockquote>
							</details>
						</blockquote>
					</details>
					<details>
						<summary><b>sagemaker</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/sagemaker/sagemaker.py'>sagemaker.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>prompt_templates</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/prompt_templates/image_handling.py'>image_handling.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/prompt_templates/factory.py'>factory.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/prompt_templates/common_utils.py'>common_utils.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
					<details>
						<summary><b>custom_httpx</b></summary>
						<blockquote>
							<table>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/custom_httpx/httpx_handler.py'>httpx_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/custom_httpx/types.py'>types.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							<tr>
								<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/llms/custom_httpx/http_handler.py'>http_handler.py</a></b></td>
								<td><code>❯ REPLACE-ME</code></td>
							</tr>
							</table>
						</blockquote>
					</details>
				</blockquote>
			</details>
			<details>
				<summary><b>batches</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/batches/main.py'>main.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>caching</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/disk_cache.py'>disk_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/qdrant_semantic_cache.py'>qdrant_semantic_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/s3_cache.py'>s3_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/dual_cache.py'>dual_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/caching.py'>caching.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/base_cache.py'>base_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/in_memory_cache.py'>in_memory_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/redis_cache.py'>redis_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/redis_semantic_cache.py'>redis_semantic_cache.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/caching/caching_handler.py'>caching_handler.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
			<details>
				<summary><b>router_strategy</b></summary>
				<blockquote>
					<table>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/lowest_cost.py'>lowest_cost.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/tag_based_routing.py'>tag_based_routing.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/simple_shuffle.py'>simple_shuffle.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/lowest_latency.py'>lowest_latency.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/lowest_tpm_rpm.py'>lowest_tpm_rpm.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/least_busy.py'>least_busy.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					<tr>
						<td><b><a href='https://github.com/BerriAI/litellm/blob/master/litellm/router_strategy/lowest_tpm_rpm_v2.py'>lowest_tpm_rpm_v2.py</a></b></td>
						<td><code>❯ REPLACE-ME</code></td>
					</tr>
					</table>
				</blockquote>
			</details>
		</blockquote>
	</details>
</details>

---
## 🚀 Getting Started

### ☑️ Prerequisites

Before getting started with litellm, ensure your runtime environment meets the following requirements:

- **Programming Language:** Python
- **Package Manager:** Pip, Npm, Poetry
- **Container Runtime:** Docker


### ⚙️ Installation

Install litellm using one of the following methods:

**Build from source:**

1. Clone the litellm repository:
```sh
❯ git clone https://github.com/BerriAI/litellm
```

2. Navigate to the project directory:
```sh
❯ cd litellm
```

3. Install the project dependencies:


**Using `pip`** &nbsp; [<img align="center" src="https://img.shields.io/badge/Pip-3776AB.svg?style={badge_style}&logo=pypi&logoColor=white" />](https://pypi.org/project/pip/)

```sh
❯ pip install -r requirements.txt, ui/requirements.txt, cookbook/litellm-ollama-docker-image/requirements.txt, litellm/requirements.txt, litellm/deprecated_litellm_server/requirements.txt
```

**Using `poetry`** &nbsp; [<img align="center" src="https://img.shields.io/endpoint?url=https://python-poetry.org/badge/v0.json" />](https://python-poetry.org/)

```sh
❯ poetry install
```


**Using `docker`** &nbsp; [<img align="center" src="https://img.shields.io/badge/Docker-2CA5E0.svg?style={badge_style}&logo=docker&logoColor=white" />](https://www.docker.com/)

```sh
❯ docker build -t BerriAI/litellm .
```




### 🤖 Usage
Run litellm using the following command:
**Using `pip`** &nbsp; [<img align="center" src="https://img.shields.io/badge/Pip-3776AB.svg?style={badge_style}&logo=pypi&logoColor=white" />](https://pypi.org/project/pip/)

```sh
❯ python {entrypoint}
```

**Using `poetry`** &nbsp; [<img align="center" src="https://img.shields.io/endpoint?url=https://python-poetry.org/badge/v0.json" />](https://python-poetry.org/)

```sh
❯ poetry run python {entrypoint}
```


**Using `docker`** &nbsp; [<img align="center" src="https://img.shields.io/badge/Docker-2CA5E0.svg?style={badge_style}&logo=docker&logoColor=white" />](https://www.docker.com/)

```sh
❯ docker run -it {image_name}
```


### 🧪 Testing
Run the test suite using the following command:
**Using `pip`** &nbsp; [<img align="center" src="https://img.shields.io/badge/Pip-3776AB.svg?style={badge_style}&logo=pypi&logoColor=white" />](https://pypi.org/project/pip/)

```sh
❯ pytest
```

**Using `poetry`** &nbsp; [<img align="center" src="https://img.shields.io/endpoint?url=https://python-poetry.org/badge/v0.json" />](https://python-poetry.org/)

```sh
❯ poetry run pytest
```

---
## 📌 Project Roadmap

- [X] **`Task 1`**: <strike>Implement feature one.</strike>
- [ ] **`Task 2`**: Implement feature two.
- [ ] **`Task 3`**: Implement feature three.

---

## 🔰 Contributing

- **💬 [Join the Discussions](https://github.com/BerriAI/litellm/discussions)**: Share your insights, provide feedback, or ask questions.
- **🐛 [Report Issues](https://github.com/BerriAI/litellm/issues)**: Submit bugs found or log feature requests for the `litellm` project.
- **💡 [Submit Pull Requests](https://github.com/BerriAI/litellm/blob/main/CONTRIBUTING.md)**: Review open PRs, and submit your own PRs.

<details closed>
<summary>Contributing Guidelines</summary>

1. **Fork the Repository**: Start by forking the project repository to your github account.
2. **Clone Locally**: Clone the forked repository to your local machine using a git client.
   ```sh
   git clone https://github.com/BerriAI/litellm
   ```
3. **Create a New Branch**: Always work on a new branch, giving it a descriptive name.
   ```sh
   git checkout -b new-feature-x
   ```
4. **Make Your Changes**: Develop and test your changes locally.
5. **Commit Your Changes**: Commit with a clear message describing your updates.
   ```sh
   git commit -m 'Implemented new feature x.'
   ```
6. **Push to github**: Push the changes to your forked repository.
   ```sh
   git push origin new-feature-x
   ```
7. **Submit a Pull Request**: Create a PR against the original project repository. Clearly describe the changes and their motivations.
8. **Review**: Once your PR is reviewed and approved, it will be merged into the main branch. Congratulations on your contribution!
</details>

<details closed>
<summary>Contributor Graph</summary>
<br>
<p align="left">
   <a href="https://github.com{/BerriAI/litellm/}graphs/contributors">
      <img src="https://contrib.rocks/image?repo=BerriAI/litellm">
   </a>
</p>
</details>

---

## 🎗 License

This project is protected under the [SELECT-A-LICENSE](https://choosealicense.com/licenses) License. For more details, refer to the [LICENSE](https://choosealicense.com/licenses/) file.

---

## 🙌 Acknowledgments

- List any resources, contributors, inspiration, etc. here.

---
