From e0b71f1dbf2b826bd684c8c8d1344b0d0464f372 Mon Sep 17 00:00:00 2001 From: DrMelone <27028174+Classic298@users.noreply.github.com> Date: Tue, 30 Dec 2025 15:01:32 +0100 Subject: [PATCH] OR --- docs/getting-started/quick-start/starting-with-openai.mdx | 4 +++- docs/tutorials/tips/performance.md | 4 ++++ 2 files changed, 7 insertions(+), 1 deletion(-) diff --git a/docs/getting-started/quick-start/starting-with-openai.mdx b/docs/getting-started/quick-start/starting-with-openai.mdx index dada9c594..e2cecf058 100644 --- a/docs/getting-started/quick-start/starting-with-openai.mdx +++ b/docs/getting-started/quick-start/starting-with-openai.mdx @@ -71,7 +71,9 @@ Once Open WebUI is running: * *Set*: Acts as an **Allowlist**. Only the specific model IDs you enter here will be visible to users. Use this to hide older or expensive models. :::tip OpenRouter Recommendation - When using **OpenRouter**, we **highly recommend** using this allowlist (adding specific Model IDs). OpenRouter exposes thousands of models, which can clutter your model selector and slow down the admin panel if not filtered. + When using **OpenRouter**, we **highly recommend**: + 1. **Use an allowlist** (add specific Model IDs). OpenRouter exposes thousands of models, which can clutter your model selector and slow down the admin panel if not filtered. + 2. **Enable Model Caching** (`Settings > Connections > Cache Base Model List` or `ENABLE_BASE_MODELS_CACHE=True`). Without caching, page loads can take 10-15+ seconds on first visit due to querying a large number of models. See the [Performance Guide](/tutorials/tips/performance) for more details. ::: * **Prefix ID**: diff --git a/docs/tutorials/tips/performance.md b/docs/tutorials/tips/performance.md index 2d0c86004..2f8d51870 100644 --- a/docs/tutorials/tips/performance.md +++ b/docs/tutorials/tips/performance.md @@ -47,6 +47,10 @@ Configure these settings to reduce latency and external API usage. #### Model Caching Drastically reduces startup time and API calls to external providers. +:::warning Important for OpenRouter and Multi-Model Providers +If you are using **OpenRouter** or any provider with hundreds/thousands of models, enabling model caching is **highly recommended**. Without caching, initial page loads can take **10-15+ seconds** as the application queries all available models. Enabling the cache reduces this to near-instant. +::: + - **Admin Panel**: `Settings > Connections > Cache Base Model List` - **Env Var**: `ENABLE_BASE_MODELS_CACHE=True` * *Note*: Caches the list of models in memory. Only refreshes on App Restart or when clicking **Save** in Connections settings.