docs(models): document oMLX OpenAI-compatible setup

This commit is contained in:
danzaio
2026-06-09 01:35:49 -03:00
committed by can1357
parent 96defff9a5
commit b36f5c0785
2 changed files with 53 additions and 2 deletions
+14
View File
@@ -272,6 +272,8 @@ If `lm-studio` is not explicitly configured, registry adds an implicit discovera
Runtime discovery fetches models (`GET /models`) and synthesizes model entries with local defaults.
This path also works for local OpenAI-compatible servers that are not LM Studio. For example, set `LM_STUDIO_BASE_URL=http://127.0.0.1:11434/v1` to discover oMLX through the existing `/v1/models` flow. Do not configure oMLX as `ollama`: Ollama discovery uses native `/api/tags` and `/api/show` endpoints, not OpenAI `/v1/models`.
### Explicit provider discovery
You can configure discovery yourself:
@@ -606,6 +608,18 @@ providers:
name: Qwen 2.5 Coder 32B (local)
```
For oMLX or another local OpenAI-compatible server with a discoverable `/v1/models` endpoint, prefer discovery instead of listing models by hand:
```yaml
providers:
omlx:
baseUrl: http://127.0.0.1:11434/v1
auth: none
api: openai-completions
discovery:
type: openai-models-list
```
### Hosted proxy with env-based key
```yaml