docs(models): document oMLX OpenAI-compatible setup
This commit is contained in:
@@ -272,6 +272,8 @@ If `lm-studio` is not explicitly configured, registry adds an implicit discovera
|
||||
|
||||
Runtime discovery fetches models (`GET /models`) and synthesizes model entries with local defaults.
|
||||
|
||||
This path also works for local OpenAI-compatible servers that are not LM Studio. For example, set `LM_STUDIO_BASE_URL=http://127.0.0.1:11434/v1` to discover oMLX through the existing `/v1/models` flow. Do not configure oMLX as `ollama`: Ollama discovery uses native `/api/tags` and `/api/show` endpoints, not OpenAI `/v1/models`.
|
||||
|
||||
### Explicit provider discovery
|
||||
|
||||
You can configure discovery yourself:
|
||||
@@ -606,6 +608,18 @@ providers:
|
||||
name: Qwen 2.5 Coder 32B (local)
|
||||
```
|
||||
|
||||
For oMLX or another local OpenAI-compatible server with a discoverable `/v1/models` endpoint, prefer discovery instead of listing models by hand:
|
||||
|
||||
```yaml
|
||||
providers:
|
||||
omlx:
|
||||
baseUrl: http://127.0.0.1:11434/v1
|
||||
auth: none
|
||||
api: openai-completions
|
||||
discovery:
|
||||
type: openai-models-list
|
||||
```
|
||||
|
||||
### Hosted proxy with env-based key
|
||||
|
||||
```yaml
|
||||
|
||||
Reference in New Issue
Block a user