Installed models
No models installed yet. Search below and download one.
Disk usage
Local runtime (OpenVINO Model Server)
- OVMS
- Checking…
- Visual C++ runtime
- Checking…
The Visual C++ runtime is missing. Install it from a terminal, then reopen Settings:
winget install --id Microsoft.VCRedist.2015+.x64 -e
Downloads
No downloads in progress.
Find models
Local (NPU)
Built inThe NPU is the most power-efficient choice. Changing the device recompiles the model on its next load.
Advanced
From 1024 to 8192. Reload required: the model recompiles when this changes. Larger windows use more memory and take longer to compile.
Reload required: the local model reloads with the new settings the next time it is used.
Idle unload time is under General.
Model lists
Providers add new models over time. Refresh reads each provider's current list with its saved key; providers without a key are skipped.
Add a custom provider
Any OpenAI-compatible endpoint. The key is stored in Windows Credential Manager, or read from the environment variable you name.