docs(config): clarify profile names and make examples copy-paste safe
Rename the size-numbered profiles so the digits read as parameter count, not Qwen version: qwen35 -> qwen35b (llama.cpp.config.example, build_archive smoke test, SECURITY_AND_OPERATIONS.md) and qwen27 -> qwen27b (llama.cpp.config). Drop the misleading `--profile qwen35` from the README/man/install examples: that profile only exists in the .example file, so pasted commands failed against the real config. Primary examples now omit --profile (using the [default] section, which always resolves), with one example plus a note showing how to select a real [model.<name>] profile. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
parent
53b6849c27
commit
d5a69e8bf8
7 changed files with 41 additions and 25 deletions
|
|
@ -63,10 +63,10 @@ chat_temperature =
|
|||
|
||||
# Example second model profile, pinned to the second GPU (e.g. RTX 3090 #2)
|
||||
# with its own port and container name so it can run alongside [default].
|
||||
[model.qwen35]
|
||||
[model.qwen35b]
|
||||
model_path = qwen3/Qwen3-35B-A3B-Q4_K_M.gguf
|
||||
model_alias = qwen35
|
||||
container_name = llama_cpp_qwen35
|
||||
model_alias = qwen35b
|
||||
container_name = llama_cpp_qwen35b
|
||||
host_port = 8002
|
||||
gpu_device = 1
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue