build(docker): pin the llama.cpp image by digest
The :server-cuda tag is a moving target, so a fresh pull could silently change server behaviour (flags, the baked-in healthcheck, ...). Pin the default image to the current digest for reproducibility; overriding `image` in the config or via --image still works. A comment documents how to bump the pin. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
parent
d72361cbae
commit
c553654aae
3 changed files with 9 additions and 3 deletions
|
|
@ -34,7 +34,8 @@ testbar von der Orchestrierung.
|
|||
|
||||
1. **Eingebaute Defaults** (`config.builtin_defaults()`) — spiegeln die
|
||||
Standardwerte der ursprünglichen Shell-Skripte wider (Image
|
||||
`ghcr.io/ggml-org/llama.cpp:server-cuda`, `host_port=8001`,
|
||||
`ghcr.io/ggml-org/llama.cpp` per Digest gepinnt für Reproduzierbarkeit,
|
||||
`host_port=8001`,
|
||||
`container_name=va_llm`, `gpu_device=1`, `jinja/fa/kv_unified/
|
||||
cont_batching/no_context_shift=true`, `reasoning=on`,
|
||||
`cache_type_k/v=q4_0`, `batch_size=1024`, `ubatch_size=512`,
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue