dschlueter/my_voice_assistant
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

first commit

Browse source
This commit is contained in:
Dieter Schlüter 2026-06-16 02:21:26 +02:00
commit 670c6082a6
5 changed files with 886 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

18
README.md
View file

@ -55,6 +55,24 @@ python3 assistant.py --backend ollama --model llama3.2
python3 assistant.py --en-variant gb
```
## LLM-Backends
Der Assistent unterstützt jeden OpenAI-kompatiblen Endpunkt über `--api-url` und `--api-key`.
| Ziel | Befehl |
|---|---|
| llama.cpp lokal (Standard, Port 8001) | `python3 assistant.py` |
| llama.cpp auf anderem Port/Host | `--backend llama --api-url http://host:8080/v1` |
| Ollama lokal | `--backend ollama --model llama3.2` |
| Ollama remote | `--backend ollama --api-url http://server:11434/v1 --model llama3.2` |
| OpenAI | `--backend openai --model gpt-4o-mini` + `OPENAI_API_KEY` setzen |
| OpenRouter | `--backend openai --api-url https://openrouter.ai/api/v1 --model mistralai/mistral-7b-instruct --api-key $OPENROUTER_API_KEY` |
| Groq | `--backend openai --api-url https://api.groq.com/openai/v1 --model llama-3.1-70b-versatile --api-key $GROQ_API_KEY` |
| LM Studio | `--backend llama --api-url http://localhost:1234/v1` |
| Together AI | `--backend openai --api-url https://api.together.xyz/v1 --model meta-llama/Llama-3-8b-chat-hf --api-key $TOGETHER_API_KEY` |
Alle Provider, die die OpenAI Chat-Completions API implementieren, funktionieren mit `--backend openai --api-url <endpoint>`.
## Dateien
| Datei | Beschreibung |