Update README.md
#16
by
Junrulu
- opened
README.md
CHANGED
|
@@ -222,6 +222,14 @@ To enable tool calling capabilities, please append the following arguments to th
|
|
| 222 |
--enable-auto-tool-choice --tool-call-parser hermes
|
| 223 |
```
|
| 224 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 225 |
<a id="highlights"></a>
|
| 226 |
|
| 227 |
## 💡 Highlights
|
|
|
|
| 222 |
--enable-auto-tool-choice --tool-call-parser hermes
|
| 223 |
```
|
| 224 |
|
| 225 |
+
### 5. llama.cpp Deployment
|
| 226 |
+
|
| 227 |
+
For macOS, you can install and use Youtu-LLM as follows:
|
| 228 |
+
```bash
|
| 229 |
+
brew install llama.cpp
|
| 230 |
+
llama-server -hf tencent/Youtu-LLM-2B-GGUF:Q8_0 --host 0.0.0.0 --port 8081 --log-disable
|
| 231 |
+
```
|
| 232 |
+
|
| 233 |
<a id="highlights"></a>
|
| 234 |
|
| 235 |
## 💡 Highlights
|