---
license: llama3
datasets: Microsoft/ChatBench
language: en
base_model: microsoft/chatbench-llama3-8b
library_name: peft
tags:
- Microsoft
- ChatBench
- Interactive Benchmark
- User Simulator
- Benchmarking
- llama-cpp
- gguf-my-repo
---

# chatbench-llama3-8b
**Model creator:** [microsoft](https://huggingface.co/microsoft)<br/>
**Original model**: [microsoft/chatbench-llama3-8b](https://huggingface.co/microsoft/chatbench-llama3-8b)<br/>
**GGUF quantization:** provided by [ysn-rfd](https:/huggingface.co/ysn-rfd) using `llama.cpp`<br/>
## Special thanks
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
## Use with Ollama
```bash
ollama run "hf.co/ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0"
```
## Use with LM Studio
```bash
lms load "ysn-rfd/chatbench-llama3-8b-GGUF"
```
## Use with llama.cpp CLI
```bash
llama-cli --hf "ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0" -p "The meaning to life and the universe is"
```
## Use with llama.cpp Server:
```bash
llama-server --hf "ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0" -c 4096
```