How to use CRD716/ggml-vicuna-1.1-quantized with Adapters:
from adapters import AutoAdapterModel model = AutoAdapterModel.from_pretrained("undefined") model.load_adapter("CRD716/ggml-vicuna-1.1-quantized", set_active=True)
