neuralmagic 's Collections Granite 3.1 Quantization
updated
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
• 3B • Updated • 72.7k
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
• 3B • Updated • 25
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
• 8B • Updated • 1.33k
• 1
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
• 8B • Updated • 427
• 2
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation
• 3B • Updated • 13
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation
• 8B • Updated • 40
• 1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
• 3B • Updated • 20
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
• 3B • Updated • 18
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation
• 8B • Updated • 17
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation
• 3B • Updated • 16
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation
• 8B • Updated • 30
• 1
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
• 8B • Updated • 17