QuantFactory/CodeLlama-7b-Instruct-hf-GGUF

Mistral-7B-v0.1-GGUF

• —Quantized version of CodeLlama-7b-Instruct-hf
• —Created using llama.cpp

Available Quants

• —Q2_K
• —Q3KL
• —Q3KM
• —Q3KS
• —Q4_0
• —Q4KM
• —Q4KS
• —Q5_0
• —Q5KM
• —Q5KS
• —Q6_K
• —Q8_0