olmo-13b-gguf

olmo-13b-gguf is a GGUF Q4_K_M quantized version of Allen AI Olmo 2 13B Instruct, providing a fast, small inference implementation, optimized for AI PCs.

Model Description

• Developed by: AllenAI
• Quantized by: bartowksi
• Model type: olmo2
• Parameters: 13 billion
• Model Parent: allenai/OLMo-2-1124-13B-Instruct
• Language(s) (NLP): English
• License: Apache 2.0
• Uses: Chat, general-purpose LLM
• Quantization: int4

Model Card Contact

llmware on hf

llmware website